Data Engineer Consultant building and maintaining enriched data infrastructure for analytical thinking at Northwest Permanente. Involves data collection, cleansing, and transformation for business intelligence.
About the role
- Data Engineer creating Real-Time Data Processing applications for a leading iGaming operator. Work involves stream data manipulation and collaboration in an Agile environment.
Responsibilities
- Contribute to the design and development of Real-Time Data Processing applications
- Development and Maintenance of Real-Time Data Processing Applications
- Manipulation of Streaming Data: Ingestion, Transformation and Aggregation
- Keeping up to date on Research and Development of new Technologies and Techniques
- Collaborating closely with the Data DevOps team and other multi-disciplined teams
- Comfortable working in an Agile Environment involving SDLC
- Full ownership of Projects and Tasks assigned
- Able to document processes and perform Knowledge Sharing sessions
Requirements
- Strong knowledge in Scala
- Familiarity with Distributed Computing like Spark/KStreams/Kafka Connect
- Knowledge on Monolithic versus Microservice Architecture concepts
- Familiar with the Apache suite including Hadoop modules (HDFS, Yarn, HBase, Hive, Spark, Apache NiFi)
- Familiar with containerization and orchestration technologies such as Docker, Kubernetes
- Familiar with Time-series or Analytics Databases such as Elasticsearch
- Experience with Amazon Web Services (S3, EC2, EMR, Redshift)
- Familiar with Data Monitoring and Visualization tools such as Prometheus and Grafana
- Familiar with software versioning tools like Git
- Decent understanding of Data Warehouse and ETL concepts (Snowflake preferred)
- Strong analytical and problem-solving skills
- Good learning mindset
- Ability to prioritize and handle multiple tasks and projects
Benefits
- Hybrid work-from-home model
- Flexible working arrangements
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Vice President - Business, Data Architect role at TD Securities focusing on business data architecture and analytics capabilities. Collaborate with stakeholders to define and govern data models and ensure alignment with strategy.
Staff Data Engineer at Headspace building privacy - first data platforms for mental health support. Leading data engineering strategies and mentoring team members to enhance data - driven decision making.
Senior Data Engineer building and implementing data pipelines at Headspace. Collaborating with analytics and data science teams to enhance personalized mental health support.
Data Engineering Intern working on data pipelines and infrastructure in fast - growing fintech. Collaborating with data engineers, learning best practices and developing data solutions.
Senior Software Engineer building and maintaining data infrastructure for Gusto. Collaborating with Data Science and Business Intelligence teams to achieve their goals.
Data Engineer building and maintaining scalable data pipelines for AI Search Infrastructure at You.com. Collaborating across teams to ensure data quality and enable AI capabilities.
Data Engineer developing and managing technology - based data solutions for clients in different industries in Greece. Participating in software development lifecycle within Agile team setting.
Data Architect leading design and governance of high - quality data architectures for clients. Collaborating with engineering teams and stakeholders to transform business challenges into scalable data solutions.
Data Engineer supporting vehicle buying and selling solutions through integration pipelines. Collaborating with teams to build digital vehicle platforms and optimize data processes in São Paulo.