Data Engineer constructing and managing data warehouses for travel technology solutions at Onfly. Collaborating across teams to optimize data processing and integration solutions in a hybrid environment.
About the role
- Data Engineer at Cargill designing, building, and maintaining data systems using cloud technologies. Working with data pipelines and infrastructure to ensure data accessibility and usability.
Responsibilities
- Designs, builds and maintains moderately complex data systems
- Develops moderately complex data products and solutions using advanced data engineering and cloud based technologies
- Maintains and supports the development of streaming and batch data pipelines
- Reviews existing data systems and architectures
- Helps prepare data infrastructure to support the efficient storage and retrieval of data
- Implements automated deployment pipelines to improve efficiency of code deployments
- Performs moderately complex data modeling aligned with the datastore technology
Requirements
- Minimum requirement of 2 years of relevant work experience
- Familiarity with major cloud platforms (AWS, GCP, Azure)
- Experience with modern data architectures, including data lakes, data lakehouses, and data hubs
- Proficiency in data collection, ingestion tools (Kafka, AWS Glue), and storage formats (Iceberg, Parquet)
- Knowledge of streaming architectures and tools (Kafka, Flink)
- Strong background in data transformation and modeling using SQL-based frameworks and orchestration tools (dbt, AWS Glue, Airflow)
- Familiarity with using Spark for data transformation
- Proficient with programming in Python, Java, Scala, or similar languages
- Expert-level proficiency in SQL for data manipulation and optimization
- Understanding of data governance principles
Benefits
- Health insurance
- Retirement plans
- Paid time off
- Flexible work arrangements
- Professional development
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Data Engineer developing and maintaining efficient data pipelines for strategic client projects. Collaborating with teams to deliver valuable data insights and ensuring data quality and governance.
Data Engineer building and maintaining ETL pipelines for Northstrat's agile development team. Collaborating in a fast - paced environment with a focus on high - quality solutions.
Data Engineering Lead at BlackStone eIT managing a team and driving data solutions aligned with strategic goals. Collaborating with departments to ensure effective data management.
Data engineer designing custom data architectures at Zenika. Developing and maintaining data transformation pipelines, optimizing performance, and collaborating with cross - functional teams.
Senior Data Engineer responsible for AspenTech IP.21 implementation, leading a team for industrial data solutions.
Senior Data Engineer responsible for implementing and optimizing industrial data infrastructure at AG Solution. Leading a team and collaborating with various stakeholders to ensure data quality and reporting.
Lead Data Engineer designing scalable data architecture on Google Cloud Platform for infas 360. Collaborating with cross - functional teams to develop tailored data products in Bonn.
Data Engineer developing data platforms for Octopus Electric Vehicles. Build and optimise data solutions to transform insights for sustainable transportation.
Senior Data Engineer developing and maintaining data pipelines and solutions for EMC's data analytics products. Collaborating with cross - functional teams to ensure high - quality data management and governance practices.