Data Engineer constructing and managing data warehouses for travel technology solutions at Onfly. Collaborating across teams to optimize data processing and integration solutions in a hybrid environment.
About the role
- Senior Data Engineer designing and developing scalable data pipelines for fintech company. Collaborating with stakeholders to ensure analytics-ready data formats and supporting batch and streaming processes.
Responsibilities
- Design, develop, and maintain scalable data pipelines using Apache Spark (PySpark and/or Scala)
- Build and optimize data workflows on Databricks , including Delta Lake, notebooks, and scheduled jobs
- Ingest, transform, and curate large-scale structured and semi-structured datasets
- Perform performance tuning and cost optimization of Spark workloads and Databricks clusters
- Implement data quality checks, monitoring, and error handling
- Collaborate with analytics and business stakeholders to deliver well-modeled, analytics-ready data
- Support batch processing and, where applicable, streaming data pipelines
- Follow best practices for testing, documentation, security, and version control
Requirements
- 5+ years of experience in Data Engineering or related roles
- Strong hands-on experience with Apache Spark (PySpark or Scala)
- Proven experience working in Databricks environments
- Strong SQL skills and experience with relational and analytical databases
- Experience building and maintaining ETL/ELT pipelines at scale
- Familiarity with modern data lake architectures (Delta Lake preferred)
- Experience with Git-based version control
Benefits
- Flexible work from home options
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Data Engineer developing and maintaining efficient data pipelines for strategic client projects. Collaborating with teams to deliver valuable data insights and ensuring data quality and governance.
Data Engineer building and maintaining ETL pipelines for Northstrat's agile development team. Collaborating in a fast - paced environment with a focus on high - quality solutions.
Data Engineering Lead at BlackStone eIT managing a team and driving data solutions aligned with strategic goals. Collaborating with departments to ensure effective data management.
Data engineer designing custom data architectures at Zenika. Developing and maintaining data transformation pipelines, optimizing performance, and collaborating with cross - functional teams.
Senior Data Engineer responsible for AspenTech IP.21 implementation, leading a team for industrial data solutions.
Senior Data Engineer responsible for implementing and optimizing industrial data infrastructure at AG Solution. Leading a team and collaborating with various stakeholders to ensure data quality and reporting.
Lead Data Engineer designing scalable data architecture on Google Cloud Platform for infas 360. Collaborating with cross - functional teams to develop tailored data products in Bonn.
Data Engineer developing data platforms for Octopus Electric Vehicles. Build and optimise data solutions to transform insights for sustainable transportation.
Senior Data Engineer developing and maintaining data pipelines and solutions for EMC's data analytics products. Collaborating with cross - functional teams to ensure high - quality data management and governance practices.