Data Engineer designing data pipelines in Python for a major railway industry client. Collaborate with Data Scientists and ensure code quality with agile methodologies.
About the role
- Data Engineer designing, building, and optimizing enterprise-scale data solutions for DyFlex Solutions. Blending technical delivery with client-facing consulting in a hybrid role.
Responsibilities
- Design, build, and optimise enterprise-scale data solutions
- Help clients unlock the value of their data and accelerate performance
- Blend hands-on technical delivery with client-facing consulting
- Shape scalable solutions using Databricks, cloud platforms, and modern data engineering practices
- Build and maintain scalable data pipelines for ingesting, transforming, and delivering data
- Manage and optimise databases, warehouses, and cloud storage solutions
- Implement data quality frameworks and testing processes to ensure reliable systems
- Design and deliver cloud-based solutions (AWS, Azure, or GCP)
- Take technical ownership of project components and lead small development teams
- Engage directly with clients, translating business requirements into technical solutions
- Champion best practices including version control, CI/CD, and infrastructure as code
Requirements
- Hands-on data engineering experience in production environments
- Strong proficiency in Python and SQL; experience with at least one additional language (e.g. Java, Typescript/Javascript)
- Experience with modern frameworks such as Apache Spark, Airflow, dbt, Kafka, or Flink
- Background in building ML pipelines, MLOps practices, or feature stores is highly valued
- Proven expertise in relational databases, data modelling, and query optimisation
- Demonstrated ability to solve complex technical problems independently
- Excellent communication skills with ability to engage clients and stakeholders
- Degree in Computer Science, Engineering, Data Science, Mathematics, or a related field
Benefits
- Work with SAP’s latest technologies on cloud as S/4HANA, BTP and Joule, plus Databricks, ML/AI tools and cloud platforms
- A flexible and supportive work environment including work from home
- Competitive remuneration and benefits including novated lease, birthday leave, remote working, additional purchased leave, and company-provided laptop
- Competitive remuneration and benefits including novated lease, birthday leave, salary packaging, wellbeing programme, additional purchased leave, and company-provided laptop
- Comprehensive training budget and paid certifications (Databricks, SAP, cloud platforms)
- Structured career advancement pathways with mentoring from senior engineers
- Exposure to diverse industries and client environments
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Senior Data Engineer responsible for building and optimizing data pipelines for banking analytics initiatives. Collaborating with data teams to ensure data quality and readiness for enterprise use.
Senior Data Engineer developing scalable data solutions on Databricks for analytics and operational workloads. Collaborating with cross - functional teams to modernize the data ecosystem.
Data Engineer focused on analytics and data pipeline development for network optimisation. Collaborating with teams to deliver high - quality data solutions with Python and SQL.
Senior Product Manager defining platform capabilities for Data Cloud in Salesforce. Collaborating with R&D teams while shaping product strategy for Data 360 integration.
Senior Data Engineer at Goodwin enhancing data platforms and fostering data - driven culture across teams. Collaborating with IT and Finance on technology solutions and data governance practices.
Director, Data Platform Design and Strategy at MedImpact leading data platform and AI innovations to enhance healthcare services. Overseeing enterprise projects and managing teams to meet strategic goals.
Data Engineer delivering AI - and data - driven solutions for Honeywell’s industrial customers. Architecting and implementing scalable data pipelines and platforms focused on IoT and real - time data processing.
Data Engineering Associate focusing on data quality control and management for distribution platform. Collaborates on large scale data projects to ensure data accuracy and availability for users.
Data Architect managing enterprise data platform built on Microsoft Fabric at Johnstone Supply. Leading architectural standards and collaborating with business and IT leaders for strategic data - driven insights.