Data Engineer transforming legacy on - premises systems to cloud - native architectures for advanced data analytics. Collaborating with teams to build efficient data solutions using Python and AWS.
About the role
- Senior Data Engineer at Zaizi designing and operating modern data pipelines for the UK public sector. Collaborating with agile teams to enable effective data use and analytics.
Responsibilities
- Design, build and operate modern data pipelines and analytics platforms for digital services across the UK public sector.
- Work as part of multidisciplinary, agile teams to enable organisations to collect, process and use data effectively.
- Apply sound data engineering practices rather than promoting any single technology or cloud provider.
- Work independently on well-defined problems and exercise judgement in selecting appropriate tools and approaches.
- Contribute to the continuous improvement of data platforms and ways of working in line with GDS standards, government data principles, and secure-by-design practices.
Requirements
- Design, build and maintain reliable data pipelines to ingest, transform and serve data from multiple sources.
- Develop analytics-ready data models that support reporting, operational insight and downstream analysis.
- Support the full data lifecycle, including data retention, archiving and decommissioning, in line with data policy and statutory obligations.
- Apply data quality, testing and monitoring practices to ensure data is trustworthy and fit for purpose.
- Understand user and business needs and translate them into practical, well-engineered data solutions.
- Contribute to shared data standards, documentation and data dictionaries.
- Work collaboratively with delivery teams and customers to identify opportunities where better use of data can improve outcomes.
- Strong commercial experience in building and operating data pipelines using modern data engineering patterns.
- Strong SQL skills and experience with at least one programming language commonly used in data engineering (e.g. Python).
- Experience with data integration, transformation and orchestration tools.
- Designing and working with analytical data stores.
- Applying software engineering and DevOps practices to data.
- Working with cloud platforms, while remaining technology- and vendor-agnostic.
- Using and contributing to open-source tools and frameworks.
Benefits
- 25 days paid holiday, plus bank holidays
- Vitality medical insurance
- Workplace Pension 5% employer contribution
- Group Life Assurance
- Cycle scheme
- 5 days a year for approved Training
- WFH equipment allowance
- Buy / Sell Holiday
- 2 days paid volunteering days
- Flexible working
- Work on exciting projects - make a difference
- Empowered to make decisions
- Encouraged to fail fast and learn quickly
- 1-2-1 and team coaching / training available to all our staff
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
No Education Requirement
Tech skills
Location requirements
Data Engineering Academy focused on Snowflake and Databricks for professionals interested in expanding their technical capabilities. Fully remote with future office work in Monterrey or Saltillo after completion.
Senior Data Engineer at Intent HQ designing and scaling data platforms. Building high - impact intelligence from millions of customer insights with a focus on performance and reliability.
SAP Data Engineer supporting MERKUR GROUP's evolution into a data - driven company. Responsible for data integration, modeling, and collaboration with various departments in Group Finance.
Data Engineer at Booz Allen Hamilton organizing data and developing advanced technology solutions. Leading data engineering activities for mission - driven projects and mentoring multidisciplinary teams.
Senior Data Engineer at Bristol Myers Squibb developing scalable data pipelines for foundational products. Collaborating with data scientists and IT professionals to ensure data quality and accessibility.
Sr. Data Engineer building and maintaining data infrastructure for Purpose Financial. Collaborating with teams to improve data services and analytics.
Data Engineer II role focusing on developing and maintaining data pipelines for analytics. Collaborating with Data Science and Analytics teams to ensure data quality and reliability.
Senior Data Architecture Specialist designing and maintaining data integration solutions for Morgan Stanley. Involved in building data architecture and optimizing data storage using various technologies.
Lead Data Engineer responsible for building and maintaining the central HR data lake. Collaborating with analysts and business stakeholders for data - driven decision making.