Senior Data Engineer leading tailored data-driven solutions delivery for public sector clients. Involves data transformation projects and building AI-powered tools for decision making.
Responsibilities
Influencing major digital and data transformation projects across the UK public sector
Building and utilising smart, AI-powered tools that support real decision making
Using tech to make a genuine difference in society
Lead the delivery of tailored solutions to clients
Responsible for the design, delivery, and implementation of solutions spanning end-user interfaces and innovative user experience to data-driven solutions
Lead the end-to-end delivery of data and digital solutions of varying scale and complexity across multiple technical domains
Build, optimise, and maintain scalable data pipelines that handle high-volume, high-velocity data in complex SaaS environments
Design efficient, scalable, and flexible data models in multiple technologies to meet business requirements
Analyse and consolidate business requirements and use cases to meet technical and non-technical debt
Make key decisions on build vs buy for data and digital engineering solutions and platforms
Requirements
Data Engineering Expertise
Proficiency in one or more core data languages and technologies, such as SQL, Scala, Python, R, PySpark, and Elasticsearch
Proven experience designing, building, and maintaining robust data pipelines using AWS, Azure, and/or open-source frameworks including Spark, Beam, and Airflow
Hands-on experience with real-time data streaming technologies (e.g., Kafka, Pub/Sub)
Strong background in data quality and validation practices, including defining metrics/KPIs and implementing automated quality controls
Ability to design, build, and optimise scalable data models that support analytics and machine learning workloads
Solid working knowledge of AWS data services (e.g., S3, Kinesis, Glue, Redshift, Lambda, EMR) or Azure equivalents (e.g., ADF, Synapse, Fabric, Azure Functions)
Experience working within Data Lakehouse platforms such as Databricks, Snowflake, and/or Microsoft Fabric is an advantage
Practical understanding of at least one major cloud provider (AWS or Azure)
Strong analytical and problem-solving skills
Excellent communication skills
Demonstrated ability to collaborate effectively within distributed or remote teams
A willingness to mentor and support colleagues in their professional development.
The successful candidate must hold or be required to go through an SC security clearance.
Technical Product Manager for Data Engineering at Betclic. Owning product roadmaps, driving data infrastructure evolution, and ensuring alignment across engineering teams.
Senior Data Engineer maturing strategic data assets and delivering business analytics in a regulated financial environment. Collaborating with stakeholders to advance business data strategy on cloud platforms.
Staff Data Engineer leading scalable data solutions for analytics and reporting at Asurion. Designing data pipelines and ensuring data quality across cloud platforms.
Lead Architect at Travelers shaping enterprise database and data platform solutions. Collaborating across technology and business units to drive digital transformation and modernization efforts.
Senior Data Engineer at Porto Bank responsible for developing robust data architecture and ensuring data quality across teams. Collaborating with various data solutions for effective data management.
Data Engineer II at Dun & Bradstreet collaborating with teams to enhance data quality standards and practices. Driving best - in - class data management across diverse disciplines.
Senior Data Engineer at NVIDIA developing and optimizing database architectures while collaborating across software and hardware teams. Focus on data - driven systems in data center environments for complex networking verification.
Senior Data Engineer building reliable data infrastructure for AI - powered health experiences. Collaborating on data pipelines and ensuring data quality in a hybrid work environment.
Manager overseeing HR technology and data architecture operations enabling HR strategy effectiveness at Healthfirst. Leading a team of analysts for data integrity and operational support across systems.
Distinguished Data Engineer in data pipelines driving innovation in AWS. A hands - on technical leader delivering next - gen data solutions across Capital One's lines of business.