About the role

Senior Data Engineer developing and maintaining data solutions while ensuring data governance for the organization. Collaborating with teams using Microsoft Azure technologies in a hybrid work environment.

Responsibilities

Own, design, develop and maintain LCCCs data platform ensuring reliable data across the organisation
Extensive hands‑on experience designing and delivering scalable, resilient cloud‑based data lake platforms using modern lakehouse architectures
Drive better data governance through the creation and embedding of principles and processes
Build and maintain key data governance and management artefacts e.g., Flow Diagram, Data Dictionary, KPI Catalogue
Define overall approach and data flow for Extract, Transform and Load; and application of this for a given deployment/project
Identify patterns, anomalies, and structure of data in preparation for Extract Transformation and Load
Design and implement data pipelines and processes based on business requirements
Write ETL data validation and data reconciliation queries
Define high level and low-level design of a data platform to ensure robustness e.g., restorability, traceability, ease to support, etc.
Define, embed, and drive data management and governance approaches, principles, and processes
Identify data quality issues through data profiling, analysis, and stakeholder engagement
Design and maintain the Microsoft Azure modern Datawarehouse architecture, implementation, administration, and support
Translate complex business requirements into clear, scalable technical designs and delivery plans, ensuring alignment between stakeholder outcomes and engineering execution

Extensive experience in Cloud (preferably Microsoft Azure) Datawarehouse architecture as well as cloud data lakehouse platforms
Experience of ETL and ELT processes, working with database architecture
Able to develop and optimise coding in SQL and python
Experience in creating data pipelines using Cloud (preferably Azure Data Factory)
Experience with Cloud: ADLS, Databricks, SQL DW, Serverless Architecture
Experience in CI/CD pipelines and monitoring
Able to work with large datasets and extrapolate conclusions
Strong analytical and critical thinking abilities
Highly desirable: Experience in building and maintaining reliable and scalable ETL on big data platforms as well as experience working with varied forms of data infrastructure
Data Engineering experience in Microsoft stack

Annual performance based bonus, up to 10%
25 days annual leave, plus eight bank holidays
Up to 8% pension contribution
Financial support and time off for study relevant to your role, plus a professional membership subscription
Employee referral scheme (up to £1500), and colleague recognition scheme
Family friendly policies, including enhanced maternity leave and shared parental leave
Free, confidential employee assistance, including financial management, family care, mental health, and on-call GP service
Three paid volunteering days a year
Season ticket loan and cycle to work schemes
Family savings on days out and English Heritage, gym discounts, cash back and discounts at selected retailers
Employee resource groups