About the role

Data Engineer at Barnet Council developing Microsoft Azure data platforms and robust data pipelines for analytics. Collaborating on data solutions and improving data quality across organization.

Responsibilities

Develop and maintain the council’s Microsoft Azure Data Platform, supporting cloudready, scalable analytics.
Build and optimise data pipelines, APIs and integrations across onpremise, cloud and supplierhosted systems.
Extract, clean, transform and combine data from a wide range of operational systems to create highquality datasets for insight and machine learning.
Work with data scientists to design and maintain pipelines for AI/ML models, including supporting feature engineering, labelling and largescale data flows.
Automate manual data processes to improve speed, reliability and accessibility of insight.
Lead data engineering projects, including working with external suppliers and supporting more junior colleagues.
Implement and maintain data lakehouse architectures, master data management and metadata repositories.
Ensure that data workflows comply with security, privacy and governance standards, including anonymisation where required.
Optimise the performance of code, pipelines and data systems, resolving issues, bugs and outages.
Contribute to the development of data strategy, standards and reusable engineering frameworks across the Hub.
Work with colleagues across ICT, Connected Places and service teams to join up data and support emerging technologies (e.g., IoT, geospatial, AI).
Support the creation of visualisations and reusable analytical products that enhance decisionmaking.

Strong handson experience with modern data engineering tools and practices, including ETL/ELT, data warehousing and data modelling.
Expertise in cloud data platforms, ideally Azure services such as Data Factory, Synapse, Databricks, Spark or Snowflake.
Proficiency in Python, SQL and other relevant languages for building pipelines and enabling automation.
Experience building and managing production data services, integrating data from multiple systems, and improving data quality.
Understanding of data governance, security, information management and UK GDPR.
The ability to communicate complex technical concepts clearly for nonspecialist audiences.
A collaborative and proactive approach, with confidence leading projects, supporting partners and driving continuous improvement.

31 days annual leave, plus public and bank holidays
Access to the Local Government Pension Scheme, which provides a valuable guaranteed income in your retirement together with security for your dependents
Work-life balance options may include hybrid working, flexitime, job share, home working, part-time
A vast range of lifestyle discounts from major retailers, supermarkets, energy suppliers and more
Broad range of payroll benefits including cycle to work, eye care vouchers, travel and gym membership
Excellent training and development opportunities
Employee well-being training programs including confidential employee assistance