Data Engineer designing and maintaining resilient data pipelines for Affinity Water. Collaborating with teams to optimize data workflows using AWS services and Talend integration.
Responsibilities
Build and support efficient ETL processes, primarily using Talend.
Design scalable data pipelines that deliver structured, high-quality data.
Monitor pipeline performance and ensure data integrity, security, and availability.
Collaborate with internal teams and third-party partners to resolve issues quickly.
Engage with business stakeholders from concept to delivery to meet their data needs.
Contribute to data policies, standards, and continuous process improvements.
Work within an Agile (Scrum) delivery environment, applying best practices in continuous integration and delivery.
Requirements
Proven experience in Data Engineering, specifically with Talend Data Integration.
Strong knowledge of AWS cloud services (S3, Glue, Redshift, Spectrum) and SQL.
Expertise in ETL design, data warehousing, and data governance principles.
Experience with REST and SOAP APIs for data extraction and integration.
Familiarity with ITIL or similar IT service management frameworks.
Proficiency in scripting languages (Shell, Python, PowerShell) is a plus.
Excellent problem-solving, analytical, and communication skills.
Ability to work effectively in a dynamic, fast-paced environment.
Experience working in Agile teams and delivering data-driven projects.
Bonus: Knowledge of Master Data Management, predictive analytics, or water industry regulatory reporting.
Benefits
Hybrid role, with the expectations of a minimum two days a week in the office in Hatfield
Annual leave from 26 days rising with length of service, and the option to purchase up to 5 extra days.
A ‘Celebration Day’ in addition to public holidays that people can use to celebrate a religious festival or other occasion that is important to them.
A generous 'double match pension scheme' that doubles the contributions you make (company contribution capped at 12%)
We offer a range of family benefits including enhanced Maternity, Adoption, Paternity, Shared Parental Leave, Fertility Support Leave and up to 5 full or 10 half days of paid Carers Leave.
Menopause policy and Reasonable Adjustment policy to help everyone perform at their best.
Access to our Wellbeing Centre with support for looking after your physical and mental health.
Discounts at a Range of Retail Outlets and on Dental and Medical Insurance through our Tap4Perks scheme.
Up to 4 Affinity days a year to volunteer in the community.
Data Warehouse Modelling Engineer designing and maintaining data models using Data Vault 2.0 for iGaming industry. Collaborating with stakeholders and optimizing data models in a hybrid work environment.
Senior Data Engineer driving impactful data solutions for the climate logistics startup HIVED's core data platform. Collaborating with cross - functional squads to enhance analytics and delivery.
Data Engineer developing and maintaining CRE forecasting infrastructure for Cushman & Wakefield. Collaborates with senior economists and technical teams to ensure high - quality data solutions.
Data Engineer at PwC, engaging with Azure cloud services to enhance data handling and integrity. Responsibilities include pipeline optimizations, documentation, and collaboration with stakeholders.
Data Engineer Manager at PwC focusing on building data infrastructure and solutions. Leading data engineering projects to transform raw data into actionable insights and drive business growth.
Junior Data Engineer at OneMarketData focusing on data quality and integrity in financial datasets. Collaborating with senior analysts and assisting in data management and analysis tasks.
Senior Data Engineering Analyst developing and implementing data solutions. Collaborating in a diverse environment focused on data processing and analysis for clients' digital transformation.
Principal Software Engineer in Threat Data Platform developing AI - driven tools for threat intelligence automation. Collaborating on robust data pipelines for PANW’s product ecosystem.