AWS Data Engineer designing and maintaining scalable cloud-based data platforms within Banking and Financial Services at EXL. Collaborating across teams to enable data-driven decision-making through cloud technologies.
Responsibilities
Design, build and maintain scalable data pipelines and ETL/ELT processes using modern cloud data engineering practices
Develop and optimise data lake and data warehouse architectures on AWS
Ensure high standards of data quality, governance, security and accessibility across data platforms
Develop scalable data transformation logic using Python, SQL and Spark-based frameworks
Monitor pipeline performance and troubleshoot data workflows to ensure reliability and efficiency
Work closely with data scientists, analysts and engineering teams to support advanced analytics and reporting initiatives
Implement best practices for data modelling, metadata management and data lineage
Produce technical documentation including data architecture, pipeline design and data flow diagrams
Support continuous improvement of data platforms through optimisation, automation and performance tuning
Requirements
8+ years of experience in data engineering or data platform development within enterprise environments
Strong expertise in AWS data services (such as S3, Glue, Redshift, EMR, Athena, Lambda or similar)
Strong programming experience with Python and SQL
Hands-on experience with Spark or distributed data processing frameworks
Proven experience building and maintaining data pipelines, data lakes and data warehouses
Strong understanding of data modelling, metadata management and data governance principles
Experience working with large-scale distributed data systems and high-volume datasets
Familiarity with CI/CD, version control (Git) and modern development practices
Experience working in Agile delivery environments
Experience within the Banking or Financial Services domain
Knowledge of Enterprise Data Management (EDM) frameworks
Experience with data governance, lineage and metadata management tools
Exposure to multi-cloud environments (Azure or GCP)
Experience supporting advanced analytics, machine learning or AI data platforms
Benefits
A competitive salary with a generous bonus
Private healthcare
Critical illness life assurance at 4 x your annual salary
Income protection insurance
A rewarding pension
Cash back cards for discounts and promotions
Cycle Scheme for savings on bikes and cycling accessories
Professional and personal development opportunities
Learning initiatives including online courses and workshops
Data Engineer role specializing in Azure & Snowflake at InfoCentric. Leading design and delivery of enterprise - scale data platforms for large organizations.
Principal Data Architect at PointClickCare ensuring coherent and scalable data architecture. Driving unified data direction while collaborating with Engineering Architecture team for AI enablement.
Data Engineer Tech Lead developing data solutions at Carelon. Leading a cross - functional team to optimize data workflows and maintain data integrity.
Lead Data Engineer responsible for evolving Manna’s data infrastructure for drone delivery. Overseeing data architecture and analytics while building scalable data pipelines.
Data Engineer designing, implementing, and optimizing data pipelines for DeepLight AI. Collaborating closely with a multidisciplinary team to analyze large - scale data.
Data Engineer designing and maintaining scalable ETL pipelines at Satori Analytics. Collaborating with teams to deliver high - quality analytics solutions across various industries.
Data Architect responsible for defining enterprise data architecture on AWS and Databricks Lakehouse platforms. Enabling scalable data lakes and enterprise analytics for financial services organizations.
Data Platform Operations Support leading data engineering strategy across projects for EXL. Driving innovation and optimization while collaborating with various teams in the organization.
Manager II leading data engineering projects at Navy Federal Credit Union. Overseeing data governance and quality initiatives while managing engineering teams in a hybrid work environment.
Principal Data Engineer responsible for architecting scalable data pipelines and building high - quality data foundations. Collaborating closely with experts to ensure data readiness for advanced analytics.