Senior AI & Data Engineer developing and implementing AI solutions in collaboration with clients and teams. Working on projects involving generative AI, predictive analytics, and data mastery.
About the role
- Senior Data Engineer designing and improving software for business capabilities at Barclays. Collaborating with teams to build a data and intelligence platform for Equity Derivatives.
Responsibilities
- design, develop and improve software for business, platform, and technology capabilities
- development and delivery of high-quality software solutions using programming languages, frameworks, and tools
- ensuring code is scalable, maintainable, and optimized for performance
- cross-functional collaboration to define software requirements and ensure seamless integration
- participate in code reviews and promote a culture of code quality and knowledge sharing
- adhere to secure coding practices and mitigate vulnerabilities
- implement effective unit testing practices
Requirements
- experience with Python for data engineering and services, including FastAPI, PySpark, Pydantic, and asyncio
- cloud platforms and data services across AWS such as EC2, ECS/Fargate, EMR, Glue, and S3
- data orchestration and workflow tools such as Airflow or Dagster
- modern data lake and storage ecosystems including Iceberg, Parquet, and data catalogs
- caching and performance optimization for production systems such as Redis
- experience with Databricks or Snowflake
- observability and monitoring platforms such as Grafana or Splunk
- streaming and messaging technologies such as Kafka
- knowledge of Java and Java Scripting
Benefits
- medical, dental and vision coverage
- 401(k)
- life insurance
- other paid leave for qualifying circumstances
Job title
Job type
Experience level
Salary
Degree requirement
Tech skills
Location requirements
Consultant driving IA business growth in Deloitte's Artificial Intelligence & Data team. Delivering innovative solutions using data analytics and automation technologies.
Data Engineer responsible for managing data architecture and pipelines at Snappi, a neobank. Collaborating with teams to enable data processing and analysis in innovative banking solutions.
Data Engineer at Destinus developing the data platform to support production and analytics needs. Involves migrating Excel sources to Lakehouse and integrating ERP systems in a hybrid role.
Senior Data Engineer developing solutions within the Global Specialty portfolio at an insurance company. Engaging with diverse business partners to ensure high quality data reporting.
Data Engineer at UBDS Group focusing on designing and optimizing modern data platforms. Collaborating in a multidisciplinary team to develop reliable data assets for analytics and operational use cases.
Data Engineer (dbt) at SDG Group involved in all phases of data projects. Collaborate on data ingestion, transformation, and visualization in a hybrid environment.
Data Consultant at SDG Group specializing in Data & Analytics projects. Collaborate on technical - functional definitions, ETL, data modeling, and visualization for cloud solutions.
Senior Data Engineer responsible for growing customer - defined targeting calculations and developing key/value databases for real - time data processing.
Data Engineer developing and maintaining the Data Lakehouse platform using Microsoft Azure technology stack at RBC. Collaborating with business and technology teams to enhance data ingestion and modeling processes.