Associate Data Engineer at Boeing India supporting API Development and Data migration with a focus on engineering and technology solutions. Involves working independently to gather requirements and supporting architecture for API services and data analytics.
About the role
- Principal Data Engineer leading the design and development at Moneyhub. Overseeing large-scale data systems and problems for financial services with a hands-on approach.
Responsibilities
- Evolve a Mission-Critical System: Take technical ownership of our Kafka-based Data Enrichment Engine, a platform that runs multiple analytical models at 20,000+ transactions per second.
- Architect for Scale: Design and implement architectural improvements to enhance the platform's performance, reliability, and scalability across both our SaaS and client-deployed environments.
- Solve Complex Engineering Challenges: Tackle deep technical problems related to high-throughput data ingestion, distributed systems, data consistency, and operational efficiency in a live production environment.
- Act as the Subject Matter Expert (SME): As the go-to expert for the toughest data infrastructure challenges, you'll partner closely with our DevSecOps team to ensure production excellence. You will guide and mentor other engineers, establishing best practices for building and operating large-scale data systems.
Requirements
- Leader of the design and development of large-scale data systems from scratch, making key design decisions and providing technical oversight of projects.
- Expert-level, hands-on experience with Apache Kafka, including designing, deploying, and operating it in a high-throughput production environment.
- Experience designing, managing, and running relational databases at a terabyte scale.
- Deep knowledge of how technologies such as Apache Spark, BigQuery or AWS Athena work including principles such as map/reduce and schema-on-read.
- Strong software engineering fundamentals with proficiency in a backend language, preferably JavaScript/Node.js.
- Demonstrable experience building solutions on a major public cloud platform (GCP, AWS, or Azure) with an ability to price expected running costs of solutions
- A pragmatic and autonomous problem-solver who takes end-to-end ownership, can unblock themselves by digging into documentation, and knows when to create a simple solution vs. an architecturally complex one.
Benefits
- 5% company contribution towards your Pension from your very first day with us. 3% contribution from yourself.
- 25 days of holiday (plus bank hols), rising to 30 days after two years;
- Choose to take your entitlement to UK bank holidays at other times based on your own days of significance;
- Private medical insurance, including cover for pre-existing conditions, plus dental and optical benefit;
- 3 Months Moneyhubber Family Pay when you become a new parent;
- Permanent health insurance and life cover - much greater than the industry standard (death in service);
- Employee assistance programme;
- Professional development support, with dedicated allowance of time and money; Life event leave;
- Cycle to work scheme;
- EV Car Scheme
- £750 towards professional memberships
- Remote working benefits, including work from almost anywhere, access to co-working spaces and support for your home office set-up
- High spec laptop
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
No Education Requirement
Tech skills
Location requirements
Senior Data Engineer building and maintaining robust data pipelines for various data products at Beep Saúde. Collaborating within the team and leading data governance practices.
Software Developer in Test working on cloud - based data platform at Tecsys. Ensuring quality and reliability of data pipelines and transformations using automation frameworks.
Data Engineer responsible for designing, building, and optimizing data pipelines and architectures in a tech environment. Requires extensive experience with modern data warehousing and cloud platforms.
Lead Data Engineer role at Brillio focusing on AI & Data Engineering with expertise in Azure and MS Fabric. Collaborate within the Data Engineering team in Pune, Maharashtra, India.
Data Architect at Whiteshield designing scalable, secure data architectures for national and enterprise transformation programs. Architecting modern data platforms to support analytics, AI and operational use cases.
Data Engineer managing scalable data ecosystems for actionable business intelligence and cross - functional stakeholder collaboration. Optimizing ETL/ELT pipelines and ensuring data integrity and security.
Data Engineer specializing in data architecture and solutions for a banking environment, driving value for customers through innovative engineering practices and technologies in data management.
Technical Lead for data engineering and reporting in healthcare technology at Dedalus. Shaping innovative software solutions and leading cross - functional technical teams in Australia.
Senior ML Data Engineer working on data pipeline curation for Mobileye's autonomous vehicle dataset. Collaborating across teams to enhance ML engineering and vision model applications.