Senior Data Engineer building reliable data infrastructure for AI - powered health experiences. Collaborating on data pipelines and ensuring data quality in a hybrid work environment.
About the role
- Data Engineer developing core algorithms and back-end pipelines for cargo tracking at Kpler. Collaborating with data engineers and scientists to optimize system performance and data quality.
Responsibilities
- Working alongside data engineers, data scientists and product managers, take responsibility for the development and implementation of our core algorithms and back-end data pipelines, based on project requirements and design specifications.
- Help clients and internal users benefit from the highest cargo tracking data quality by adding new features and reviewing pipelines and integrations with our datastores.
- Help to optimise system performance, maintain features, troubleshoot issues, and ensure high availability.
- Demonstrate strong analytical and debugging skills with a proactive approach to learning.
Requirements
- Have hands-on experience with **Python**. Experience with **Flask** or **SQLALchemy** is a plus.
- Solid **SQL** skills for querying and managing relational databases.
- Knowledge of streaming and big data technologies (such as** Kafka or Spark**).
- Comfortable working with **Git**, code reviews, and **Agile methodologies**.
- Have an understanding of containerisation and orchestration tools (e.g., **Docker, Kubernetes**).
- Are eager to learn new languages and technologies.
- Have worked with **AWS **(or another cloud provider), using **Terraform**.
- Have experience with Scala or other **JVM Languages**.
- Exposure to **Elasticsearch.**
Benefits
- Health insurance
- Professional development opportunities
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
No Education Requirement
Tech skills
Location requirements
Manager overseeing HR technology and data architecture operations enabling HR strategy effectiveness at Healthfirst. Leading a team of analysts for data integrity and operational support across systems.
Distinguished Data Engineer in data pipelines driving innovation in AWS. A hands - on technical leader delivering next - gen data solutions across Capital One's lines of business.
Product Manager for Capital One enhancing financial experiences and optimizing product development with technology. Collaborating with cross - functional teams and leading initiatives for the Core Data Platform Services.
Sr. Lead Data Engineer at Capital One responsible for delivering data solutions and mentoring teams. Engage in collaborative Agile practices and drive powerful experiences for financial empowerment.
Senior Data Engineer at EDO building data pipelines for advertising effectiveness measurement. Collaborating with Data Scientists using AWS, Airflow, DBT, and Snowflake on large data sets.
Data Engineer transforming data into actionable insights at InnoWave. Designing data pipelines and collaborating between technical teams and business stakeholders in Lisbon.
Data Engineer developing and maintaining infrastructure for analytics at Waitwhile. Responsible for data lifecycle management, API availability, and AI operationalization.
Data Engineer supporting, developing, and maintaining a data analytics platform with agile delivery. Working with business and IT teams to leverage data technologies effectively.
Data Engineer at Domes Resorts responsible for designing data pipelines and supporting analytics. Join E - Commerce, Intelligence & Innovation team to drive business growth through data solutions.