Senior Data Engineer responsible for designing and implementing data solutions at Harambee. Collaborating with various stakeholders to enhance technology supporting work - seekers' journeys.
About the role
- Data Engineer at Mobileye building robust data pipelines for data infrastructure. Collaborating with teams to deliver high-quality data solutions for dynamic environments.
Responsibilities
- Design, build, and maintain robust and scalable data pipelines (batch and real-time) end-to-end.
- Design and implement scalable, flexible data architectures to support evolving business needs.
- Build and manage data platforms, including data lakes and data warehouses.
- Integrate multiple data sources (structured and unstructured) into a unified data platform using batch (ETL) and real-time streaming solutions.
- Design and implement efficient data models, schemas, and database structures (SQL / NoSQL).
- Develop and implement data quality processes to ensure accuracy, consistency, and reliability.
- Monitor, optimize, and troubleshoot data infrastructure to meet performance and SLA requirements.
Requirements
- 5+ years of hands-on experience as a Data Engineer, building data systems from scratch in dynamic environments.
- Bachelor’s degree in Computer Science, Engineering, or a related field (or equivalent practical experience).
- Strong proficiency in Python and advanced SQL, with solid experience in data modeling.
- Proven experience designing and building scalable data pipelines (batch and real-time), including streaming technologies such as Kafka.
- Strong experience working with AWS, including services such as S3, Athena and DynamoDB.
- Experience working with big data processing frameworks such as Spark, and columnar data formats (e.g., Parquet).
- Hands-on experience with workflow orchestration tools such as Airflow.
- Strong ownership and execution mindset, with excellent problem-solving skills and high attention to detail, and the ability to collaborate effectively and deliver in ambiguous, fast-paced environments.
- Experience with data platform technologies such as Databricks, Snowflake – Advantage.
- Experience building data platforms using modern lakehouse technologies (e.g., Iceberg) – Advantage.
- Fluent in English.
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Senior Manager Data Engineer at Squarcle delivering technical leadership in data engineering and compliance with business objectives. Leading teams to optimize and develop data platforms for clients.
Senior Consultant Data Engineer in a consultancy firm focusing on data engineering and platform development. Collaborating with diverse teams to deliver high - quality data solutions.
Cloud Data Engineer at Shift, focusing on building and operating data pipelines on Azure for Australian SMEs. Collaborating across teams to enhance data integration and quality.
AI Systems & Data Engineer at HyperFi designing Databricks pipelines and managing AI systems. Collaborating on data engineering tasks and optimizing workflows in a flexible tech environment.
Engenheiro de Dados especializado em PowerBI e Lakehouse no Campos Thomaz Advogados. Foco em preparar dados para dashboards e estruturação de ambientes com Microsoft.
Data Platform Expert developing and maintaining data solutions for analysis and reporting at Magna Electronics. Collaborating with various teams to enhance data - driven decision making and insights.
Data Engineer at Mobiz designing, building, and maintaining scalable data solutions for analytics. Collaborating with teams to leverage modern cloud technologies and improve data - driven decision - making.
Head of Data Engineering at Envitia overseeing data architecture services for public sector programs. Leading service mobilization with client stakeholders in a hybrid work environment.
Applied AI Health Data Architect - Senior Manager at PwC designing data architecture for healthcare operations. Contributing to innovative data solutions and mentoring teams for operational excellence.