Data Engineer creating and implementing Big Data applications at Absa with business stakeholders and technology leaders. Involves ETL/ELT pipeline design, data automation, and team mentorship.
About the role
- Data Engineer with a focus on design and optimization of enterprise data products at METRO. Collaborating with analysts and contributing to machine learning projects within the DWH team.
Responsibilities
- Design and develop robust, automated data pipelines (ETL/ELT) to ingest data from multiple sources into the Data Warehouse or Data Lake
- Perform data wrangling tasks, including data cleaning and transformation, to convert raw data into usable formats for analysis, visualization or machine learning
- Validate data quality and monitor pipeline performance to ensure data integrity and reliability.
- Implement data access controls in compliance with company regulations and policies.
- Contribute to machine learning and AI projects by preparing, validating, and serving high-quality datasets for model training and evaluation
- Collaborate closely with Data and BI Analysts, providing technical support where needed.
Requirements
- Bachelor’s degree in Data Science, Information Technology, or a related scientific field, preferably combined with a postgraduate degree in Data Science
- Knowledge and experience in SQL, PL/SQL
- Solid understanding of Data Engineering methodologies and principles.
- Hands-on experience with ETL/ELT tools.
- Experience in data modeling and data structures.
- Familiarity with technologies such as Oracle Data Integrator, Azure Data Lake, Azure Data Factory, Databricks will be considered a plus.
- Experience with programming languages commonly used in data engineering and data science (e.g. Python) will be considered a plus.
Benefits
- The opportunity to work and grow in a collaborative and friendly environment, tackling challenging business problems that deliver real value to our customers.
- A competitive compensation and benefits package.
- A private health and insurance plan.
- Access to learning platforms (such as Udemy for Business) to support your professional development and help sharpen your technical skills.
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Senior Data Architect delivering, enhancing, and adopting enterprise data and analytics products for DoD organizations. Collaborating with teams to translate requirements into scalable solutions for national security outcomes.
Senior Data Engineer supporting the delivery and enhancement of enterprise data and analytics for DoD organizations. Collaborating with engineers and government partners on scalable, production - ready solutions.
Senior Data Engineer at Skillfield designing distributed data processing solutions using Apache Spark. Collaborates on cloud and on - prem solutions across enterprise levels in a hybrid work environment.
Senior Data Engineer optimizing ETL/ELT pipelines at Asahi Kasei. Evaluate programming concepts and support data science projects while ensuring solution stability in a hybrid work setup.
Data Engineer responsible for building data intelligence system for the public sector. Ensuring data ingestion, quality, correlation, and helping with analytics for decision making.
Big Data Engineer focused on architecting and deploying scalable Apache Spark environments. Working on Nebul’s sovereign AI cloud to enhance data performance and security.
BI Specialist focusing on data architecture and insights for RPE. Collaborating with business and technology teams to enhance data governance and analytics.
Technical Lead responsible for delivering innovative software solutions for the healthcare sector. Leading technical teams and ensuring compliance with governance standards across Australia and New Zealand.
Senior Data Engineer dedicated to designing and optimizing cloud data solutions at Leega, a consulting firm focused on innovative client service.