Data Engineer creating and implementing Big Data applications at Absa with business stakeholders and technology leaders. Involves ETL/ELT pipeline design, data automation, and team mentorship.
About the role
- Data Engineer joining a global FinTech business to support next-generation data engineering capabilities. Focused on designing and delivering robust, scalable data solutions in a hybrid team.
Responsibilities
- Design, develop and maintain scalable data pipelines for ingestion, transformation and storage
- Write efficient SQL queries to support data extraction, manipulation and analysis
- Use Apache Spark and Python to process large datasets and automate workflows
- Partner with data scientists, engineers and business stakeholders to translate requirements into data solutions
- Implement data quality checks and validation to ensure accuracy and reliability
- Analyse complex datasets to identify trends, patterns and anomalies
- Produce and maintain clear documentation covering data processes and architecture
- Support stakeholders with data visualisation and interpretation of outputs
Requirements
- Strong experience in SQL for data manipulation and analysis
- Hands-on experience with Apache Spark (Java, SQL or PySpark) and Python
- Experience working with large, complex datasets in enterprise environments
- Exposure to cloud data platforms (AWS, Azure or GCP) and big data technologies
- Confident communicator, comfortable working across technical and non-technical teams
- Background or exposure to financial services or capital markets
- **Nice to have**
- Experience using Java in data processing or integration contexts
- Knowledge of ETL processes and data warehousing concepts
- Experience with data visualisation tools (Power BI, Tableau, Qlik)
- Familiarity with data science notebooks (e.g. Jupyter, Zeppelin)
- Version control experience (Git, GitHub, Bitbucket, Azure DevOps)
Benefits
- Initial 6-month contract, with strong possibility of extension and/or permanency.
- Salary to be discussed.
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Senior Data Architect delivering, enhancing, and adopting enterprise data and analytics products for DoD organizations. Collaborating with teams to translate requirements into scalable solutions for national security outcomes.
Senior Data Engineer supporting the delivery and enhancement of enterprise data and analytics for DoD organizations. Collaborating with engineers and government partners on scalable, production - ready solutions.
Senior Data Engineer at Skillfield designing distributed data processing solutions using Apache Spark. Collaborates on cloud and on - prem solutions across enterprise levels in a hybrid work environment.
Senior Data Engineer optimizing ETL/ELT pipelines at Asahi Kasei. Evaluate programming concepts and support data science projects while ensuring solution stability in a hybrid work setup.
Data Engineer responsible for building data intelligence system for the public sector. Ensuring data ingestion, quality, correlation, and helping with analytics for decision making.
Big Data Engineer focused on architecting and deploying scalable Apache Spark environments. Working on Nebul’s sovereign AI cloud to enhance data performance and security.
BI Specialist focusing on data architecture and insights for RPE. Collaborating with business and technology teams to enhance data governance and analytics.
Technical Lead responsible for delivering innovative software solutions for the healthcare sector. Leading technical teams and ensuring compliance with governance standards across Australia and New Zealand.
Senior Data Engineer dedicated to designing and optimizing cloud data solutions at Leega, a consulting firm focused on innovative client service.