Data Engineer creating and implementing Big Data applications at Absa with business stakeholders and technology leaders. Involves ETL/ELT pipeline design, data automation, and team mentorship.
About the role
- Senior Data Engineer responsible for data pipeline projects at Suprema Gaming. Focus on batch and streaming data solutions while collaborating with business teams.
Responsibilities
- Design and implement batch and streaming data pipelines, ensuring reliability and performance;
- Architect and evolve multi-cloud data lakes, ensuring governance, security and scalability;
- Develop solutions in Databricks for distributed processing, machine learning and integration with multiple data sources;
- Work end-to-end: ingestion, cleansing, storage, modeling and provisioning for visualization (BI/Analytics);
- Follow architectural standards and best practices for data engineering in hybrid and distributed environments;
- Collaborate with business, data science and product teams to turn data into strategic insights;
- Implement automations using tools such as n8n and explore integrations with AI solutions to optimize processes;
- Ensure data quality, observability and reliability through monitoring, testing and pipeline versioning;
- Respond to critical data incidents, leading root cause analyses and proposing sustainable solutions.
Requirements
- Bachelor's degree in Computer Engineering, Computer Science, Information Systems or related fields;
- Minimum of 10 years of experience in data engineering, with proven experience in complex projects;
- Strong experience in batch and streaming pipelines (Spark, Kafka, Flink, etc.);
- Experience with multi-cloud data lakes (AWS, GCP and/or Azure);
- Experience with Databricks (PySpark, Delta Lake, MLlib, etc.) and Snowflake;
- Hands-on experience from ingestion to visualization (integration with BI tools such as Power BI, Tableau, Looker, Data Studio, Qlik, Einstein Insights);
- Advanced knowledge of SQL and Python;
- Experience with process automation (n8n, Airflow, Dagster or similar);
- Familiarity with data security and governance practices (LGPD/GDPR, access control, auditing);
- Advanced English for reading, writing and technical interaction.
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Senior Data Architect delivering, enhancing, and adopting enterprise data and analytics products for DoD organizations. Collaborating with teams to translate requirements into scalable solutions for national security outcomes.
Senior Data Engineer supporting the delivery and enhancement of enterprise data and analytics for DoD organizations. Collaborating with engineers and government partners on scalable, production - ready solutions.
Senior Data Engineer at Skillfield designing distributed data processing solutions using Apache Spark. Collaborates on cloud and on - prem solutions across enterprise levels in a hybrid work environment.
Senior Data Engineer optimizing ETL/ELT pipelines at Asahi Kasei. Evaluate programming concepts and support data science projects while ensuring solution stability in a hybrid work setup.
Data Engineer responsible for building data intelligence system for the public sector. Ensuring data ingestion, quality, correlation, and helping with analytics for decision making.
Big Data Engineer focused on architecting and deploying scalable Apache Spark environments. Working on Nebul’s sovereign AI cloud to enhance data performance and security.
BI Specialist focusing on data architecture and insights for RPE. Collaborating with business and technology teams to enhance data governance and analytics.
Technical Lead responsible for delivering innovative software solutions for the healthcare sector. Leading technical teams and ensuring compliance with governance standards across Australia and New Zealand.
Senior Data Engineer dedicated to designing and optimizing cloud data solutions at Leega, a consulting firm focused on innovative client service.