Data Warehouse Modelling Engineer designing and maintaining data models using Data Vault 2.0 for iGaming industry. Collaborating with stakeholders and optimizing data models in a hybrid work environment.
About the role
- Staff Data Engineer designing next-gen data platforms and pipelines at CommBank. Integrating data sources and ensuring high-quality, scalable data products while collaborating with Business Banking technology teams.
Responsibilities
- Design and build next-gen data platforms and pipelines using Python, PySpark, or Scala.
- Integrate data from diverse sources into centralised lakes and cloud platforms.
- Create technology blueprints and engineering roadmaps for long-term transformation.
- Ensure data security, governance, and compliance.
- Deliver end-to-end solutions that meet business needs and minimise risk.
- Build high-quality, scalable data products from scratch.
- Communicate effectively with stakeholders and contribute to team-wide engineering practices.
- Define and evolve shared semantic models and metric definitions to ensure consistent meaning and reusable data across products and domains.
- Drive adoption of catalogues, glossaries, and stewardship practices that promote discoverability, accountability, and self-service.
- Embed policy-as-code for data access, classification, and retention ensuring compliance with internal and regulatory standards.
- Implement automated testing, observability, and end-to-end lineage to improve data trust, traceability, and incident resolution speed.
Requirements
- AWS Certified Data Engineer Associate with demonstrable experience in Data Engineering.
- Strong expertise in Python, PySpark, SQL, Spark, Scala, and distributed data processing.
- Experience in AWS data platforms (Glue, Lambda, Redshift, Athena, Kinesis, EMR).
- Experience with AWS DataZone, Lake Formation, IAM, encryption.
- Experience in using AI Powered coding Assistants like Cline, Roo and Aider.
- Exposure to AWS Marketplace, API Gateway, and data monetization strategies.
- Experience with Terraform, CloudFormation, GitOps, and serverless frameworks.
- Ability to fine-tune ETL jobs, query performance, and cost efficiencies.
- Knowledge of data product thinking and data mesh principles.
Benefits
- Flexible working arrangements
- Opportunities for professional development
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Senior Data Engineer driving impactful data solutions for the climate logistics startup HIVED's core data platform. Collaborating with cross - functional squads to enhance analytics and delivery.
Data Engineer developing and maintaining CRE forecasting infrastructure for Cushman & Wakefield. Collaborates with senior economists and technical teams to ensure high - quality data solutions.
Data Engineer at PwC, engaging with Azure cloud services to enhance data handling and integrity. Responsibilities include pipeline optimizations, documentation, and collaboration with stakeholders.
Data Engineer Manager at PwC focusing on building data infrastructure and solutions. Leading data engineering projects to transform raw data into actionable insights and drive business growth.
Junior Data Engineer at OneMarketData focusing on data quality and integrity in financial datasets. Collaborating with senior analysts and assisting in data management and analysis tasks.
Data Engineer Manager leading robust data solutions for PwC's clients. Transforming raw data into actionable insights and coaching team members.
Senior Data Engineering Analyst developing and implementing data solutions. Collaborating in a diverse environment focused on data processing and analysis for clients' digital transformation.
Principal Software Engineer in Threat Data Platform developing AI - driven tools for threat intelligence automation. Collaborating on robust data pipelines for PANW’s product ecosystem.
Senior Azure Data Engineer maintaining business intelligence solutions for Grupo Gloria, implementing and stabilizing projects in Azure and Databricks with Power BI reporting.