Data Engineer focused on analytics and data pipeline development for network optimisation. Collaborating with teams to deliver high - quality data solutions with Python and SQL.
About the role
- Staff Data Engineer specializing in AWS Cloud, Data Mesh, and AI technologies at CommBank. Responsible for designing and building data platforms that empower business banking.
Responsibilities
- Design and build next-gen data platforms and pipelines using Python, PySpark, or Scala
- Integrate data from diverse sources into centralised lakes and cloud platforms
- Create technology blueprints and engineering roadmaps for long-term transformation
- Ensure data security, governance, and compliance
- Deliver end-to-end solutions that meet business needs and minimise risk
- Build high-quality, scalable data products from scratch
- Communicate effectively with stakeholders and contribute to team-wide engineering practices
Requirements
- 5+ years of experience in Data Engineering
- AWS Certified Data Engineer Associate
- Strong expertise in Python, PySpark, SQL, Spark, Scala
- Experience in AWS data platforms (Glue, Lambda, Redshift, Athena, Kinesis, EMR)
- Data Governance & Security experience with AWS DataZone, Lake Formation, IAM
- Experience in using AI Powered coding Assistants
- Exposure to AWS Marketplace, API Gateway, and data monetization strategies
- Experience with Terraform, CloudFormation, GitOps, and serverless frameworks
- Ability to fine-tune ETL jobs, query performance, and cost efficiencies
- Knowledge of data product thinking and data mesh principles
Benefits
- Flexible working hours
- Professional development opportunities
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Senior Product Manager defining platform capabilities for Data Cloud in Salesforce. Collaborating with R&D teams while shaping product strategy for Data 360 integration.
Senior Data Engineer at Goodwin enhancing data platforms and fostering data - driven culture across teams. Collaborating with IT and Finance on technology solutions and data governance practices.
Director, Data Platform Design and Strategy at MedImpact leading data platform and AI innovations to enhance healthcare services. Overseeing enterprise projects and managing teams to meet strategic goals.
Data Engineer delivering AI - and data - driven solutions for Honeywell’s industrial customers. Architecting and implementing scalable data pipelines and platforms focused on IoT and real - time data processing.
Data Engineering Associate focusing on data quality control and management for distribution platform. Collaborates on large scale data projects to ensure data accuracy and availability for users.
Data Architect managing enterprise data platform built on Microsoft Fabric at Johnstone Supply. Leading architectural standards and collaborating with business and IT leaders for strategic data - driven insights.
Data Engineer at Studyportals responsible for data pipelines and infrastructure. Join a team ensuring accurate and trustworthy data for analytics and business decisions.
AI/ML Engineer designing and refining prompts and workflows using large language models. Responsible for developing data pipelines and delivering scalable AI solutions in a hybrid work environment.
AWS Data Architect at Fractal designing and operationalizing AWS data solutions at enterprise scale. Collaborating with clients and mentoring engineers in best practices.