Senior Manager leading a team of database engineers to manage CCC's data platform. Overseeing mission - critical applications and collaborating with cross - functional teams in a hybrid environment.
About the role
- Lead Data Engineer architecting and building data platforms at an ASX-listed fintech. Spearheading MLOps initiatives and collaborating across teams in a hybrid work environment.
Responsibilities
- Lead the design, development, and maintenance of scalable data pipelines using Apache Airflow, dbt, and Azure Data Factory.
- Architect and optimise our Snowflake data warehouse, including schema design, performance tuning, and cost management.
- Implement and enforce data governance policies, including data masking, role-based access control, and compliance with regulatory standards.
- Drive MLOps initiatives: model deployment, monitoring, retraining pipelines, and integration with CI/CD workflows.
- Collaborate with cross-functional teams to operationalise ML models, including Generative AI solutions, into production systems.
- Partner with the Platforms team to oversee infrastructure-as-code deployments using Pulumi, Docker, Kubernetes and cloud-native services (Azure, AWS).
- Lead, coach and guide a team of engineers, fostering a culture of best practices in coding, testing, and documentation alongside a culture of continuous learning and psychological safety.
- Partner with stakeholders across the business such as Operations to translate business requirements into technical solutions.
Requirements
- 7+ years experience in data engineering, with at least 2 years experience leading a team, ideally in a fast paced, high growth environment.
- Strong proficiency in Apache Airflow, dbt, and Azure Data Factory.
- Expertise in Snowflake, including advanced SQL, performance optimisation, and security features.
- Experience with real-time data processing (Apache Flink, Kafka).
- Proven experience with MLOps tools and frameworks (MLflow, Kubeflow, or similar).
- Hands-on experience deploying and integrating Generative AI models (OpenAI, Hugging Face, or similar).
- Solid understanding of data governance frameworks and compliance requirements (GDPR, CCPA).
- Proficiency in Python and SQL; familiarity with PySpark or other distributed processing frameworks is a plus.
- Experience with cloud platforms (Azure, AWS) and infrastructure-as-code tools (Pulumi, Terraform).
- Strong CI/CD skills with Azure Pipelines or equivalent.
- Excellent communication skills, with the ability to interact effectively with technical and non-technical stakeholders
- Strong problem solving skills, with a continuous learning mindset.
Benefits
- Flexible and hybrid working
- $500 every year to spend on your wellbeing
- Take an extra Annual Leave day off on us every financial year, with A Day on Wisr
- Access via WHEREFIT to discounted gym memberships, corporate discounts for wellbeing products and more!
- Generous paid parental leave to support your transition to parenthood
- Regular social events and awesome team offsites
- Access to our Employee Assistance Program, Uprise with up to 6 coaching sessions per year
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
No Education Requirement
Tech skills
Location requirements
As a Principal Data Architect at Solstice, lead the design and implementation of data architecture solutions. Ensure data integrity, security, and accessibility to meet strategic organizational goals.
Data Platform Specialist overseeing data workflows and enhancing data quality for Stackgini's AI - driven IT solutions. Collaborating with teams to drive improvements and stakeholder support.
Data Engineer designing data pipelines in Python for a major railway industry client. Collaborate with Data Scientists and ensure code quality with agile methodologies.
Senior Data Engineer responsible for building and optimizing data pipelines for banking analytics initiatives. Collaborating with data teams to ensure data quality and readiness for enterprise use.
Senior Data Engineer developing scalable data solutions on Databricks for analytics and operational workloads. Collaborating with cross - functional teams to modernize the data ecosystem.
Data Engineer focused on analytics and data pipeline development for network optimisation. Collaborating with teams to deliver high - quality data solutions with Python and SQL.
Senior Product Manager defining platform capabilities for Data Cloud in Salesforce. Collaborating with R&D teams while shaping product strategy for Data 360 integration.
Senior Data Engineer at Goodwin enhancing data platforms and fostering data - driven culture across teams. Collaborating with IT and Finance on technology solutions and data governance practices.
Director, Data Platform Design and Strategy at MedImpact leading data platform and AI innovations to enhance healthcare services. Overseeing enterprise projects and managing teams to meet strategic goals.