Platform Engineer with expertise in Databricks to manage and optimise the platform's performance and costs at Deloitte. Engaging in operational excellence and analysis of performance metrics.
Responsibilities
Manage and optimise the Databricks platform to ensure high performance and cost efficiency
Analyse DBU consumption and drive improvements in platform utilisation
Monitor and enhance PySpark pipeline performance
Make informed decisions on scaling up/down clusters based on workload demands
Establish and maintain automated release management processes
Focus on operational excellence across the platform environment
Gather performance data and provide clear evidence-based insights to stakeholders and Databricks teams
Requirements
Strong hands-on experience with Databricks platform engineering
Solid expertise in PySpark and performance tuning
Proven experience optimising data pipelines and platform costs
Experience with cluster management and scaling strategies
Ability to analyse performance metrics and present findings effectively
Familiarity with platform operations and reliability best practices
Cloud Engineer at SDG Group managing data volume optimization for GCP. Designing workflows and ensuring efficient data processing in a hybrid work environment.
Product Reliability Engineer role at Kraken focused on scalable energy management solutions. Collaborating with teams to ensure product performance and system resilience in a hybrid work environment.
Frontend Platform Developer at Borrowell building foundational components for product teams in a remote - first environment. Collaborating with cross - functional teams to enhance code quality and app reliability.
AI Platform Engineer role at RAVL focused on developing GenAI platforms and agent - based architectures. Building scalable integration layers for enterprise AI in a growing engineering team.
ML Platform Engineer at RAVL designing scalable machine learning platforms for financial services. Leading development on Azure Databricks and optimizing MLOps pipelines for enterprise environments.
Lead Platform Engineer managing cloud - native infrastructure at InsurTech company, driving architectural decisions and enhancing platform reliability under a culture of simplicity and care.
Principal Platform Engineer leading platform architecture and operations at Automata, transforming lab automation through integrated technology solutions in a hybrid work model.
Power Platform Engineer developing solutions using PowerPlatform at knowmad mood. Collaborating with multidisciplinary teams in Madrid for quality project delivery in a hybrid mode.
Cloud Operations Engineer responsible for ensuring operational stability of Saviynt’s cloud platform. Collaborating with teams to troubleshoot issues and implement improvements in a dynamic environment.