Senior Azure Data Engineer responsible for data solutions in Data & Analytics team. Requires expertise in Databricks, Azure services, and data pipeline optimization.
Responsibilities
Design, build, and maintain scalable data solutions that meet business requirements and align with industry best practices.
Collaborate with the Data & Analytics team on various projects.
Requirements
6+ years of experience as a Databricks & Data Engineer, building Azure-based data solutions using Data Factory, Synapse, Databricks.
Expertise in Python, SQL (SparkSQL, TSQL, PLSQL), Dimensional Data Modeling, Data Warehousing, and ETL/ELT processes.
Develop and optimize large-scale data pipelines using Databricks, Synapse, and Apache Spark.
Integrate data into Azure Data Lake Storage via Data Factory and Data Flows.
Architect Delta Lake & Lakehouse solutions for scalable analytics.
Optimize performance across Databricks, and Synapse environments.
Any ERP experience
Leverage Microsoft Fabric for seamless data integration & transformation.
Operationalize ML models in Databricks and automate CI/CD pipelines with Azure DevOps.
Ensure data governance & security with Azure Purview & Databricks Unity Catalog
Senior Data Engineer at Keyrus leading the design, development, and delivery of scalable data platforms. Collaborating with teams to translate requirements into production - grade solutions and mentoring engineers.
Senior Data Engineer for global payments platform designing ETL pipelines and data models. Collaborating across teams to tackle complex data challenges in an innovative fintech environment.
Data Warehouse Modelling Engineer designing and maintaining data models using Data Vault 2.0 for iGaming industry. Collaborating with stakeholders and optimizing data models in a hybrid work environment.
Senior Data Engineer driving impactful data solutions for the climate logistics startup HIVED's core data platform. Collaborating with cross - functional squads to enhance analytics and delivery.
Data Engineer developing and maintaining CRE forecasting infrastructure for Cushman & Wakefield. Collaborates with senior economists and technical teams to ensure high - quality data solutions.
Data Engineer at PwC, engaging with Azure cloud services to enhance data handling and integrity. Responsibilities include pipeline optimizations, documentation, and collaboration with stakeholders.
Data Engineer Manager at PwC focusing on building data infrastructure and solutions. Leading data engineering projects to transform raw data into actionable insights and drive business growth.