Data Engineer building scalable cloud data pipelines in Azure and Databricks. Focus on Lakehouse architecture and data governance in a hybrid work model.
Responsibilities
Design and develop scalable, robust data ingestion and transformation pipelines on Azure and Databricks;
Build solutions based on Lakehouse architecture, organized into bronze, silver and gold layers;
Ensure pipeline performance and scalability through best practices in partitioning, caching and parallelism;
Automate processes with a focus on reusability, monitoring and quality control;
Act as a technical reference for the data engineering team, promoting best practices and standardization.
Requirements
Experience with transactional databases and requirements analysis;
Knowledge of Data Governance;
Strong familiarity with Azure Data Lake Gen2, Azure Data Factory, Key Vault and integration across Azure services;
Proficiency in Spark (PySpark) and Python for developing pipelines and transforming data;
Experience with Git and CI/CD practices applied to data pipelines;
Advanced conversational English.
Benefits
Multi-benefits card – choose how and where to use it.
Scholarships for undergraduate, graduate, MBA and language courses.
Certification incentive programs.
Flexible working hours.
Competitive salaries.
Annual performance review with a structured career plan.
Possibility of international career opportunities.
Data Platform Expert developing and maintaining data solutions for analysis and reporting at Magna Electronics. Collaborating with various teams to enhance data - driven decision making and insights.
Data Engineer at Mobiz designing, building, and maintaining scalable data solutions for analytics. Collaborating with teams to leverage modern cloud technologies and improve data - driven decision - making.
Head of Data Engineering at Envitia overseeing data architecture services for public sector programs. Leading service mobilization with client stakeholders in a hybrid work environment.
Applied AI Health Data Architect - Senior Manager at PwC designing data architecture for healthcare operations. Contributing to innovative data solutions and mentoring teams for operational excellence.
CRM Functional Data Migration Engineer at Data - Core Systems, Inc. managing Dynamics 365 CE solutions and delivering technical expertise in a consulting role.
Data Engineer role for Alberta Securities Commission, focusing on data pipelines and infrastructure. Involves designing, building, and securing data assets for organizational decision - making.
Data Architect supporting UK MOD programme delivering data and integration capabilities for Defence. Join Amentum's growing IT team focused on critical national infrastructure and security projects.
Data Engineer joining Contour Software's development team to handle various big data projects. Focus on cloud data lake architecture and machine learning implementation.
Enterprise Architect Sr position at PNC collaborating with technology stakeholders to build enterprise data architecture. Focus on data models, governance, and guiding data decisions for business strategy.
Data Engineer architecting and maintaining data products using Databricks and Power BI for Nitro's digital transformation efforts. Collaborating to optimize processes and leverage cloud technologies.