Data Platform Expert developing and maintaining data solutions for analysis and reporting at Magna Electronics. Collaborating with various teams to enhance data - driven decision making and insights.
About the role
- Data Engineer strengthening data platform team at Samba TV to improve data analytics and reporting capabilities. Building on AWS, Databricks, BigQuery, and Snowflake technology.
Responsibilities
- Build scalable data product architecture
- Responsible for modernizing data frameworks and integrations with Databricks and BigQuery
- Upgrade and reduce toil for developers on Apache Airflow
- Develop and optimize data transformations using Apache Spark (PySpark/Scala)
- Build procedures and guidelines to help teams operate with data
- Identify bottlenecks in our development lifecycle and find solutions to improve them
- Drive innovation throughout the tech org by evangelizing and educating teams on best practices and new technologies
- Work directly with our data teams and FinOps teams to drive efforts that span across teams
- Implement data governance, access control, and auditing using Databricks Unity Catalog
- Build and integrate automated, reusable data validation suites using data quality frameworks (Great Expectations or similar)
- Implement monitoring and anomaly detection systems for data quality, reliability and performance
- Develop and manage REST APIs to support secure data access, automation, and integration
- Collaborate with data scientists, analysts, and software engineers to deliver governed, reusable data assets
- Implement monitoring, logging, and alerting for data workflows
- Optimize cost and performance of cloud-based data infrastructure
Requirements
- Bachelor’s degree in Computer Science, Engineering, or a related field (or equivalent experience)
- 5+ years of experience in data engineering or a related role
- Strong hands-on experience with Databricks, Apache Spark and BigQuery or Snowflake
- Proven experience with Modern table formats such as Delta Lake and Iceberg
- A deep understanding of the data lifecycle and how teams operate with data
- Hands-on experience implementing data governance and metadata management using Databricks Unity Catalog
- Experience managing and extending Apache Airflow (custom operators, plugins, infrastructure)
- Experience with Kubernetes
- Solid experience with AWS cloud services, especially S3 and data-related services
- Experience with data validation and data quality principles and working with SLA systems
- Proficiency in Python and SQL
Benefits
- Equal opportunity employer
- Celebration of diversity
- Commitment to an inclusive environment
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Data Engineer at Mobiz designing, building, and maintaining scalable data solutions for analytics. Collaborating with teams to leverage modern cloud technologies and improve data - driven decision - making.
Head of Data Engineering at Envitia overseeing data architecture services for public sector programs. Leading service mobilization with client stakeholders in a hybrid work environment.
Applied AI Health Data Architect - Senior Manager at PwC designing data architecture for healthcare operations. Contributing to innovative data solutions and mentoring teams for operational excellence.
CRM Functional Data Migration Engineer at Data - Core Systems, Inc. managing Dynamics 365 CE solutions and delivering technical expertise in a consulting role.
Data Engineer role for Alberta Securities Commission, focusing on data pipelines and infrastructure. Involves designing, building, and securing data assets for organizational decision - making.
Data Architect supporting UK MOD programme delivering data and integration capabilities for Defence. Join Amentum's growing IT team focused on critical national infrastructure and security projects.
Data Engineer joining Contour Software's development team to handle various big data projects. Focus on cloud data lake architecture and machine learning implementation.
Enterprise Architect Sr position at PNC collaborating with technology stakeholders to build enterprise data architecture. Focus on data models, governance, and guiding data decisions for business strategy.
Data Engineer architecting and maintaining data products using Databricks and Power BI for Nitro's digital transformation efforts. Collaborating to optimize processes and leverage cloud technologies.