Data Platform Expert developing and maintaining data solutions for analysis and reporting at Magna Electronics. Collaborating with various teams to enhance data - driven decision making and insights.
About the role
- Data Engineer at GFT managing data systems and workflows, focusing on data engineering and data science collaboration. Leveraging technologies like Python, Airflow, and AWS.
Responsibilities
- Architect, develop, and maintain scalable data infrastructure, including data lakes, pipelines, and metadata repositories
- Work closely with data scientists to build and support data models, integrate data sources, and support machine learning workflows and experimentation environments
- Develop and optimize large-scale, batch, and real-time data processing systems to enhance operational efficiency and meet business objectives
- Leverage Python, Apache Airflow, and AWS services to automate data workflows and processes
- Utilize AWS services such as S3, Glue, EC2, and Lambda to manage data storage and compute resources
- Implement robust testing and validation procedures to ensure the reliability, accuracy, and security of data processing workflows
- Stay informed of industry best practices and emerging technologies in both data engineering and data science
Requirements
- Proficiency in Python for data processing and scripting (pandas, pyspark)
- Workflow automation (Apache Airflow)
- Experience with AWS services (Glue, S3, EC2, Lambda)
- Experience with Kubernetes and Docker for managing containerized environments in the cloud
- Hands-on experience with columnar and big data databases (Athena, Redshift, Vertica, Hive/Hadoop)
- Strong familiarity with AWS services for cloud-based data processing and management
- Experience with CI/CD tools such as Jenkins, CircleCI, or AWS CodePipeline for continuous integration and deployment
- Expertise in building and managing robust data architectures and pipelines for large-scale data operations
- Ability to support data science workflows, including collaboration on data preparation, feature engineering, and enabling experimentation environments
Benefits
- Competitive salary
- 13th-month salary guarantee
- Performance bonus
- Professional English course for employees
- Premium health insurance
- Extensive annual leave
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Data Engineer at Mobiz designing, building, and maintaining scalable data solutions for analytics. Collaborating with teams to leverage modern cloud technologies and improve data - driven decision - making.
Head of Data Engineering at Envitia overseeing data architecture services for public sector programs. Leading service mobilization with client stakeholders in a hybrid work environment.
Applied AI Health Data Architect - Senior Manager at PwC designing data architecture for healthcare operations. Contributing to innovative data solutions and mentoring teams for operational excellence.
CRM Functional Data Migration Engineer at Data - Core Systems, Inc. managing Dynamics 365 CE solutions and delivering technical expertise in a consulting role.
Data Engineer role for Alberta Securities Commission, focusing on data pipelines and infrastructure. Involves designing, building, and securing data assets for organizational decision - making.
Data Architect supporting UK MOD programme delivering data and integration capabilities for Defence. Join Amentum's growing IT team focused on critical national infrastructure and security projects.
Data Engineer joining Contour Software's development team to handle various big data projects. Focus on cloud data lake architecture and machine learning implementation.
Enterprise Architect Sr position at PNC collaborating with technology stakeholders to build enterprise data architecture. Focus on data models, governance, and guiding data decisions for business strategy.
Data Engineer architecting and maintaining data products using Databricks and Power BI for Nitro's digital transformation efforts. Collaborating to optimize processes and leverage cloud technologies.