Data Architect designing and implementing analytics and reporting solutions for Taylor Corporation. Collaborating with stakeholders and leading data modeling efforts in a hybrid environment.
About the role
- Senior Data Engineer responsible for designing and implementing ETL pipelines. Collaborating with cross-functional teams to ensure data quality and optimizing data workflows with AWS tools.
Responsibilities
- Design and implement robust ETL pipelines using AWS Glue, Lambda, and S3.
- Monitor and optimize the performance of data workflows and batch processing jobs.
- Troubleshoot and resolve issues related to data pipeline failures, inconsistencies, and performance bottlenecks.
- Collaborate with cross-functional teams to define data requirements and ensure data quality and accuracy.
- Develop and maintain automated solutions for data transformation, migration, and integration tasks.
- Implement best practices for data security, data governance, and compliance within AWS environments.
- Continuously improve and optimize AWS Glue jobs, Lambda functions, and S3 storage management.
- Maintain comprehensive documentation for data pipeline architecture, job schedules, and issue resolution processes.
Requirements
- Strong experience with Data Engineering practices.
- Experience in AWS services, particularly AWS Glue, Lambda, S3, and other AWS data tools.
- Proficiency in SQL, python , Pyspark, numpy etc and experience in working with large-scale data sets.
- Experience in designing and implementing ETL pipelines in cloud environments.
- Expertise in troubleshooting and optimizing data processing workflows.
- Familiarity with data warehousing concepts and cloud-native data architecture.
- Knowledge of automation and orchestration tools in a cloud-based environment.
- Strong problem-solving skills and the ability to debug and improve the performance of data jobs.
- Excellent communication skills and the ability to work collaboratively with cross-functional teams.
- Good to have knowledge of DBT & Snowflake
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
BI Data Engineer designing and optimizing Power BI dashboards for Rabobank's Payments & Savings data. Collaborating with cross - functional teams to provide actionable insights from large data sets.
Lead Data Engineer providing technical expertise and mentoring at Westpac. Ensuring platform stability and compliance while driving engineering practices within the squad.
Data Engineer at Uline delivering custom data warehousing solutions for shipping materials distribution. Responsibilities include ETL workflows and data integration management.
MDM Data Engineer managing Profisee MDM platform for Pacific Life. Responsible for data quality, integration and technical support across enterprise systems.
Data Engineer responsible for designing and developing cloud - based data pipelines for ING. Collaborating with international teams focusing on financial risk analytics in the cloud environment.
Data Engineer specializing in SQL and datamigration processes for the municipality of Amsterdam. Collaborating with diverse stakeholders to ensure data integrity and accessibility.
Senior Expert in Data Architecture at OMV Group based in Romania. Leading data governance strategy and managing complex data management responsibilities.
Senior BI and Data Engineer developing innovative BI solutions in the Tech for Good space. Collaborating to enhance STEM education through effective data practices.
Data Engineer creating scalable, reliable data solutions for Retail Insight's clients and enhancing the data ecosystem. Collaborating with software engineers to ensure data quality and accessibility.