Data Engineer optimizing data integrations for Retail industry. Combine multiple data sources and design ETL workflows while maintaining data quality and security.
Responsibilities
Combine data from multiple sources such as APIs, databases, and third-party systems;
Design and execute ETL/ELT workflows utilizing advanced data processing tools like Cloud Composer/Airflow, Dataflow;
Develop robust and efficient data pipelines, implement processing logic, and perform data transformations;
Enhance BigQuery queries and allocate resources effectively to minimize costs and boost performance;
Maintain data quality, availability, and security by adhering to industry best practices.
Requirements
Demonstrated experience as a Data or Software Engineer in Senior role
Prior experience with dbt and Python is advantageous
Familiarity with CI/CD systems like GitLab is required
Experience with any public Cloud service
Knowledge of Google Cloud and Cloud Data Warehousing is highly beneficial
Specifically, experience with BigQuery or Snowflake and their integration with dbt is preferred. Additionally, proficiency with Terraform is strongly desired.
Benefits
Diverse and technically challenging projects
Training budget for professional and personal growth
Flexible working hours and a hybrid workplace model
Senior Data Engineer focusing on data infrastructure for an AI - driven insurtech startup based in Nepal. Collaborating with teams to optimize data models and maintain data quality.
Senior Professional Consultant leading architecture and design for SAP BW and SAC solutions at Freudenberg. Collaborating with stakeholders and optimizing performance of data landscapes.
Senior Data Engineer designing and managing data architectures to transform large - scale data into insights for Humana. Involves leading technical discussions and implementing best data practices.
Data Engineer II at Early Warning Services developing data science tools and infrastructure. Collaborating on software enhancements and mentoring interns in a hybrid work environment.
Senior Data Architect responsible for optimizing data architecture and supporting data - driven business decisions at TruStage. Leading technical guidance for data architecture and cross - functional team collaboration.
Senior Data Architect developing data architecture plans at The Hartford, collaborating with internal teams to align data standards and practices. Leading complex solutions with a focus on operational effectiveness.
Senior Solution Architect defining architecture framework for SA‑CCR in regulatory risk. Collaborating with stakeholders to ensure compliance and efficient data governance.
Senior Data Engineer optimizing and designing data pipelines on AWS for The Rec Hub. Collaborating with the team to enhance data processing and mentorship.
Data Engineer at TeCreation focusing on data analysis and innovative system development in the well - being industry. Collaborating on data integration and business intelligence reporting.