Senior Data Engineer optimizing and designing data pipelines on AWS for The Rec Hub. Collaborating with the team to enhance data processing and mentorship.
Responsibilities
Analyze and improve existing data pipelines to optimize performance, cost efficiency, and scalability.
Transition batch/snapshot pipelines to delta-based data processing pipelines.
Develop and maintain Terraform modules for efficient infrastructure management on AWS.
Migrate data pipelines from Google Cloud Platform to AWS while minimizing downtime and ensuring high reliability.
Design and implement dashboards and alerting systems to enable proactive monitoring of data pipeline performance.
Mentor, support and guide team members, share expertise and best practices, and contribute to the overall growth of the team.
Requirements
Python programming skills for data manipulation, scripting, and pipeline development.
Experience building scalable and distributed data pipelines using PySpark.
Strong command of SQL for querying and transforming large datasets.
Experience with AWS services such as S3, ECS, etc., with particular emphasis on Lambda and Glue.
Experience designing and managing infrastructure using Terraform.
Knowledge of Terragrunt is a plus.
Experience configuring and maintaining pipelines to support automation and deployment workflows.
Knowledge of DataDog for monitoring, alerting, and dashboard creation.
Benefits
Hybrid/flexible working - Onsite 3 Days a week Romania office based near București Basarab train station.
Staff Data Engineer at Headspace building privacy - first data platforms for mental health support. Leading data engineering strategies and mentoring team members to enhance data - driven decision making.
Senior Data Engineer building and implementing data pipelines at Headspace. Collaborating with analytics and data science teams to enhance personalized mental health support.
Data Engineering Intern working on data pipelines and infrastructure in fast - growing fintech. Collaborating with data engineers, learning best practices and developing data solutions.
Senior Software Engineer building and maintaining data infrastructure for Gusto. Collaborating with Data Science and Business Intelligence teams to achieve their goals.
Data Engineer building and maintaining scalable data pipelines for AI Search Infrastructure at You.com. Collaborating across teams to ensure data quality and enable AI capabilities.
Data Engineer developing and managing technology - based data solutions for clients in different industries in Greece. Participating in software development lifecycle within Agile team setting.
Data Architect leading design and governance of high - quality data architectures for clients. Collaborating with engineering teams and stakeholders to transform business challenges into scalable data solutions.
Data Engineer supporting vehicle buying and selling solutions through integration pipelines. Collaborating with teams to build digital vehicle platforms and optimize data processes in São Paulo.
Senior Advanced Data Engineer designing and optimizing data architecture for Honeywell. Collaborating with cross - functional teams to drive data - driven decision - making and operational efficiency.
Senior Data Engineer building and operating data platforms at bsport for analytics and AI/ML. Collaborating with Data team to enrich data layers and maintain platform observability.