Senior Data Engineer optimizing and designing data pipelines on AWS for The Rec Hub. Collaborating with the team to enhance data processing and mentorship.
About the role
- Data Engineer designing and building scalable data pipelines for advanced analytics. Utilizing Azure cloud platforms and industry-leading tools to support client data needs.
Responsibilities
- Develop, maintain, and optimize reusable, scalable data pipelines that include robust error handling and logging mechanisms.
- Implement automated notifications and error reporting using Azure Logic Apps and other tools.
- Collaborate with cross-functional teams to ensure data pipelines align with business objectives and meet performance requirements.
- Ensure data quality by implementing and maintaining frameworks.
- Design and implement data models and ETL/ELT processes that enable high-performance analytics solutions.
- Support the integration and transformation of diverse data sources into unified and consumable formats.
- Stay up-to-date with the latest advancements in Azure data services, including Microsoft Fabric, to deliver innovative solutions.
Requirements
- 3-5 years of proven experience as a Data Engineer or in a similar role.
- Proficiency in designing and implementing data pipelines with tools such as Azure Data Factory and Azure Synapse, preferably within Microsoft Fabric.
- Strong programming skills in Python (preferable), Spark, Java, or C#.
- Advanced SQL expertise (T-SQL, PL/SQL) for database design and query optimization.
- Hands-on experience with cloud data platforms, particularly Azure (Databricks, Synapse, Data Factory, Logic Apps).
- Familiarity with data quality frameworks.
Benefits
- Competitive compensation with bonus potential.
- Comprehensive benefits, including health, dental, and vision coverage.
- Generous PTO and paid holidays.
- Certification support, training programs, and professional growth opportunities.
- Flexible work environment with remote and hybrid options.
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Data Engineer responsible for analyzing data and supporting decision - making processes in a wellness - focused company. Utilizing advanced data technologies and collaborating with internal teams for effective data management.
Data Engineer at TeCreation focusing on data analysis and innovative system development in the well - being industry. Collaborating on data integration and business intelligence reporting.
Senior Data Engineer developing high - impact data solutions in a collaborative financial team. Integrating data systems and ensuring performance with innovative technologies.
Senior Data Engineer developing data pipelines and infrastructure on Google Cloud Platform for WorkWhile's staffing marketplace. Collaborating with Data Science and Engineering teams to enhance data quality and availability.
Data Engineer developing data platforms for a consulting firm focused on quality solutions. Collaborating within a small team to deliver robust infrastructure and systems.
Senior Data Engineer designing and maintaining data pipelines within a fast - growing social impact startup. Collaborate cross - functionally to enhance products and analytics capabilities.
Senior Associate in data engineering at PwC focusing on designing robust data solutions. Leading complex data pipeline projects and collaborating with cross - functional teams to support automation and analytics.
Data Engineering & Warehousing Manager overseeing data engineering and warehousing operations at Hastings Insurance. Leading pipelines, platforms, and technical teams for enterprise data insights.
Senior Data Engineer delivering scalable data solutions in data engineering team at fintech startup. Building and maintaining data pipelines, collaborating with cross - functional teams for accurate data delivery.