SAP Specialist responsible for designing, developing, and executing data migration objects in Hydro’s SAPEX program. Ensuring successful ETL processes and maintaining data quality.
About the role
- Azure Data Engineer developing scalable data pipelines and collaborating with data teams for EU institutions. Working remotely from EU locations with a focus on high-quality data management.
Responsibilities
- Develop, deploy, and maintain scalable and incremental data pipelines from REST APIs and databases using Python, PySpark, Azure Synapse, Knime, SQL, and ETL tools to ingest, transform, and prepare data.
- Process and transform complex JSON and GIS data into structured datasets optimized for analysis and reporting.
- Load, organize, and manage data in Azure Data Lake Storage and Microsoft Fabric OneLake, ensuring accessibility, performance, and efficient storage using lakehouse and Delta Lake patterns.
- Document ETL processes, metadata definitions, data lineage, and technical specifications to ensure transparency and reusability.
- Collaborate with data analysts, BI developers, and business stakeholders to understand data requirements and deliver reliable, well-documented datasets aligned with organizational needs.
- Implement data quality checks, logging, monitoring, and automated incremental load mechanisms within data pipelines to support maintainability, observability, and troubleshooting.
Requirements
- Bachelor degree - EQF 6
- Ability to understand, speak and write English (C1/C2), French (B2) will be an advantage
- Excellent knowledge of data engineering tools Azure Synapse Analytics, Microsoft Fabric, PySpark and Python.
- Excellent knowledge of working with REST APIs, including ingestion and parsing of JSON and GIS data
- Excellent knowledge of Azure data lake storage and Oracle database
- Experience designing incremental loads, CDC processes, and automated schema evolution
- Ability to implement robust data quality checks, logging, and monitoring in ETL processes
- Ability to document ETL workflows, metadata, and technical specifications clearly and consistently
- Familiarity with DevOps and version control best practices.
- Experience with CI/CD pipelines
- Experience working in an Agile and Scrum framework
- Analysis and problem solving skills
- Ability to participate in technical meetings and good communication skills
- Ability to participate in multilingual meetings
- Ability to work in multi-cultural environment, on multiple large projects; Excellent Team Player
- Specific expertise (mandatory) at least 5 years of excellent knowledge in Azure Data Lake Storage, Microsoft Fabric OneLake, and Oracle databases
- at least 5 years of excellent expertise in developing data pipelines from REST APIs and on integration (such as Azure Synapse, PySpark, Microsoft Fabric, Python, SQL, KNIME)
- at least 5 years of excellent expertise in processing JSON and GIS data
- Certificates (mandatory) Microsoft Azure Data Engineer Associate
- Following certifications are a plus: Microsoft Certified: Azure Solutions Architect Expert
- Microsoft Certified: Azure Developer Associate
- Microsoft Certified: Azure Database Administrator Associate
Benefits
- Freelance B2B
- Professional development opportunities
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Senior Data Engineer building scalable data pipelines and data models within retail at Avaron. Collaborating closely with business and technical teams to ensure reliable data solutions.
Senior Data Engineer building and operating the data platform at bsport. Collaborating with the Data team to optimize data intake and accessibility for analytics and AI.
Data Engineer building and maintaining Azure data platforms for Hultafors Group's analytics and reporting needs. Collaborating across various business functions in a cloud environment.
Lead Data Pipeline Manager at Valpak, overseeing data pipelines for environmental compliance initiatives. Collaborate with teams to ensure data quality and operational performance.
Data Engineer role responsible for building scalable data pipelines and systems at Consort Group in Portugal. Involves data engineering and regulatory reporting across diverse technical environments.
Senior Data Engineer with strong ETL experience using IBM DataStage for data transformations. Collaborating on data quality and design improvements in a hybrid environment.
Data Engineer supporting data capabilities of the fastest - growing family law firm in the UK. Drive data initiatives and collaborate with the BI team in a hybrid working environment.
Data Architect designing AWS - based data solutions in hybrid role with a major financial sector client in LATAM. Involves leading data architecture decisions and optimizing data processing solutions.
Senior Data Engineer developing data solutions for a key client in the financial sector. Collaborating in a hybrid setting located in Quito, Ecuador.