Senior Data Engineer for the MDM Data Product Team at Avenga. Responsible for provisioning data from master data customer and product systems.
About the role
- Senior Azure Data Engineer at Accellor enhancing data capabilities for enterprise clients using Azure technologies. Building solutions to transform business processes through robust data engineering practices.
Responsibilities
- Develop and maintain robust data pipelines to collect, transform, and process large datasets from various sources, ensuring timely and accurate delivery of data for analytics and reporting.
- Strong experience in performance tuning databases, procedures, and functions, with a focus on optimizing data architecture, scalability, and cost savings.
- Pipeline Development: Design and implement scalable data integration pipelines using Azure Data Factory (ADF) and Azure Databricks.
- Data Modeling: Create and maintain complex data models in Azure Synapse Analytics and Azure SQL Database to support business intelligence needs
- Work with the Lead Engineer to automate business processes, automate the movement of data within the organization, and orchestrate the exchange of data with external partners.
- Collaborate with other department managers and business leaders to complete organizational goals and strategic priorities and support critical processes.
- Optimize data architecture and performance by leveraging modern technologies and by implementing performance-tuning strategies for databases, procedures, and functions.
- Automate data workflows to improve efficiency and scalability, while ensuring data integrity, hygiene, and cost efficiency.
- Work closely with business stakeholders to gather requirements, translate them into technical specifications, and deliver solutions within project timelines.
- Troubleshoot and resolve data and reporting issues, driving continuous improvement in analytic capabilities.
Requirements
- Bachelor’s degree is preferred in Computer Science, Data Engineering, with over 12+ years of professional experience.
- A proven track record in building scalable data pipelines and automating data processes through programming, scripts, APIs, and platform tools.
- Strong expertise in modern data tools and technologies, including SQL Server, Microsoft Fabric, Data Bricks, Azure Functions, ADF, Synapse, Python, C# / .NET, and APIs.
- Cloud Platform: Proven experience with the Azure Data Stack (ADF, Synapse, Databricks, ADLS).
- Languages: Strong proficiency in SQL and Python (PySpark). Knowledge of Scala or C# is a plus.
- Deep understanding of data integrity and hygiene, with a commitment to maintaining high standards of data quality.
- Excellent communication and collaboration skills, with the ability to work effectively with cross-functional teams and stakeholders.
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Data Warehouse Modelling Engineer designing and maintaining data models using Data Vault 2.0 for iGaming industry. Collaborating with stakeholders and optimizing data models in a hybrid work environment.
Senior Data Engineer driving impactful data solutions for the climate logistics startup HIVED's core data platform. Collaborating with cross - functional squads to enhance analytics and delivery.
Data Engineer developing and maintaining CRE forecasting infrastructure for Cushman & Wakefield. Collaborates with senior economists and technical teams to ensure high - quality data solutions.
Data Engineer at PwC, engaging with Azure cloud services to enhance data handling and integrity. Responsibilities include pipeline optimizations, documentation, and collaboration with stakeholders.
Data Engineer Manager at PwC focusing on building data infrastructure and solutions. Leading data engineering projects to transform raw data into actionable insights and drive business growth.
Junior Data Engineer at OneMarketData focusing on data quality and integrity in financial datasets. Collaborating with senior analysts and assisting in data management and analysis tasks.
Data Engineer Manager leading robust data solutions for PwC's clients. Transforming raw data into actionable insights and coaching team members.
Senior Data Engineering Analyst developing and implementing data solutions. Collaborating in a diverse environment focused on data processing and analysis for clients' digital transformation.
Principal Software Engineer in Threat Data Platform developing AI - driven tools for threat intelligence automation. Collaborating on robust data pipelines for PANW’s product ecosystem.