Data Engineer Consultant building and maintaining enriched data infrastructure for analytical thinking at Northwest Permanente. Involves data collection, cleansing, and transformation for business intelligence.
About the role
- Data Engineer building and maintaining Azure data platforms for Hultafors Group's analytics and reporting needs. Collaborating across various business functions in a cloud environment.
Responsibilities
- Build and run our central Data Foundation platform, the single source of truth for the organization
- Work mainly in Azure with a lakehouse architecture (Azure Data Lake, Data Factory, Databricks) to collect, transform and consolidate data from ERPs, CRMs and other systems
- Enable analytics and Power BI reporting for Finance, Sales, Logistics, Sustainability, Management and other functions
- Design, develop and maintain data pipelines and models in our Data Foundation platform
- Build and optimize ingestion in Azure Data Factory from ERPs, CRMs and internal/external sources
- Develop and maintain transformation logic in Databricks (SQL and Python) and implement scalable lakehouse / dimensional models
- Profile, map and validate data to ensure high data quality and consistency for downstream analytics
- Monitor and operate pipelines and platform components (scheduling, performance, availability, error handling) according to SLAs
- Troubleshoot and resolve incidents, perform root cause analysis and implement preventative improvements
- Act as a 2nd/3rd line expert for data platform and pipeline issues
- Contribute to architecture, standards, reusable components and best practices
- Collaborate with business stakeholders, application owners, BI developers, data analysts, architects and vendors to translate requirements into data solutions
- Create and maintain technical documentation for pipelines, datasets and models
Requirements
- Bachelor’s degree in computer science, Information Systems, Engineering, Mathematics or similar, or equivalent experience
- 3–5+ years as Data Engineer, BI/Data Warehouse Developer or similar
- Hands-on experience with Azure Data Lake, Azure Data Factory and Databricks
- Strong skills in building and operating batch and/or streaming data pipelines in a lakehouse or data warehouse
- Solid SQL and Python skills for data engineering, ideally in Databricks
- Good understanding of relational/analytical databases and performance optimization
- Knowledge of data governance, data quality, security and handling of sensitive data
- Experience with monitoring, logging, alerting and ITSM processes (incident/problem/change management)
- Familiarity with CI/CD, version control and automated testing for data pipelines
Benefits
- Competitive salary
- Flexible working hours
- Professional development opportunities
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Vice President - Business, Data Architect role at TD Securities focusing on business data architecture and analytics capabilities. Collaborate with stakeholders to define and govern data models and ensure alignment with strategy.
Staff Data Engineer at Headspace building privacy - first data platforms for mental health support. Leading data engineering strategies and mentoring team members to enhance data - driven decision making.
Senior Data Engineer building and implementing data pipelines at Headspace. Collaborating with analytics and data science teams to enhance personalized mental health support.
Data Engineering Intern working on data pipelines and infrastructure in fast - growing fintech. Collaborating with data engineers, learning best practices and developing data solutions.
Senior Software Engineer building and maintaining data infrastructure for Gusto. Collaborating with Data Science and Business Intelligence teams to achieve their goals.
Data Engineer building and maintaining scalable data pipelines for AI Search Infrastructure at You.com. Collaborating across teams to ensure data quality and enable AI capabilities.
Data Engineer developing and managing technology - based data solutions for clients in different industries in Greece. Participating in software development lifecycle within Agile team setting.
Data Architect leading design and governance of high - quality data architectures for clients. Collaborating with engineering teams and stakeholders to transform business challenges into scalable data solutions.
Data Engineer supporting vehicle buying and selling solutions through integration pipelines. Collaborating with teams to build digital vehicle platforms and optimize data processes in São Paulo.