Data Engineer developing and maintaining efficient data pipelines for strategic client projects. Collaborating with teams to deliver valuable data insights and ensuring data quality and governance.
About the role
- Data Engineer responsible for gathering and processing data using cutting-edge frameworks at Diconium. Collaborating with stakeholders to design and manage data pipelines for various fields.
Responsibilities
- Gather and process raw, structured, semi-structured, and unstructured data using batch and real-time data processing frameworks
- Monitor and improve the performance of the pipelines
- Work on fast paced and innovative projects with the goal to deliver innovative solutions for our customers
- Support different stakeholders (internal/external) in making the right technology decisions
- Design, implement, and manage data pipelines for our clients (internal/external)
- Support our customers in obtaining the necessary data easily and transparently in order to develop intelligent data products in different fields (mobility, automotive, industrial, consumer, financial & non-profit organizations)
Requirements
- Python
- Scripting (Bash/Python/Go/Ruby)
- ETL
- Spark
- Amazon Web Services (AWS)
- Good communication skills
- CI/CD
- Data Warehouse
- Data Architecture
- Streaming Processing (Kafka, eventhub etc)
- SQL
- Relevant working experience of 5+ years
Benefits
- Discover new skills and improve your strengths
- Adapt your working day to your personal lifestyle
- Celebrate community, sustainability and diversity
- Develop yourself both professionally and personally through training programs
- Free language courses
- Competence centers and an active tech community
- Benefit from hybrid work
- Workation
- Flexible hours
- Parental support
- Sabbaticals
- Enjoy public transport tickets
- Job bikes
- Health offers
- Supplementary insurances
- Pension plan
- Various discounts
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Data Engineer building and maintaining ETL pipelines for Northstrat's agile development team. Collaborating in a fast - paced environment with a focus on high - quality solutions.
Data Engineering Lead at BlackStone eIT managing a team and driving data solutions aligned with strategic goals. Collaborating with departments to ensure effective data management.
Data engineer designing custom data architectures at Zenika. Developing and maintaining data transformation pipelines, optimizing performance, and collaborating with cross - functional teams.
Senior Data Engineer responsible for AspenTech IP.21 implementation, leading a team for industrial data solutions.
Senior Data Engineer responsible for implementing and optimizing industrial data infrastructure at AG Solution. Leading a team and collaborating with various stakeholders to ensure data quality and reporting.
Lead Data Engineer designing scalable data architecture on Google Cloud Platform for infas 360. Collaborating with cross - functional teams to develop tailored data products in Bonn.
Data Engineer developing data platforms for Octopus Electric Vehicles. Build and optimise data solutions to transform insights for sustainable transportation.
Senior Data Engineer developing and maintaining data pipelines and solutions for EMC's data analytics products. Collaborating with cross - functional teams to ensure high - quality data management and governance practices.
Principal Product Manager leading product strategy for health data platform at PointClickCare. Collaborating across teams to optimize health data for analytics and care delivery.