Data Engineer developing automated data pipelines for Creditreform. Collaborating with Data Scientists and Analysts and ensuring data quality and consistency.
Responsibilities
Design, implement and operate fully automated data pipelines (ETL, ELT, etc.) for efficient processing of large volumes of structured and unstructured data using Azure Databricks
Connect various internal (e.g. databases, APIs) and external data sources (including APIs, web crawlers)
Ensure technical and operational data quality and consistency through appropriate validation and cleansing processes
Monitor running data pipelines and processes and resolve any operational errors
Work closely with our Data Scientists, Data Analysts, Data Engineers and BI developers
Document work results in a structured, audience-appropriate manner
Requirements
Degree in Computer Science, Data Engineering, a natural science or a comparable field
Initial professional experience in Data Engineering
Knowledge of developing and optimizing data pipelines (ETL, ELT), ideally with Spark and Databricks
Experience with Python, SQL, Spark, etc., with a clear focus on Data Engineering
Solid basic understanding of connecting databases, APIs, etc. to a data platform
Implementation and adherence to high data protection and security standards in a regulated environment
Drive to continuously learn and proactively develop professionally
Very good German and good English skills, both written and spoken
Benefits
30 days of vacation + Rosenmontag (Carnival Monday) off
Flexible working hours and the option to work remotely up to 2 days per week
Internal complimentary courses and ongoing training and development
Occupational health promotion, sports and recreation programs (location Neuss)
Support for company pension scheme
Family-friendly policies, private supplementary insurance also available for dependents
Opportunity to study while working
Flat-hierarchy communication and regular feedback discussions
After-work events as well as summer and Christmas parties (location Neuss)
Employee offers via Corporate Benefits or other employee discounts for items such as electronics, travel or housing
Fully equipped kitchen with coffee, tea, water and fresh fruit
Subsidized delivered lunch and a snack vending machine offering sweet, healthy or hot snacks (location Neuss)
Covered free parking and lockable bicycle parking (location Neuss)
Good public transport connections
Option for a JobRad (bike leasing) and a discounted Deutschlandticket
Technology Consulting Senior Consultant role at Protiviti, mentoring interns while leading data engineering and analytics initiatives for clients. Collaborating across diverse industries to deliver meaningful insights.
Senior Data Architect designing scalable AI - ready data architectures for Novo Nordisk. Building data platforms, ensuring compliance standards, and collaborating with cross - functional teams.
Data Engineering Coordinator at AlmapBBDO overseeing data pipeline architecture and implementation. Leading team development and ensuring data quality across platforms in a hybrid environment.
AWS Data Engineer designing data models and supporting data architecture for various clients at EXL. Collaborating to deliver data solutions for improved business outcomes in a hybrid work environment.
Senior Data Engineer at Noda creating scalable data solutions for smarter, sustainable buildings. Collaborating with teams to optimize data for high - performance analytics.
Senior Consultant position at Protiviti mentoring teams on data analytics and engineering solutions using Microsoft technologies, enhancing efficiency and client relationship management.
Leading Technology Consulting as Associate Director at Protiviti, focusing on Microsoft Fabric and Databricks. Strengthening client relationships through analytics and mentoring teams in consulting engagements.
GCP Data Engineer specializing in data governance, architecture, and quality. Collaborates in a hybrid environment across multiple locations in Mexico.
Director of Data Engineering leading data architecture and analytics at Petfolk. Overseeing data infrastructure and managing a data team to drive AI and business intelligence solutions.