Data Engineer optimizing PostgreSQL and OpenSearch platforms at Deutschlandradio. Supporting media research with data analysis and maintaining high data quality in projects.
Responsibilities
Further development and optimization of our on-premise data platform (PostgreSQL, OpenSearch) for the analysis of podcast logfiles in particular
Maintenance and improvement of ETL/ELT pipelines (Airflow) for processing usage data from various sources
Maintenance of the CI/CD pipeline (GitLab) and deployment processes for automated data processing and dashboard updates
Technical support of our tracking solution (Piano Analytics) and ensuring high data quality for analyses
Provision of reliable data for the media research team and editorial departments, and support with technical questions regarding dashboards and reports
Further development of monitoring and alerting and ensuring GDPR compliance across all data processes
Requirements
Degree in Computer Science, Mathematics, Data Science or a comparable professional background with several years of experience as a Data Engineer
Strong programming skills in Python and solid SQL skills, ideally with practical experience in PostgreSQL
Experience with Airflow for orchestrating ETL/ELT pipelines and familiarity with GitLab CI/CD, Docker and Linux environments
Experience in logfile analysis and processing, and ideally knowledge of OpenSearch, Elasticsearch or similar search engines
Basic understanding of Machine Learning and NLP for future projects is desirable, as well as cloud experience (GCP, AWS)
Strong communication skills, enjoyment of independent work and the ability to convey technical matters clearly
Good written and spoken German (C1 level or higher)
Benefits
Exciting and creative tasks in a dynamic and motivated team
Work at a public-service broadcaster that follows the guiding principle of acting "confidently, respectfully and curiously" both internally and externally
The opportunity to contribute your own ideas and suggestions, as well as a variety of development and training opportunities
Flexible home office and mobile working options
Family-friendly employer and childcare during the summer holidays
Company pension scheme and other attractive collective-agreement social benefits
Discounted sports offerings through our corporate sports program and a partnership with Urban Sports Club
Good public transport connections and a monthly subsidy for the Deutschlandticket (nationwide public transport pass)
Meal options available at both Cologne and Berlin locations
Director of Data Engineering leading data architecture and analytics at Petfolk. Overseeing data infrastructure and managing a data team to drive AI and business intelligence solutions.
Senior Data Engineer managing end - to - end data pipelines with Google Cloud Platform. Collaborating closely with product teams to deliver scalable data solutions in a hybrid setting.
GCP Data Engineer designing, building, and optimising data solutions on Google Cloud Platform. Collaborating with clients to solve complex data challenges and enhance AI capabilities.
Data Engineer developing scalable data solutions across multi - cloud environments for clients. Mentoring junior engineers while ensuring data quality and promoting best practices within the team.
Consultant Data Engineer for modern data transformations at Intelligen. Work on dbt and Snowflake projects for enterprise clients to optimize data pipelines.
Data Engineer designing and delivering modern data solutions across multi - cloud environments for clients in Australia. Collaborating and mentoring while contributing to meaningful projects in a high - performing team.
Principal Product Manager leading GEICO's Customer Data Platform development and strategy. Collaborating with cross - functional stakeholders to improve customer engagement through data - driven solutions.
Senior Product Manager at GEICO managing the Customer Data Platform, collaborating across teams for data - driven solutions. Evolving customer engagement using innovative data strategies.
Data Engineering Lead at Absa enabling analytics and AI through scalable data platforms. Overseeing engineering teams to deliver high - quality, trusted data solutions.