Senior Engineer responsible for data lake management and processing pipeline design using Python, Spark, and Azure. Ensuring high data quality and operational continuity in a growing organization.
Responsibilities
Maintain, develop, and optimize the global datalake environment, ensuring high data quality, reliability, and overall performance
Design and implement high-performance data processing pipelines and workflows utilizing Python, Spark, and Databricks
Manage scalable and efficient data integration and processing solutions using Azure Data Factory, Databricks, and Event Hub
Establish robust data management processes and execute advanced data querying and quality control with SQL and big data technologies
Automate operational tasks and support infrastructure maintenance by leveraging shell scripting and foundational UNIX knowledge
Support data modeling initiatives for coherent structure design and document all technical processes to ensure operational continuity
Requirements
Strong background and understanding of database data management (general SQL knowledge, data querying, data quality control)
Strong programming knowledge in Python (pandas, numpy)
Advanced level Big Data / data lake framework (Spark, Databricks)
Strong cloud knowledge and handling of Azure Data Factory, Databricks, Event Hub
Basic familiarity with UNIX operating system, especially shell scripting
Basic understanding of network level problems and connectivity requirements
Basic Understanding data modelling principes
Data-centric mindset
Structured, analytical thinking
Can work in a multi-shift operation (Monday to Friday, 07:00 AM - 22:00 PM) + on-call (weeknights, weekend)
Benefits
Possibility to improve yourself in a constantly growing organization
Senior Full Stack Engineer responsible for developing and integrating AI tools in a HealthTech startup, providing impactful solutions for therapists' workflows.
Full Stack Engineer developing AI systems for a proactive chat app. Building features across frontend, backend, and AI integrations for reliable workflows.
Full - Stack Developer creating innovative digital solutions at Dreamlight Labs. Develop modern web interfaces and APIs while collaborating with a dynamic team in the creative industry.
Software Tech Lead responsible for Full Stack architecture and development at SPiNE Energy startup. Engage in innovative energy applications and scalable solutions for energy management.
Product Engineer responsible for full - stack development and feature ownership using AI tools. Join JustDice in Hamburg to build mobile and apps in a supportive environment.
Senior Staff Engineer at mylo responsible for large - scale technical impact across backend systems. Collaborating with teams to ensure architectural excellence and improve system reliability.
Full Stack Developer at Centah managing integrations and API features for a scalable SaaS platform. Contributing to system reliability and mentoring less experienced engineers.
Director of Software Engineering providing strategic and technical leadership across Ensemble’s software delivery organization. Drive technology strategy and lead engineering teams to deliver scalable software solutions.
Developing and maintaining state of the art solutions for McKesson. Senior Associate Software Engineer role requires collaboration with teams and participation in Agile methodology.
Lead Software Engineer responsible for influencing and implementing technology strategy for software delivery teams at Ensemble. Focused on developing reusable components and mentoring technical deliverables.