Senior Data Engineer at QiH responsible for designing real-time data pipelines and building scalable infrastructure. Collaborating with teams to tackle data challenges with innovative solutions.
Responsibilities
Design, develop, and maintain scalable real-time data pipelines and infrastructure.
Integrate various data sources and ensure seamless real-time data flow across the organisation.
Build efficient, fault-tolerant, and highly available data ingestion processes.
Monitor and improve data pipeline performance and scalability for low-latency and high-throughput.
Work closely with cross-functional teams, including software engineers, data scientists, and business stakeholders, to ensure data infrastructure aligns with business objectives.
Requirements
Hands-on experience in data engineering with a proven track record of building and managing real-time data pipelines across a track record of multiple initiatives.
Expertise in developing data backbones using distributed streaming platforms (Kafka, Spark Streaming, Flink, etc.).
Experience working with cloud platforms such as AWS, GCP, or Azure for real-time data ingestion and storage.
Programming skills in Python, Java, Scala, or a similar language.
Proficiency in database technologies (SQL, NoSQL, time-series databases) and data modelling.
Strong understanding of data pipeline orchestration tools (e.g., Apache Airflow, Kubernetes).
You thrive when working as part of a team
Comfortable in a fast-paced environment
Have excellent written and verbal English skills
Last but not least, you’ll have no ego!
Benefits
Competitive Basic Salary
Quarterly Bonuses
Hybrid working
Private Health Care
Market Leading Training Programme
Recognition & Reward Scheme
Annual Company Conference (previous destinations Bologna, Dubrovnik, Belgrade and Thessaloniki)
Data Engineer focused on analytics and data pipeline development for network optimisation. Collaborating with teams to deliver high - quality data solutions with Python and SQL.
Senior Product Manager defining platform capabilities for Data Cloud in Salesforce. Collaborating with R&D teams while shaping product strategy for Data 360 integration.
Senior Data Engineer at Goodwin enhancing data platforms and fostering data - driven culture across teams. Collaborating with IT and Finance on technology solutions and data governance practices.
Director, Data Platform Design and Strategy at MedImpact leading data platform and AI innovations to enhance healthcare services. Overseeing enterprise projects and managing teams to meet strategic goals.
Data Engineer delivering AI - and data - driven solutions for Honeywell’s industrial customers. Architecting and implementing scalable data pipelines and platforms focused on IoT and real - time data processing.
Data Engineering Associate focusing on data quality control and management for distribution platform. Collaborates on large scale data projects to ensure data accuracy and availability for users.
Data Architect managing enterprise data platform built on Microsoft Fabric at Johnstone Supply. Leading architectural standards and collaborating with business and IT leaders for strategic data - driven insights.
Data Engineer at Studyportals responsible for data pipelines and infrastructure. Join a team ensuring accurate and trustworthy data for analytics and business decisions.
AI/ML Engineer designing and refining prompts and workflows using large language models. Responsible for developing data pipelines and delivering scalable AI solutions in a hybrid work environment.
AWS Data Architect at Fractal designing and operationalizing AWS data solutions at enterprise scale. Collaborating with clients and mentoring engineers in best practices.