Data Engineer focused on analytics and data pipeline development for network optimisation. Collaborating with teams to deliver high - quality data solutions with Python and SQL.
About the role
- Senior Data Engineer developing solutions for high-impact data in the financial sector. Join an innovative and collaborative team with opportunities to grow.
Responsibilities
- Design, develop and support robust data infrastructure solutions with a focus on scalability, security and efficiency.
- Lead the implementation and maintenance of ecosystems such as Trino, AWS Glue, Redshift, Airflow, Kafka and Spark on Kubernetes (K8s).
- Collaborate with engineering, data science and product teams to ensure smooth integration between systems.
- Diagnose and resolve performance, scalability and reliability incidents.
- Apply and promote best practices in data architecture, governance and monitoring.
Requirements
- Strong experience in data infrastructure ecosystems: Trino, AWS Glue, Terraform, CI/CD, Apache Airflow, Kafka and Spark on Kubernetes.
- Proven experience with cloud computing (AWS).
- Advanced proficiency in Python (including PySpark) and object-oriented programming.
- Demonstrated experience with distributed systems, data warehouses and large-scale ETL/ELT pipelines.
- Practical knowledge of data governance, security and storage (e.g., S3, Redshift).
- Analytical problem-solving skills with a focus on operational efficiency.
- Good communication skills and experience working collaboratively.
- Preferred:
- Certifications such as AWS Certified Solutions Architect or similar.
- Familiarity with Trino for ad-hoc analysis.
- Experience with monitoring tools such as Datadog or New Relic.
- Knowledge of AI applied to data, especially RAG (Retrieval-Augmented Generation), for projects involving analysis and intelligent insight generation.
Benefits
- Competitive compensation based on experience;
- Opportunities for career growth and participation in strategic projects;
- Dynamic and challenging work environment;
- Opportunity to work at a rapidly expanding, market-leading company.
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Senior Product Manager defining platform capabilities for Data Cloud in Salesforce. Collaborating with R&D teams while shaping product strategy for Data 360 integration.
Senior Data Engineer at Goodwin enhancing data platforms and fostering data - driven culture across teams. Collaborating with IT and Finance on technology solutions and data governance practices.
Director, Data Platform Design and Strategy at MedImpact leading data platform and AI innovations to enhance healthcare services. Overseeing enterprise projects and managing teams to meet strategic goals.
Data Engineer delivering AI - and data - driven solutions for Honeywell’s industrial customers. Architecting and implementing scalable data pipelines and platforms focused on IoT and real - time data processing.
Data Engineering Associate focusing on data quality control and management for distribution platform. Collaborates on large scale data projects to ensure data accuracy and availability for users.
Data Architect managing enterprise data platform built on Microsoft Fabric at Johnstone Supply. Leading architectural standards and collaborating with business and IT leaders for strategic data - driven insights.
Data Engineer at Studyportals responsible for data pipelines and infrastructure. Join a team ensuring accurate and trustworthy data for analytics and business decisions.
AI/ML Engineer designing and refining prompts and workflows using large language models. Responsible for developing data pipelines and delivering scalable AI solutions in a hybrid work environment.
AWS Data Architect at Fractal designing and operationalizing AWS data solutions at enterprise scale. Collaborating with clients and mentoring engineers in best practices.