Data Engineer building and maintaining ETL pipelines for Northstrat's agile development team. Collaborating in a fast - paced environment with a focus on high - quality solutions.
About the role
- Senior Data Engineer at Cifas focusing on data pipeline design and management using Microsoft Fabric tools. Collaborating with teams to ensure data integrity and analytics performance.
Responsibilities
- Maintaining, monitoring and managing the Cifas data analytics environment, leveraging Microsoft Fabric tools to build and manage data ecosystems, ensuring scalability and performance optimisation.
- Designing and implementing scalable data pipelines using Microsoft Fabric components such as Data Factory, Lakehouse, and Data Warehouse.
- Developing and optimising complex queries for data extraction, transformation, and loading (ETL) processes.
- Collaborating with cross-functional teams and external providers to understand data requirements and deliver solutions that meet business needs.
- Ensuring data quality and integrity through rigorous testing and validation procedures.
- Monitoring and troubleshooting data workflows, ensuring high availability and performance.
- Ensuring data pipelines are available and optimised for the application of data science and AI tools
- Implementing data governance and security measures in compliance with industry standards.
- Documenting data workflows, system architectures, and integration processes to ensure transparency and knowledge sharing across teams.
- Providing technical support and training where necessary to ensure effective use of data platforms and tools.
Requirements
- A degree in Computer Science, Information Systems, or a related field.
- Proven experience in data engineering with a focus on SQL and Microsoft Fabric and its components.
- Proficiency in programming languages like Python, SQL, and Scala for data manipulation and pipeline development.
- Hands-on experience with Microsoft Fabric tools, including Data Factory, Lakehouse, and Data Warehouse.
- Familiarity with cloud platforms such as Azure, AWS, or GCP.
- Understanding of data modelling techniques and best practices.
- Knowledge of data visualization tools like Power BI or Tableau.
- Certifications in Microsoft Azure or related technologies.
- Familiarity with big data technologies and frameworks.
- Experience of working with data science and AI tools in Microsoft Fabric
- Ability to diagnose and resolve issues within data pipelines and systems.
- Capacity to design scalable and efficient solutions for complex data challenges.
- Strong written and verbal communication skills to liaise with technical and non-technical stakeholders effectively.
Benefits
- Remote working with approximately 2 days a month in the London office.
- Generous annual leave allowance plus the bank holidays
- Private healthcare
- Excellent pension package through salary sacrifice
- Personal and professional growth
- Employee wellbeing services – Wellbeing hub access with resources to various online exercise content, meditation guides, sleep stories and yoga.
Job title
Job type
Experience level
Salary
Degree requirement
Tech skills
Location requirements
Data Engineering Lead at BlackStone eIT managing a team and driving data solutions aligned with strategic goals. Collaborating with departments to ensure effective data management.
Data engineer designing custom data architectures at Zenika. Developing and maintaining data transformation pipelines, optimizing performance, and collaborating with cross - functional teams.
Senior Data Engineer responsible for AspenTech IP.21 implementation, leading a team for industrial data solutions.
Senior Data Engineer responsible for implementing and optimizing industrial data infrastructure at AG Solution. Leading a team and collaborating with various stakeholders to ensure data quality and reporting.
Lead Data Engineer designing scalable data architecture on Google Cloud Platform for infas 360. Collaborating with cross - functional teams to develop tailored data products in Bonn.
Data Engineer developing data platforms for Octopus Electric Vehicles. Build and optimise data solutions to transform insights for sustainable transportation.
Senior Data Engineer developing and maintaining data pipelines and solutions for EMC's data analytics products. Collaborating with cross - functional teams to ensure high - quality data management and governance practices.
Principal Product Manager leading product strategy for health data platform at PointClickCare. Collaborating across teams to optimize health data for analytics and care delivery.
Senior Data Engineer designing and optimizing data platforms for clients using Microsoft Azure, Microsoft Fabric, Power BI, and Databricks. Working closely with clients to deliver scalable solutions.