Data Engineer designing data pipelines in Python for a major railway industry client. Collaborate with Data Scientists and ensure code quality with agile methodologies.
About the role
- Senior Data Engineer at Knix designing and maintaining data pipelines and models for analytics. Leading ELT/ETL development and optimizing Snowflake environment for data insights.
Responsibilities
- Design, build, and maintain scalable ELT/ETL pipelines using FiveTran, Airbyte, and custom Python workflows.
- Manage data ingestion and transformation across AWS services such as S3, Lambda, Glue, and Athena.
- Monitor pipeline performance and implement logging, alerting, and troubleshooting processes.
- Administer and optimize Knix’s Snowflake environment including access management, cost efficiency, and query performance.
- Design and maintain scalable data models using both dimensional and normalized approaches.
- Build and maintain reusable transformation logic in DBT to deliver high-quality, analysis-ready datasets.
- Partner with engineering, analytics, and business teams to understand data needs and deliver governed, trustworthy datasets.
- Design and optimize Looker explores, views, and dashboards to support self-serve analytics.
- Apply best practices in data quality, documentation, and data governance.
- Champion data engineering best practices including version control, testing, and peer reviews.
- Support performance tuning and optimization across the data stack.
- Stay current on emerging tools, frameworks, and trends in the modern data ecosystem to drive innovation.
Requirements
- 7+ years of experience in software and/or data engineering, with at least 4 years focused on data engineering or analytics engineering.
- Deep hands-on experience with Snowflake, DBT, FiveTran, and Looker in a production environment.
- Proficiency in Python for data workflows, automation, and orchestration.
- Strong SQL skills and experience designing scalable, performant data models.
- Working knowledge of AWS services including S3, Lambda, Glue, and Athena.
- Familiarity with Airbyte or similar tools for custom ingestion.
- Strong problem-solving skills and the ability to work independently and collaboratively.
- Understanding of data governance, access control, and performance tuning.
Benefits
- Employees feel respected and supported at Knix.
- We take an inclusive and equitable approach offering the same interview experience to every candidate we meet with.
- We know and believe that diverse and inclusive teams empower us to make better decisions and inspire innovation so that we can better serve our customers and community.
- We are committed to providing reasonable accommodations and will work with you to meet your needs.
- We celebrate our inclusive work environment and welcome members of all backgrounds and perspectives to apply.
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Senior Data Engineer responsible for building and optimizing data pipelines for banking analytics initiatives. Collaborating with data teams to ensure data quality and readiness for enterprise use.
Senior Data Engineer developing scalable data solutions on Databricks for analytics and operational workloads. Collaborating with cross - functional teams to modernize the data ecosystem.
Data Engineer focused on analytics and data pipeline development for network optimisation. Collaborating with teams to deliver high - quality data solutions with Python and SQL.
Senior Product Manager defining platform capabilities for Data Cloud in Salesforce. Collaborating with R&D teams while shaping product strategy for Data 360 integration.
Senior Data Engineer at Goodwin enhancing data platforms and fostering data - driven culture across teams. Collaborating with IT and Finance on technology solutions and data governance practices.
Director, Data Platform Design and Strategy at MedImpact leading data platform and AI innovations to enhance healthcare services. Overseeing enterprise projects and managing teams to meet strategic goals.
Data Engineer delivering AI - and data - driven solutions for Honeywell’s industrial customers. Architecting and implementing scalable data pipelines and platforms focused on IoT and real - time data processing.
Data Engineering Associate focusing on data quality control and management for distribution platform. Collaborates on large scale data projects to ensure data accuracy and availability for users.
Data Architect managing enterprise data platform built on Microsoft Fabric at Johnstone Supply. Leading architectural standards and collaborating with business and IT leaders for strategic data - driven insights.