Full-Stack Data Engineer responsible for developing robust data solutions at Collinson. Design and maintain data pipelines while collaborating with stakeholders across various technical projects.
Responsibilities
Deliver audit-ready and traceable solutions to support assurance, compliance reviews, and fraud risk monitoring.
Develop and deploy data models that align with diverse business requirements across compliance, audit, fraud detection, and assurance.
Design, develop, and maintain data pipelines for collecting, transforming, and loading data into various data stores.
Build and maintain data warehousing and data lake solutions
Develop and deploy data models that support various business requirements
Write efficient and scalable code in languages such as Python, Scala, or Java
Lead the design of data solutions with quality, automation, and performance in mind
Own the data pipelines feeding into the Data Platform ensuring they are reliable and scalable
Ensure data is available in a fit-for-purpose and timely manner for business and analytics consumption
Work with Data Governance team to ensure solutions are compliant with regulations such as GDPR and CISO policies and data quality is baked-in to pipelines
Collaborate with cross-functional teams to understand data requirements and provide support for data-driven initiatives
Set and embed standards for systems and solutions, and share knowledge to keep the team engaged and skilled in the latest technology
Prototype and adopt new approaches, driving innovation into the solutions
Support alignment of requirements and sources of data from line of business systems and other endpoints
Mentor and guide junior members of the team to help them get up to speed in a short amount of time
Communicate complex solutions in a clear and understandable way to both experts and non-experts.
Stay up-to-date with industry trends and technology advancements in data engineering.
Requirements
Extensive experience leading AWS and cloud data platform transformations
Proven track record of delivering large-scale data and analytical solutions in a cloud environment
Hands-on experience with end-to-end data pipeline implementation on AWS, including data preparation, extraction, transformation & loading, normalization, aggregation, warehousing, data lakes, and data governance
Expertise in developing Data Warehouses
In-depth understanding of modern data architecture such as Data Lake, Data Warehouse, Lakehouse, and Data Mesh
Strong knowledge of data architecture and data modelling practices
Familiarity with CI/CD driven data pipeline and infrastructure
Agile delivery approach using Scrum and Kanban methodologies
Innovative problem-solving skills and ability to provide clear recommendations
Experience managing and leading a small team of data engineers
Strong knowledge of how data drives analytical and reporting activities, including automated marketing and personalization capabilities
Senior Manager leading a team of database engineers to manage CCC's data platform. Overseeing mission - critical applications and collaborating with cross - functional teams in a hybrid environment.
As a Principal Data Architect at Solstice, lead the design and implementation of data architecture solutions. Ensure data integrity, security, and accessibility to meet strategic organizational goals.
Data Platform Specialist overseeing data workflows and enhancing data quality for Stackgini's AI - driven IT solutions. Collaborating with teams to drive improvements and stakeholder support.
Data Engineer designing data pipelines in Python for a major railway industry client. Collaborate with Data Scientists and ensure code quality with agile methodologies.
Senior Data Engineer responsible for building and optimizing data pipelines for banking analytics initiatives. Collaborating with data teams to ensure data quality and readiness for enterprise use.
Senior Data Engineer developing scalable data solutions on Databricks for analytics and operational workloads. Collaborating with cross - functional teams to modernize the data ecosystem.
Data Engineer focused on analytics and data pipeline development for network optimisation. Collaborating with teams to deliver high - quality data solutions with Python and SQL.
Senior Product Manager defining platform capabilities for Data Cloud in Salesforce. Collaborating with R&D teams while shaping product strategy for Data 360 integration.
Senior Data Engineer at Goodwin enhancing data platforms and fostering data - driven culture across teams. Collaborating with IT and Finance on technology solutions and data governance practices.
Director, Data Platform Design and Strategy at MedImpact leading data platform and AI innovations to enhance healthcare services. Overseeing enterprise projects and managing teams to meet strategic goals.