Senior Data Engineer responsible for Cloud Data Lake design and development in financial services. Collaborate with management and technical teams to execute technology product roadmap.
Responsibilities
End to end Cloud Data Lake design & development including data ingestion, data modeling and data distribution
Build data integrations, hand-offs between on-prem/cloud-based systems
Design and develop high volume data ingestion components and solutions to collect data from various sources
Manage and use appropriate tools in the cloud data lake development and deployment
Responsible for developing/implementing cloud infrastructure to support current and future business needs
Participating in technical design, application build, configuration, unit testing, and production deployment
Ensuring all cloud solutions exhibit higher level of cost efficiency, performance, security, scalability, and reliability
Requirements
10+ years' experience in professional software design and development
Bachelor's/Master's Degree in Computer Science, Engineering or Math or equivalent experience
Development experience in designing, developing and deploying complex applications
Strong tech skillset/experience in PL/SQL, Java/J2EE, Python, Scala, PERL/scripting
Hands on experience with Cloud platforms, preferably using Databricks
Strong knowledge of Cloud Security in AWS/Azure, specifically IAM Roles & Polices, Security Groups and Encryption keys
Experience in building systems using modern, scalable, resilient, cloud native architectures
Senior Manager leading a team of database engineers to manage CCC's data platform. Overseeing mission - critical applications and collaborating with cross - functional teams in a hybrid environment.
As a Principal Data Architect at Solstice, lead the design and implementation of data architecture solutions. Ensure data integrity, security, and accessibility to meet strategic organizational goals.
Data Platform Specialist overseeing data workflows and enhancing data quality for Stackgini's AI - driven IT solutions. Collaborating with teams to drive improvements and stakeholder support.
Data Engineer designing data pipelines in Python for a major railway industry client. Collaborate with Data Scientists and ensure code quality with agile methodologies.
Senior Data Engineer responsible for building and optimizing data pipelines for banking analytics initiatives. Collaborating with data teams to ensure data quality and readiness for enterprise use.
Senior Data Engineer developing scalable data solutions on Databricks for analytics and operational workloads. Collaborating with cross - functional teams to modernize the data ecosystem.
Data Engineer focused on analytics and data pipeline development for network optimisation. Collaborating with teams to deliver high - quality data solutions with Python and SQL.
Senior Product Manager defining platform capabilities for Data Cloud in Salesforce. Collaborating with R&D teams while shaping product strategy for Data 360 integration.
Senior Data Engineer at Goodwin enhancing data platforms and fostering data - driven culture across teams. Collaborating with IT and Finance on technology solutions and data governance practices.
Director, Data Platform Design and Strategy at MedImpact leading data platform and AI innovations to enhance healthcare services. Overseeing enterprise projects and managing teams to meet strategic goals.