Data Engineer developing scalable data architectures supporting analytics and ML at Porto Bank. Ensuring quality and efficient data integration while managing risks and standards.
Responsibilities
Develop robust, scalable data architecture that supports data teams (Analytics, BI, Data Science, Machine Learning and other verticals) and business stakeholders, democratizing access to data in a secure, simple, structured and high-quality manner;
Design, build and integrate monitoring and observability mechanisms across the data ecosystem;
Design and build development standards and best practices, and document the environment and deliverables;
Document, monitor and ensure data quality;
Design and enforce best practices for pipeline development, with a focus on performance and scalability;
Ensure a cross-functional view to relate and integrate areas (Data Products and MLOps) and data solutions;
Ensure knowledge sharing across the entire team;
Identify, manage and mitigate risks related to activities under your and your team’s responsibility;
Ensure and implement the data architecture design;
Ensure a correct understanding of business needs and strategic vision;
Ensure that all mapped requirements to be developed are delivered with quality, scalability and on schedule;
Requirements
Bachelor's degree in Engineering, Computer Science or other related fields;
Experience with Azure and/or AWS;
Experience with Databricks;
Experience with Delta Lake / Lakehouse;
Experience with Cosmos DB, Azure Synapse and Analysis Services;
Experience with programming languages Python, SQL and PySpark;
Experience with distributed data processing;
Experience with CI/CD pipelines and/or Azure DevOps;
Senior Data Engineer at Keyrus leading the design, development, and delivery of scalable data platforms. Collaborating with teams to translate requirements into production - grade solutions and mentoring engineers.
Senior Data Engineer for global payments platform designing ETL pipelines and data models. Collaborating across teams to tackle complex data challenges in an innovative fintech environment.
Data Warehouse Modelling Engineer designing and maintaining data models using Data Vault 2.0 for iGaming industry. Collaborating with stakeholders and optimizing data models in a hybrid work environment.
Senior Data Engineer driving impactful data solutions for the climate logistics startup HIVED's core data platform. Collaborating with cross - functional squads to enhance analytics and delivery.
Data Engineer developing and maintaining CRE forecasting infrastructure for Cushman & Wakefield. Collaborates with senior economists and technical teams to ensure high - quality data solutions.
Data Engineer at PwC, engaging with Azure cloud services to enhance data handling and integrity. Responsibilities include pipeline optimizations, documentation, and collaboration with stakeholders.
Data Engineer Manager at PwC focusing on building data infrastructure and solutions. Leading data engineering projects to transform raw data into actionable insights and drive business growth.