Senior Data Engineer in Porto Bank developing and managing scalable data architectures and systems. Focused on integrating diverse data solutions while identifying and managing risks.
Responsibilities
Develop a robust, scalable Data Architecture to support data teams (Analytics, BI, Data Science, Machine Learning and other verticals) and business stakeholders, democratizing access to data in a secure, simple, structured and high-quality manner;
Design, build, and integrate monitoring mechanisms to track the health and performance of the data ecosystem;
Design and implement development standards and best practices, and document the environment and deliverables;
Document, monitor and ensure data quality;
Design and enforce best practices for pipeline development, with a focus on performance and scalability;
Ensure and maintain a cross-functional view to relate and integrate areas (Data Products and MLOps) and data solutions;
Ensure knowledge is shared across the team;
Identify, manage and mitigate risks related to activities under your and the team's responsibility;
Ensure and implement the designed data architecture;
Ensure accurate understanding of business needs and strategic vision;
Ensure that all mapped requirements to be developed are delivered with quality, scalability and on schedule.
Requirements
Bachelor's degree in Engineering, Computer Science, or a related field;
Experience with Azure and/or AWS;
Experience with Databricks;
Experience with Delta Lake / Lakehouse architectures;
Experience with Cosmos DB, Azure Synapse and Analysis Services;
Experience with Python, SQL and PySpark;
Experience with distributed data processing;
Experience with continuous integration and continuous delivery (CI/CD) pipelines and/or Azure DevOps;
Data Engineer designing, implementing, and optimizing data pipelines for DeepLight AI. Collaborating closely with a multidisciplinary team to analyze large - scale data.
Data Engineer designing and maintaining scalable ETL pipelines at Satori Analytics. Collaborating with teams to deliver high - quality analytics solutions across various industries.
Data Architect responsible for defining enterprise data architecture on AWS and Databricks Lakehouse platforms. Enabling scalable data lakes and enterprise analytics for financial services organizations.
Data Platform Operations Support leading data engineering strategy across projects for EXL. Driving innovation and optimization while collaborating with various teams in the organization.
Manager II leading data engineering projects at Navy Federal Credit Union. Overseeing data governance and quality initiatives while managing engineering teams in a hybrid work environment.
Senior Data Engineer building and maintaining data pipelines for cloud and AI solutions at Qodea. Collaborating with ML engineers and focusing on reliability and performance in a cloud - native environment.
Principal Data Engineer responsible for architecting scalable data pipelines and building high - quality data foundations. Collaborating closely with experts to ensure data readiness for advanced analytics.
Senior Data Engineer at Qodea designing scalable data pipelines and infrastructure. Delivering solutions utilizing cutting - edge tools and collaborating closely with teams for impactful results.
Senior Data Engineer designing and maintaining data pipelines for Qodea's global technology solutions. Collaborating with teams to ensure data quality and governance across platforms.
Product Director managing Target's Customer Data Platform. Leading strategy, financials, and team development to enhance guest experience through data - driven initiatives.