Dados Arquitetos projetando soluções na nuvem com foco em arquiteturas híbridas em São Paulo. Trabalhando com Databricks, Azure e GCP.
Responsibilities
Lead the design, evolution, and standardization of the data architecture (Lakehouse) in a critical enterprise environment, including expansion to hybrid/multi-cloud architectures (Azure + GCP), ensuring scalability, resilience, and high availability.
Ensure adherence to data standards (STG/RAW/TRUSTED/REFINED layers, Delta Lake, business rules), governance (catalog/lineage, data quality), and security (identities, access control, segregation, and data protection).
Serve as the technical reference for supporting the data ecosystem (Databricks, LakeFlow Pipelines/Connect, Jobs/Orchestration, batch/streaming integrations, CDC/replication), supporting troubleshooting, performance tuning, cost optimization, and end-to-end stability.
Support squads and business stakeholders in defining requirements, modeling (conceptual/logical/physical), designing data products, and establishing best practices for consumption (BI, endpoints/APIs, enterprise integrations, Model Serving/Vector Search when applicable).
Be responsible for architectural decisions (ADRs), documentation, technical governance, CI/CD practices (Git), observability/monitoring, and continuous alignment with Infrastructure, Security, Networking, and Cloud teams.
Requirements
Strong experience as a Data Architect / Data Solutions Architect supporting enterprise production environments and integrations with multiple data sources;
Proficiency in Databricks/Spark, Delta Lake, SQL, and Python, with hands-on experience designing pipelines (batch/streaming), performance optimization, partitioning, governance, and reliability.
Experience in cloud data architecture, with a focus on Azure (e.g., ADLS, networking/Private Link, IAM/Entra ID, Secrets/Key Vault, monitoring) and integration with GCP (e.g., BigQuery/GCS and cross-cloud connectivity/security);
Strong communication skills, empathy, organization, and the ability to work with diverse stakeholders;
Hands-on, proactive, collaborative, and results-oriented profile;
Benefits
Bachelor's degree completed or in progress in Computer Science, Engineering, Information Systems, Systems Analysis, or related fields;
Data Engineer developing and maintaining CRE forecasting infrastructure for Cushman & Wakefield. Collaborates with senior economists and technical teams to ensure high - quality data solutions.
Data Engineer at PwC, engaging with Azure cloud services to enhance data handling and integrity. Responsibilities include pipeline optimizations, documentation, and collaboration with stakeholders.
Data Engineer Manager at PwC focusing on building data infrastructure and solutions. Leading data engineering projects to transform raw data into actionable insights and drive business growth.
Junior Data Engineer at OneMarketData focusing on data quality and integrity in financial datasets. Collaborating with senior analysts and assisting in data management and analysis tasks.
Senior Data Engineering Analyst developing and implementing data solutions. Collaborating in a diverse environment focused on data processing and analysis for clients' digital transformation.
Principal Software Engineer in Threat Data Platform developing AI - driven tools for threat intelligence automation. Collaborating on robust data pipelines for PANW’s product ecosystem.
Senior Azure Data Engineer maintaining business intelligence solutions for Grupo Gloria, implementing and stabilizing projects in Azure and Databricks with Power BI reporting.
Staff Data Engineer at URBN developing AI - powered digital experiences by integrating algorithmic solutions with creative tools. Collaborating with cross - functional teams for impactful product evolution.
Senior Data Engineer at Anglian Water responsible for scalable data solutions and team collaboration. Leading design, build, and operation of secure data pipelines for critical services.