Data Engineer transforming data for analysis in an insurance company. Responsible for building data infrastructures and optimizing data delivery.
About the role
- Data Engineer creating scalable data pipelines using technologies like Databricks and Azure for intelligent data solutions. Focused on collaboration with multidisciplinary teams to tackle complex data challenges.
Responsibilities
- Design, develop, and maintain scalable, reliable data pipelines.
- Build data ingestion, transformation, and modeling solutions using Databricks, Spark/PySpark, Cloudera, and Azure Data Factory (ADF).
- Ensure data quality, integrity, and usability across the entire pipeline.
- Design and maintain Data Lake and Data Warehouse solutions, applying data governance best practices.
- Work with concepts and architectures such as Bronze, Silver, and Gold layers, star schema, Delta Tables, Delta Sharing, and analytical tables.
- Collaborate with technical and business teams to orchestrate solutions aligned with company objectives.
Requirements
- Solid experience as a Data Engineer or in a similar role.
- Advanced knowledge of:
- • Cloudera (Hive, Impala, HDFS, etc.)
- • SQL
- • Python / PySpark
- • Azure Databricks (workflows, jobs, Delta Tables, queries, etc.)
- • Azure Data Factory (ADF)
- • ETL/ELT and data pipelines
- • Dimensional data modeling
- • Data Lake / Data Warehouse
- • Data governance and data quality
- Experience with CI/CD practices applied to data environments.
- Strong communication and collaboration skills with multidisciplinary teams.
- Ability to work in dynamic environments and handle loosely defined technical scopes.
- Knowledge of code optimization in cloud environments.
- Advantage: Experience with Teradata.
- Experience with SAS.
Benefits
- Health and dental insurance;
- Meal and grocery vouchers;
- Childcare assistance;
- Extended parental leave;
- Partnerships with gyms and health & wellness professionals via Wellhub (Gympass) and TotalPass;
- Profit-sharing (PLR);
- Life insurance;
- Continuous learning platform (CI&T University);
- Employee discount club;
- Free online platform dedicated to promoting physical and mental health and well-being;
- Prenatal and responsible parenthood course;
- Partnerships with online course platforms;
- Language learning platform;
- And many more
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Senior Data Engineer for the MDM Data Product Team at Avenga. Responsible for provisioning data from master data customer and product systems.
Data Warehouse Modelling Engineer designing and maintaining data models using Data Vault 2.0 for iGaming industry. Collaborating with stakeholders and optimizing data models in a hybrid work environment.
Senior Data Engineer driving impactful data solutions for the climate logistics startup HIVED's core data platform. Collaborating with cross - functional squads to enhance analytics and delivery.
Data Engineer developing and maintaining CRE forecasting infrastructure for Cushman & Wakefield. Collaborates with senior economists and technical teams to ensure high - quality data solutions.
Data Engineer at PwC, engaging with Azure cloud services to enhance data handling and integrity. Responsibilities include pipeline optimizations, documentation, and collaboration with stakeholders.
Data Engineer Manager at PwC focusing on building data infrastructure and solutions. Leading data engineering projects to transform raw data into actionable insights and drive business growth.
Junior Data Engineer at OneMarketData focusing on data quality and integrity in financial datasets. Collaborating with senior analysts and assisting in data management and analysis tasks.
Data Engineer Manager leading robust data solutions for PwC's clients. Transforming raw data into actionable insights and coaching team members.
Senior Data Engineering Analyst developing and implementing data solutions. Collaborating in a diverse environment focused on data processing and analysis for clients' digital transformation.