Data Engineer Tech Lead developing data solutions at Carelon. Leading a cross - functional team to optimize data workflows and maintain data integrity.
About the role
- Senior Data Engineer responsible for designing, building, and deploying data solutions at CI&T. Collaborating on technical engagements and ensuring adherence to security best practices.
Responsibilities
- Contribute to technical engagements and proactively identify opportunities to expand CI&T's business with clients.
- Collaborate on multiple projects across various domains, providing diverse subject matter expertise.
- Participate in technical design and architecture discussions to ensure robust solutions.
- Ensure adherence to security and performance best practices in all solutions.
- Create and maintain technical documentation required by clients.
- Communicate effectively with customer team members to ensure alignment and clarity of technical solutions.
- Understand client requirements and develop viable technical solutions by selecting appropriate frameworks.
- Guarantee a stable and productive development environment for all team members.
Requirements
- 6+ years of experience in the software development area
- Proven expertise in Data Warehousing and Data Analytics projects, encompassing data acquisition, transformation, and data science initiatives.
- Exposure with modern data file formats such as Delta Tables, Apache Iceberg, and Parquet.
- Proficiency in Python, Spark, DBT, and other data transformation tools and frameworks.
- Expertise in data modelling, with familiarity in conceptual, logical, and physical data models, following methodologies like Data Vault 2.0 and Dimensional Modelling.
- Experience with cloud data services such as Microsoft Intelligent Data Platform, AWS Data Services, or Google Cloud Data Analytics.
- Minimum of 3 years experience with Snowflake
- Hands-on experience with cloud data platforms like Databricks and/or Snowflake; certifications.
- Skilled in data pipeline orchestration tools, including Azure Data Factory, AWS Glue, Apache Airflow, or Prefect.
- Experience with CI/CD and MLOps pipelines to streamline development and deployment processes.
- Proficient in Infrastructure as Code (IaC) for efficient infrastructure management.
- Expertise in data migration, performance tuning, and optimization of databases and SQL queries.
- Understanding of Data Governance and Data Management concepts.
- Understanding design patterns, clean architecture, and clean coding principles.
- Familiarity with unit, integration, and E2E testing.
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Lead Data Engineer responsible for evolving Manna’s data infrastructure for drone delivery. Overseeing data architecture and analytics while building scalable data pipelines.
Data Engineer designing, implementing, and optimizing data pipelines for DeepLight AI. Collaborating closely with a multidisciplinary team to analyze large - scale data.
Data Engineer designing and maintaining scalable ETL pipelines at Satori Analytics. Collaborating with teams to deliver high - quality analytics solutions across various industries.
Data Architect responsible for defining enterprise data architecture on AWS and Databricks Lakehouse platforms. Enabling scalable data lakes and enterprise analytics for financial services organizations.
Data Platform Operations Support leading data engineering strategy across projects for EXL. Driving innovation and optimization while collaborating with various teams in the organization.
Manager II leading data engineering projects at Navy Federal Credit Union. Overseeing data governance and quality initiatives while managing engineering teams in a hybrid work environment.
Principal Data Engineer responsible for architecting scalable data pipelines and building high - quality data foundations. Collaborating closely with experts to ensure data readiness for advanced analytics.
Senior Data Engineer building and maintaining data pipelines for cloud and AI solutions at Qodea. Collaborating with ML engineers and focusing on reliability and performance in a cloud - native environment.
Senior Data Engineer at Qodea designing scalable data pipelines and infrastructure. Delivering solutions utilizing cutting - edge tools and collaborating closely with teams for impactful results.