Seeking a Data Engineer with Palantir expertise, focusing on scalable solutions and data workflows. Join EXL, a leader in data analytics and digital operations.
About the role
- Staff Data Engineer leading scalable data solutions for analytics and reporting at Asurion. Designing data pipelines and ensuring data quality across cloud platforms.
Responsibilities
- Lead the design and development of scalable data pipelines and data products using Databricks, Spark, and Delta Lake
- Develop and optimize data transformations and ELT workflows using SQL and Python
- Design and implement data models and curated datasets to support analytics and reporting use cases
- Ensure data quality, consistency, and reliability through validation, monitoring, and testing practices
- Optimize pipeline performance, scalability, and cost efficiency within AWS environments
- Apply best practices for data partitioning, storage optimization, and query performance tuning
- Collaborate with product, analytics, and business teams to translate requirements into efficient data solutions
- Provide technical leadership and mentorship to engineers, including code reviews and design guidance
- Leverage AI tools for coding, validation, and documentation assistance to enhance productivity and code quality
- Troubleshoot and resolve data pipeline failures, latency issues, and data inconsistencies
- Continuously evaluate and improve data engineering workflows and tooling
Requirements
- 8+ years of experience in data engineering or data pipeline development
- Strong hands-on experience with Databricks, Apache Spark, and Delta Lake
- Advanced proficiency in SQL and Python for building and optimizing data pipelines
- Experience developing robust ETL/ELT pipelines and handling complex data transformations
- Hands-on experience with AWS cloud services (e.g., S3, EMR, Lambda, Glue, Redshift, Kinesis)
- Strong understanding of data modeling and data warehousing concepts
- Experience working with large-scale datasets (TB+ or greater) in distributed environments
- Knowledge of data quality frameworks, validation techniques, and monitoring practices
- Familiarity with CI/CD pipelines and modern development workflows
- Experience using AI-assisted development tools for code generation, validation, or documentation
- Strong problem-solving skills with the ability to debug complex data issues
- Bachelor's degree in Computer Science, Engineering, or related field
Benefits
- Health insurance
- Professional development opportunities
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Internship for Data Engineer position focused on Data & Analytics with a pathway to employment at Logicalis Spain.
Senior Data Engineer at Keyrus leading the design, development, and delivery of scalable data platforms. Collaborating with teams to translate requirements into production - grade solutions and mentoring engineers.
Entry - level Data Engineer in Product Data Group at NGINX. Building scalable data pipelines and collaborating with engineers.
Senior Data Engineer for global payments platform designing ETL pipelines and data models. Collaborating across teams to tackle complex data challenges in an innovative fintech environment.
Data Engineer transforming data for analysis in an insurance company. Responsible for building data infrastructures and optimizing data delivery.
Senior Data Engineer for the MDM Data Product Team at Avenga. Responsible for provisioning data from master data customer and product systems.
Data Warehouse Modelling Engineer designing and maintaining data models using Data Vault 2.0 for iGaming industry. Collaborating with stakeholders and optimizing data models in a hybrid work environment.
Senior Data Engineer driving impactful data solutions for the climate logistics startup HIVED's core data platform. Collaborating with cross - functional squads to enhance analytics and delivery.
Data Engineer developing and maintaining CRE forecasting infrastructure for Cushman & Wakefield. Collaborates with senior economists and technical teams to ensure high - quality data solutions.