AWS Data Engineer designing data models and supporting data architecture for various clients at EXL. Collaborating to deliver data solutions for improved business outcomes in a hybrid work environment.
About the role
- BI Data Engineer II supporting scalable Lakehouse data pipelines at Boston Beer Company. Collaborating with stakeholders to drive data ingestion and maintain enterprise data quality.
Responsibilities
- Serve as a Databricks-first data engineer, designing, building, and supporting scalable Lakehouse data pipelines (ETL/ELT) using Spark and Delta Lake.
- Develop and maintain Databricks notebooks, workflows, and jobs, with secondary support for On-Premise SQL Server integrations.
- Build analytics-ready data models in Databricks, supporting limited dimensional and reporting models on SQL Server as needed.
- Drive data ingestion, migration, and integration between Databricks and On-Premise systems as part of platform modernization.
- Collaborate with analysts, data scientists, business stakeholders, and all teams under the Data Enterprise organization (including Data Operation and MDM) to translate requirements into scalable, maintainable solutions
- Optimize Spark jobs and Databricks workflows for performance, reliability, and cost efficiency.
- Implement enterprise data quality checks, security best practices, and governance standards across Databricks and SQL environments.
- Support production pipelines with CI/CD and automated deployment for reliable, repeatable releases.
Requirements
- Bachelor's Degree in Computer Science, or a closely related field, or the equivalent
- Databricks and Spark: 2–5 years of hands‑on experience with Databricks notebooks, Spark transformations, and Delta Lake for scalable
- Strong Python, Scala, and SQL skills for building and maintaining data pipelines.
- Exposure to automated deployment pipelines using tools such as Azure DevOps and Databricks Asset Bundles (DABs) for reliable, production-ready workflows.
- Understanding of enterprise data quality checks, security practices, and governance frameworks.
- Ability to work effectively with analysts, stakeholders, and cross-functional teams to troubleshoot and optimize pipelines.
Benefits
- Generous healthcare on day one
- Stock purchase plan
- 401k
- Tuition reimbursement
- Fertility/adoption support
- Free financial coaching
- Health & wellness program and discounts
- Professional development & training
- Free beer!
Job title
Job type
Experience level
Salary
Degree requirement
Tech skills
Location requirements
Senior Data Engineer at Noda creating scalable data solutions for smarter, sustainable buildings. Collaborating with teams to optimize data for high - performance analytics.
Leading Technology Consulting as Associate Director at Protiviti, focusing on Microsoft Fabric and Databricks. Strengthening client relationships through analytics and mentoring teams in consulting engagements.
Senior Consultant position at Protiviti mentoring teams on data analytics and engineering solutions using Microsoft technologies, enhancing efficiency and client relationship management.
GCP Data Engineer specializing in data governance, architecture, and quality. Collaborates in a hybrid environment across multiple locations in Mexico.
Data Engineer involved in major data transformation journey, building data products within Data Mesh concept in Stockholm.
Director of Data Engineering leading data architecture and analytics at Petfolk. Overseeing data infrastructure and managing a data team to drive AI and business intelligence solutions.
Senior Data Engineer managing end - to - end data pipelines with Google Cloud Platform. Collaborating closely with product teams to deliver scalable data solutions in a hybrid setting.
GCP Data Engineer designing, building, and optimising data solutions on Google Cloud Platform. Collaborating with clients to solve complex data challenges and enhance AI capabilities.
Data Engineer developing scalable data solutions across multi - cloud environments for clients. Mentoring junior engineers while ensuring data quality and promoting best practices within the team.