Senior Data Engineer focusing on data infrastructure for an AI - driven insurtech startup based in Nepal. Collaborating with teams to optimize data models and maintain data quality.
About the role
- Senior Data Engineer developing scalable data pipelines at Enable Data Incorporated. Collaborating with analytics and stakeholders to ensure well-modeled data solutions and maintain data quality.
Responsibilities
- Design, develop, and maintain scalable **data pipelines** using **Apache Spark** (PySpark and/or Scala)
- Build and optimize data workflows on **Databricks**, including Delta Lake, notebooks, and scheduled jobs
- Ingest, transform, and curate large-scale structured and semi-structured datasets
- Perform performance tuning and cost optimization of Spark workloads and Databricks clusters
- Implement data quality checks, monitoring, and error handling
- Collaborate with analytics and business stakeholders to deliver well-modeled, analytics-ready data
- Support batch processing and, where applicable, streaming data pipelines
- Follow best practices for testing, documentation, security, and version control
Requirements
- 5+ years of experience in **Data Engineering** or related roles
- Strong hands-on experience with **Apache Spark** (PySpark or Scala)
- Proven experience working in **Databricks** environments
- Strong SQL skills and experience with relational and analytical databases
- Experience building and maintaining **ETL/ELT pipelines** at scale
- Familiarity with modern data lake architectures (Delta Lake preferred)
- Experience with Git-based version control
- **Must be a U.S. Citizen**
- **Must be currently located in Minnesota (MN), or willing to relocate **
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Senior Professional Consultant leading architecture and design for SAP BW and SAC solutions at Freudenberg. Collaborating with stakeholders and optimizing performance of data landscapes.
Senior Data Engineer designing and managing data architectures to transform large - scale data into insights for Humana. Involves leading technical discussions and implementing best data practices.
ウーブン・バイ・トヨタのデータプラットフォーム実現に情熱を持つエンジニアを募集中。スケーラブルなデータアーキテクチャの設計・実装を担当します。
Data Engineer II at Early Warning Services developing data science tools and infrastructure. Collaborating on software enhancements and mentoring interns in a hybrid work environment.
Senior Data Architect responsible for optimizing data architecture and supporting data - driven business decisions at TruStage. Leading technical guidance for data architecture and cross - functional team collaboration.
Senior Data Architect developing data architecture plans at The Hartford, collaborating with internal teams to align data standards and practices. Leading complex solutions with a focus on operational effectiveness.
Senior Solution Architect defining architecture framework for SA‑CCR in regulatory risk. Collaborating with stakeholders to ensure compliance and efficient data governance.
Senior Data Engineer optimizing and designing data pipelines on AWS for The Rec Hub. Collaborating with the team to enhance data processing and mentorship.
Data Engineer at TeCreation focusing on data analysis and innovative system development in the well - being industry. Collaborating on data integration and business intelligence reporting.