As a Principal Data Architect at Solstice, lead the design and implementation of data architecture solutions. Ensure data integrity, security, and accessibility to meet strategic organizational goals.
About the role
- Senior Data Engineer developing scalable data solutions on Databricks for analytics and operational workloads. Collaborating with cross-functional teams to modernize the data ecosystem.
Responsibilities
- Design, build, maintain, and optimize scalable data pipelines and ELT/ETL processes to ingest, process, and store large volumes of data from various sources.
- Architect robust batch and streaming solutions using PySpark, Spark SQL, and Databricks Jobs.
- Monitor and troubleshoot data pipelines and infrastructure to ensure high availability and performance.
- Ensure reliability, observability, and SLAs through monitoring, alerting, and automated recovery patterns.
- Implement and maintain data integration solutions, including APIs and data connectors, to facilitate data exchange between systems.
- Build and manage data solutions on AWS, leveraging services such as S3, Lambda, Glue, IAM, EC2, EKS, Step Functions, and EventBridge.
- Implement and maintain CI/CD pipelines.
Requirements
- 7+ years of data engineering experience building production-grade data pipelines.
- Deep expertise in Databricks , Spark , and Delta Lake .
- Hands-on experience with AWS cloud services.
- Strong proficiency in Python , SQL , and distributed computing patterns.
- Experience with Terraform and cloud-native CI/CD.
- Strong understanding of data modeling, orchestration, and data quality frameworks.
- Ability to operate autonomously while collaborating in a team environment.
Benefits
- Must be authorized to work in the U.S. without the need for employment-based visa sponsorship now or in the future.
- No sponsorship is available for H-1B, L-1, O-1, E-3, H-1B1, F-1, J-1, OPT, CPT or any other employment-based visa.
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
No Education Requirement
Tech skills
Location requirements
Data Platform Specialist overseeing data workflows and enhancing data quality for Stackgini's AI - driven IT solutions. Collaborating with teams to drive improvements and stakeholder support.
Data Engineer designing data pipelines in Python for a major railway industry client. Collaborate with Data Scientists and ensure code quality with agile methodologies.
Senior Data Engineer responsible for building and optimizing data pipelines for banking analytics initiatives. Collaborating with data teams to ensure data quality and readiness for enterprise use.
Data Engineer focused on analytics and data pipeline development for network optimisation. Collaborating with teams to deliver high - quality data solutions with Python and SQL.
Senior Product Manager defining platform capabilities for Data Cloud in Salesforce. Collaborating with R&D teams while shaping product strategy for Data 360 integration.
Senior Data Engineer at Goodwin enhancing data platforms and fostering data - driven culture across teams. Collaborating with IT and Finance on technology solutions and data governance practices.
Director, Data Platform Design and Strategy at MedImpact leading data platform and AI innovations to enhance healthcare services. Overseeing enterprise projects and managing teams to meet strategic goals.
Data Engineer delivering AI - and data - driven solutions for Honeywell’s industrial customers. Architecting and implementing scalable data pipelines and platforms focused on IoT and real - time data processing.
Data Engineering Associate focusing on data quality control and management for distribution platform. Collaborates on large scale data projects to ensure data accuracy and availability for users.