Senior Data Engineer focusing on Databricks in a market-leading company. Designing data architectures and optimizing data workflows in a collaborative environment.
Responsibilities
Design our Databricks architecture and optimize jobs and configurations
Develop scalable data pipelines and orchestrate robust workflows
Build and automate CI/CD pipelines for data workflows in Databricks
Create versioned and reliable data pipelines for Agentic AI and GenAI use cases – including automated data preparation in collaboration with Data Scientists
Develop containerized solutions and collaborate closely with DevOps (Docker, Kubernetes) – including monitoring, self-healing, and infrastructure-as-code
Align with Data Science and business units to ensure a scalable and stable data supply for our Agentic-AI platform
Evaluate new technologies, define best practices, and actively contribute to the evolution of our technical standards
Requirements
Several years of experience in Data Engineering (ideally 3+ years)
Strong hands-on Databricks experience, including workspace administration, Delta Lake, and performance tuning
Solid knowledge of AWS services (e.g., S3, Lambda)
Analytical thinking, strong initiative, and a passion for advancing technology
Experience with infrastructure-as-code, especially Terraform
Nice to have: Experience with streaming (Kafka/Kinesis) and an understanding of Agentic-AI architectures and their data requirements
Senior Data Engineer designing and optimizing data platforms for clients using Microsoft Azure, Microsoft Fabric, Power BI, and Databricks. Working closely with clients to deliver scalable solutions.
Data Engineer providing technical expertise on mission - critical NAVSUP OIS program. Work involves data architecture and database management in AWS GovCloud environments.
Senior Data Engineer focusing on data infrastructure for an AI - driven insurtech startup based in Nepal. Collaborating with teams to optimize data models and maintain data quality.
Senior Professional Consultant leading architecture and design for SAP BW and SAC solutions at Freudenberg. Collaborating with stakeholders and optimizing performance of data landscapes.
Senior Data Engineer designing and managing data architectures to transform large - scale data into insights for Humana. Involves leading technical discussions and implementing best data practices.
Data Engineer II at Early Warning Services developing data science tools and infrastructure. Collaborating on software enhancements and mentoring interns in a hybrid work environment.
Senior Data Architect responsible for optimizing data architecture and supporting data - driven business decisions at TruStage. Leading technical guidance for data architecture and cross - functional team collaboration.
Senior Data Architect developing data architecture plans at The Hartford, collaborating with internal teams to align data standards and practices. Leading complex solutions with a focus on operational effectiveness.
Senior Solution Architect defining architecture framework for SA‑CCR in regulatory risk. Collaborating with stakeholders to ensure compliance and efficient data governance.