Lead Platform Engineer at Capital One driving transformation in technology and solutions with Agile practices and DevOps tools. Collaborating on complex technical problems in a fast - paced environment.
About the role
- Databricks Platform Engineer working on AWS ecosystem design, build, and optimization. Responsible for implementing scalable pipeline solutions across data platforms.
Responsibilities
- Design, deploy, and optimize Databricks workspaces and clusters on AWS to support data science and modeling workloads.
- Manage Fivetran connectors and dbt projects for end-to-end data ingestion, transformation, and orchestration across Databricks, S3, and Snowflake.
- Automate infrastructure provisioning and configuration using Terraform integrated with GitHub Actions.
- Architect and implement high availability (HA) and disaster recovery (DR) strategies, including cross-region replication and failover.
- Implement job orchestration, cluster policies, autoscaling, and CI/CD workflows for notebooks, models, and releases.
- Establish monitoring and alerting for cost, usage, pipeline health, data freshness, and compliance using tools such as Datadog.
- Collaborate with platform segments and security teams to enforce governance, tagging, rightsizing, SLAs, and audit readiness.
- Develop and maintain Unity Catalog for governance, lineage, and secure data sharing across platforms.
- Build and maintain MLflow integrations for model lifecycle management, experimentation tracking, and deployment.
Requirements
- Graduate in Computer Science, Information Technology, or a related field.
- 4-6 years of experience in database administration or data management.
Job title
Job type
Experience level
Salary
Degree requirement
Tech skills
Location requirements
Data Platform Engineer managing daily operations of data platforms for a global cybersecurity company. Collaborating with teams to ensure platform reliability and performance.
Senior Platform Engineer focused on building internal platform capabilities for developer tooling and experience at MONY Group. Collaborating with teams to enhance platform engineering and software delivery.
Power Platform Developer contributing to data management efforts at the company. Working hybrid from Gurugram, Haryana, India.
Senior Platform Engineer supporting Fiserv's Global Kafka Event Streaming Services. Designing, deploying, and managing Kafka and Flink clusters for highly scalable infrastructure.
Senior Data & Platform Support Engineer supporting Oracle databases at the Federal Reserve Bank. Collaborating with teams to ensure operability of payment systems and enhance business outcomes.
IT Project Manager involved in managing diverse projects at Fidelity focusing on architecture and data solutions. Lead delivery teams in technology initiatives enhancing existing systems.
Data Platform Engineer transforming operational data into clean, analysis - ready datasets for Versana's platform. Collaborating within a team to implement data engineering practices and ensuring data quality standards.
Head of Platform Engineering overseeing SaaS platform development for mobility payments in Denmark. Leading a talented team in a hybrid work environment with a focus on infrastructure and support.
Platform Engineer focused on enhancing platform reliability and release automation at Aspire Software. Engaging with both development and operations teams for better integration.