Contract Data Platform Engineer focusing on Spark and ETL at a data services company. Designing scalable systems and collaborating with data scientists and engineers.
Responsibilities
Design and develop scalable, distributed, and resilient software systems.
Build, test, and optimize Spark-based ETL pipelines in Scala or Python.
Collaborate with researchers and data scientists to deliver production-ready data and models.
Participate in architecture discussions, peer reviews, and deployment processes.
Define and monitor technical and operational metrics to ensure system health and performance.
Continuously identify areas for optimization and efficiency improvements across services.
Mentor junior engineers and contribute to engineering best practices.
Drive innovation by staying current with emerging tools and technologies.
Requirements
5+ years of software engineering experience
Strong programming skills in Scala, Python, or Java
Spark experience for building and optimizing ETL jobs
Experience with Databricks (DBX) – workflows, data development, and debugging
Solid understanding of microservices architecture and distributed systems
Experience with AWS, Docker, and Kubernetes
Familiarity with Spring Boot, Terraform, and infrastructure-as-code
Smarsh seeks a Platform Engineer I to design AWS cloud infrastructure for digital communications risk management. Collaborate with teams on infrastructure and customer onboarding efforts.
Software engineer at Uncountable focusing on Generative AI deployment in software. Building AI - powered search tools and developing LLM stack for scientific research.
Lead Platform Engineer at TD Securities, developing a high performing Trading Risk Warehouse platform. Responsible for ensuring stability and scalability, while managing underlying infrastructure and supporting development teams.
Lead Platform Engineer at Capital One driving transformation in technology and solutions with Agile practices and DevOps tools. Collaborating on complex technical problems in a fast - paced environment.
Data Platform Engineer managing daily operations of data platforms for a global cybersecurity company. Collaborating with teams to ensure platform reliability and performance.
Senior Platform Engineer focused on building internal platform capabilities for developer tooling and experience at MONY Group. Collaborating with teams to enhance platform engineering and software delivery.
Databricks Platform Engineer working on AWS ecosystem design, build, and optimization. Responsible for implementing scalable pipeline solutions across data platforms.
Senior Data & Platform Support Engineer supporting Oracle databases at the Federal Reserve Bank. Collaborating with teams to ensure operability of payment systems and enhance business outcomes.