Senior Staff Machine Learning Engineer leading technical architecture for GEICO's AI Agent Platform. Driving innovation and enhancing productivity for internal associates and customers.
About the role
- Senior ML Platform Engineer responsible for designing scalable machine learning infrastructure at GEICO. Collaborating across teams to enhance ML operations and LLM deployment effectiveness.
Responsibilities
- Design and implement scalable infrastructure for training, fine-tuning, and serving open source LLMs (Llama, Mistral, Gemma, etc.)
- Architect and manage Kubernetes clusters for ML workloads, including GPU scheduling, autoscaling, and resource optimization
- Design, implement, and maintain feature stores for ML model training and inference pipelines
- Build and optimize LLM inference systems using frameworks like vLLM, TensorRT-LLM, and custom serving solutions
- Ensure 99.9%+ uptime for ML platforms through robust monitoring, alerting, and incident response procedures
- Design and implement ML platforms using DataRobot, Azure Machine Learning, Azure Kubernetes Service (AKS), and Azure Container Instances
- Develop and maintain infrastructure using Terraform, ARM templates, and Azure DevOps
- Implement cost-effective solutions for GPU compute, storage, and networking across Azure regions
- Ensure ML platforms meet enterprise security standards and regulatory compliance requirements
- Evaluate and potentially implement hybrid cloud solutions with AWS/GCP as backup or specialized use cases
- Design and maintain robust CI/CD pipelines for ML model deployment using Azure DevOps, GitHub Actions, and MLOps tools
- Implement automated model training, validation, deployment, and monitoring workflows
- Set up comprehensive observability using Prometheus, Grafana, Azure Monitor, and custom dashboards
- Continuously optimize platform performance, reducing latency and improving throughput for ML workloads
- Design and implement backup, recovery, and business continuity plans for ML platforms
- Mentor junior engineers and data scientists on platform best practices, infrastructure design, and ML operations
- Lead comprehensive code reviews focusing on scalability, reliability, security, and maintainability
- Design and deliver technical onboarding programs for new team members joining the ML platform team
- Establish and champion engineering standards for ML infrastructure, deployment practices, and operational procedures
- Create technical documentation, runbooks, and deliver internal training sessions on platform capabilities
- Work closely with data scientists to understand requirements and optimize workflows for model development and deployment
- Collaborate with product engineering teams to integrate ML capabilities into customer-facing applications
- Support research teams with infrastructure for experimenting with cutting-edge LLM techniques and architectures
- Present technical solutions and platform roadmaps to leadership and cross-functional stakeholders.
Requirements
- Bachelor’s degree in computer science, Engineering, or related technical field (or equivalent experience)
- 3+ years of software engineering experience with focus on infrastructure, platform engineering, or MLOps
- 2+ years of hands-on experience with machine learning infrastructure and deployment at scale a plus if you have experience working with Large Language Models and transformer architectures
- Proficient in Python; strong skills in Go, Rust, or Java preferred
- Proven experience working with open source LLMs (Llama 2/3, Qwen, Mistral, Gemma, Code Llama, etc.)
- Proficient in Kubernetes including custom operators, helm charts, and GPU scheduling
- Deep expertise in Azure services (AKS, Azure ML, Container Registry, Storage, Networking)
- Experience implementing and operating feature stores (Chronon, Feast, Tecton, Azure ML Feature Store, or custom solutions)
- Hands-on experience with inference optimization using vLLM, TensorRT-LLM, Triton Inference Server, or similar
- Advanced experience with Azure DevOps, GitHub Actions, Jenkins, or similar CI/CD platforms
- Proficiency with Terraform, ARM templates, Pulumi, or CloudFormation
- Deep understanding of Docker, container optimization, and multi-stage builds
- Experience with Prometheus, Grafana, ELK stack, Azure Monitor, and distributed tracing
- Knowledge of both SQL and NoSQL databases, data warehousing, and vector databases.
Benefits
- Comprehensive Total Rewards program that offers personalized coverage tailor-made for you and your family’s overall well-being.
- Financial benefits including market-competitive compensation; a 401K savings plan vested from day one that offers a 6% match; performance and recognition-based incentives; and tuition assistance.
- Access to additional benefits like mental healthcare as well as fertility and adoption assistance.
- Supports flexibility- We provide workplace flexibility as well as our GEICO Flex program, which offers the ability to work from anywhere in the US for up to four weeks per year.
Job title
Job type
Experience level
Salary
Degree requirement
Tech skills
Location requirements
Staff Machine Learning Engineer developing the next generation of AI Agent OS and SDKs for GEICO. Key responsibilities include architecting scalable systems and implementing observability frameworks.
Senior Machine Learning Engineer at Bumble developing scalable AI systems for personalized user interactions. Leading machine learning model development and deployment from exploration to production.
Lead Machine Learning Engineer at Bumble shaping user connections through machine learning. Driving end - to - end AI solutions while mentoring engineers in a hybrid work environment.
Designing and operating cloud - based MLOps capabilities supporting analytical and generative AI models. Collaborating with data science and business teams for high - impact AI solutions.
Machine Learning Engineer analyzing data structures and developing ML models for customer profiling in Azerbaijan. Collaborating on probabilistic modeling and data quality improvement.
Machine Learning Engineer at HackerRank working on integrity systems to improve model quality. Collaborating on strategies for new signals like audio analysis and behavioral anomalies.
Machine Learning Engineer developing integrity systems for assessing model quality at HackerRank. Collaborating on multimodal signal processing and improving model performance.
Architect designing enterprise - grade AI/ML architectures for Quantiphi. Leading AI applications and ML strategy with a focus on scalability, security, and integration.
Software Engineer for ML Infrastructure at Slack, architecting systems to support large scale AI deployment and reliability. Engage in deep systems engineering focusing on ML lifecycle and infrastructure scalability.