On-Device Machine Learning Engineer optimizing and deploying ML models for consumer hardware. Focused on latency, battery, and user experience with local, edge processing.
Responsibilities
On-device model optimization and deployment
Convert, optimize, and deploy models to run efficiently on-device using Core ML and/or MLX.
Implement quantization strategies (e.g., 8-bit / 4-bit where applicable), compression, pruning, distillation, and other techniques to meet performance targets.
Profile and improve model execution across compute backends (CPU/GPU/Neural Engine where relevant), and reduce memory footprint.
Local RAG + memory systems
Build and optimize local retrieval pipelines (embeddings, indexing, caching, ranking) that work offline and under tight resource constraints.
Implement local memory systems (short/long-term) with careful attention to privacy, durability, and performance.
Collaborate with product/design to translate “memory” behavior into concrete technical architectures and measurable quality targets.
Model lifecycle on consumer hardware
Own the on-device model lifecycle: packaging, versioning, updates, rollback strategies, on-device A/B testing approaches, telemetry, and quality monitoring.
Build robust evaluation and regression suites that reflect real device constraints and user workflows.
Ensure models degrade gracefully (low-power mode, thermals, backgrounding, OS interruptions).
Performance, reliability, and user experience
Treat battery, thermal, and latency as first-class product requirements: instrument, benchmark, and optimize continuously.
Design inference pipelines and scheduling strategies that respect app responsiveness, animations, and UI smoothness.
Partner with platform engineers to integrate ML into production apps with clean APIs and stable runtime behavior.
Requirements
Strong experience shipping ML features into production, ideally including mobile / edge / consumer devices.
Hands-on proficiency with Core ML and/or MLX, and the practical realities of running models locally.
Solid understanding of quantization and optimization techniques for inference (accuracy/perf tradeoffs, calibration, benchmarking).
Experience building or operating retrieval systems (embedding generation, vector search/indexing, caching strategies)—especially under resource constraints.
Fluency in performance engineering: profiling, latency breakdowns, memory analysis, and tuning on real devices.
Strong software engineering fundamentals: maintainable code, testing, CI, and debugging across complex systems.
Nice to Have:
• Experience with on-device LLMs, multimodal models, or real-time interactive ML features.
• Familiarity with Metal / GPU compute, or performance tuning of ML workloads on Apple platforms.
• Experience designing privacy-preserving personalization and memory (local-first data handling, encryption, retention policies).
• Experience building developer tooling for model packaging, benchmarking, and release management.
• Prior work on offline-first architectures, edge inference, or battery/thermal-aware scheduling.
Benefits
Competitive salary and performance-based incentives.
Comprehensive health, dental, and vision benefits package.
401k Match (US-based only)
$200/mos Health and Wellness Stipend
$400/year Continuing Education Credit
$500/year Function Health subscription (US-based only)
Machine Learning Engineer at DentalMonitoring developing and improving ML models for orthodontic treatment solutions. Engage in deep learning and computer vision tasks within a hybrid work environment.
AI/ML Engineer developing advanced solutions for federal client at Niyam IT. Focusing on AI/ML models and operational efficiency improvement in federal environments.
Senior Machine Learning Engineer at Capital Group, designing Generative AI systems to enhance investment processes. Collaborating with professionals to translate ideas into reliable, production - grade systems
Senior AI/ML Engineer designing and deploying AI/ML solutions for validation challenges at Micron. Working on machine learning models and optimization solutions to enhance product quality and validation efficiency.
Machine Learning Engineer focusing on MLOps and software engineering at flaschenpost, ensuring robust planning and operational success through ML products.
AI ML Engineer at global networking leader, shaping ML strategy and building high - performance systems. Innovating with AI technology to enhance network management and develop flagship products.
Senior Staff Machine Learning Engineer leading technical architecture for GEICO's AI Agent Platform. Driving innovation and enhancing productivity for internal associates and customers.
Staff Machine Learning Engineer developing the next generation of AI Agent OS and SDKs for GEICO. Key responsibilities include architecting scalable systems and implementing observability frameworks.
Senior Machine Learning Engineer at Bumble developing scalable AI systems for personalized user interactions. Leading machine learning model development and deployment from exploration to production.
Lead Machine Learning Engineer at Bumble shaping user connections through machine learning. Driving end - to - end AI solutions while mentoring engineers in a hybrid work environment.