Hybrid Director of AI Ethics and Integrity

at Onit

• Job title: Director of AI Ethics and Integrity
• Job type: Full Time
• Experience level: Lead
• Salary: Not specified
• Degree requirement: Postgraduate Degree
• Location requirements: Hybrid, Pune, India

About the role

• Director of AI Ethics and Integrity leading rigorous validation of AI products at Onit. Overseeing adversarial testing and ensuring accuracy, safety, and reliability across product lines.

Responsibilities

• The Director of AI Ethics and Integrity leads Onit's AI red team function, responsible for rigorous validation of all AI-powered products, both legal AI features and general LegalOps automation, before release to customers.
• This role combines AI evaluation methodology with domain expertise to ensure our products meet the highest standards of accuracy, safety, and reliability across all use cases.
• Critically, this position is independent from the model development and product engineering teams, providing objective, adversarial testing that identifies risks before they reach production.
• The successful candidate will lead a team of AI Researchers who stress-test products for hallucinations, reasoning failures, security vulnerabilities, and domain-specific risks including legal accuracy where applicable.

Requirements

• 7+ years of experience in AI/ML evaluation, quality assurance, or product validation
• Experience with AI/ML red teaming, adversarial testing, or systematic evaluation methodology
• Strong understanding of LLM failure modes: hallucination, prompt injection, reasoning errors, and edge case behavior
• Proven ability to design systematic testing protocols and maintain rigorous documentation
• Strong analytical skills with ability to identify edge cases and failure modes across diverse product types
• Excellent communication skills for translating technical risks to business stakeholders
• Experience leading teams in a quality, validation, or research capacity

Benefits

• Health Coverage: Employee and immediate family members.
• Time Away: Flexible paid time off and 10 company paid holidays annually.
• Family Support: Exceptional paid leave for birth parents, non-birth parents, and caregivers. Onit also offers surrogacy and adoption reimbursement.
• Income Protection: 100% employer-paid life and disability insurance.
• Additional Coverage Options: Voluntary benefits including hospital indemnity, critical illness, accident, and even pet insurance.
• Tax-Advantaged Accounts: Flexi, NPS.
• Community Engagement: One paid volunteer day each year to give back to the community.