AI Quality Assurance Lead ensuring AI compliance and accuracy at Chip. Overseeing quality assurance processes and collaborating across teams in a hybrid work environment.
Responsibilities
Conduct QA reviews of AI interactions, treating AI as a “virtual agent.”
Oversee automated scoring systems that assess accuracy, tone, empathy, and escalation behaviour.
Monitor dashboards and predictive QA tools to identify potential risks or failures in real time.
Lead calibration sessions to align human QA results with automated scoring outputs.
Drive continuous improvement through customer feedback analysis, complaint tracking, and performance reporting.
Ensure AI interactions comply with FCA Principles, Consumer Duty, and complaints handling rules.
Monitor guardrails that ensure AI operates within its agreed principles.
Embed fairness and bias testing into QA processes.
Provide assurance to senior accountable managers and support regulatory reporting.
Deliver monthly AI quality and risk reporting to a Model Governance Committee.
Ensure all AI QA processes are auditable, transparent, and regulator-ready.
Act as the key point of contact for Risk & Compliance, Product and Engineering in relation to AI oversight.
Work closely with Engineering, Product, Customer Support, and Content teams to maintain quality inputs into the AI.
Partner with Risk & Compliance to ensure 2nd line oversight is robust and effective.
Engage with senior leadership to provide insights on AI performance and future improvements.
Requirements
Proven experience in Quality Assurance or Risk/Compliance oversight, ideally in financial services.
Essential to have knowledge of FCA regulatory expectations, including Consumer Duty and Principles for Businesses.
Familiarity with AI concepts (e.g. model drift, hallucination, bias, explainability).
Strong analytical skills with the ability to interpret data and identify actionable insights.
Excellent communication skills, able to bridge operational, technical, and compliance stakeholders.
Comfortable working in a fast-paced environment with emerging technology and regulatory scrutiny.
Benefits
Discretionary Performance-Related Bi-Annual Bonus of up to 10% (Cash) and 5% (Shares) based on your gross annual salary.
Workplace pension scheme - We invest in your future with a workplace pension scheme , contributing 5% on earnings up to £50,000 .
Private medical insurance (medical history disregarded)
Employee Assistance Programme
Cycle to work scheme
Season ticket loan
Free ChipX subscription for UK-based employees
28 days holiday plus bank holidays, plus the days between Christmas and New Year.
Annual training budget for courses, workshops, or conferences to help you advance your career.
£30 per month Chip Fitness Benefit to suit your Mental/Physical Wellbeing.
Supplier Quality Engineer leading Preventive Quality projects and ensuring compliance with AS9145 standards at Boeing. Collaborating with suppliers and internal teams to optimize product deliverables.
Lead Engineer responsible for designing and validating test equipment and programs for power electronics. Collaborating with engineering teams to ensure high - quality product development and testing processes.
Senior Analyst ensuring audit integrity and operational excellence in pricing quality assurance at TForce Freight. Leading team reviews and driving adherence to pricing agreements and policies.
Analyst in Pricing Quality Assurance at TForce Freight maintaining audit integrity and operational accuracy across pricing initiatives. Responsible for conducting audits and providing analysis to support management.
Quality Engineer supporting product development and quality assurance at Evergen. Leading investigations, supporting supplier qualifications, and ensuring compliance with standards.
Senior Quality Engineer ensuring compliance and quality assurance for medical device design and development at Johnson & Johnson in Minnesota. Collaborating with R&D and manufacturing for effective product launches.
Quality Engineer at EDAP TMS supporting the quality management system and continuous improvement initiatives. Collaborating on projects and conducting audits to ensure quality standards are met.
Quality Assurance & Compliance Officer maintaining high standards of documentation and compliance within behavioral health organization. Focused on audit processes and regulatory adherence in Hopewell, Virginia.
Quality Assurance Manager responsible for leadership in Quality Management Systems at a biotech company. Ensuring compliance, scalability, and driving culture of quality improvement.
Compliance Quality Assurance Manager ensuring compliance risk management at TD Bank. Leading independent reviews and providing strategic guidance for compliance structures and processes.