AI Governance Engineer managing technical governance of generative AI tools across the enterprise. Bridging software engineering, security, and compliance for effective AI integration.
Responsibilities
Design, implement, and maintain the technical governance framework for all GenAI/LLM tools and integrations.
Evaluate, approve, onboard, monitor, and retire third-party and open-source AI tools (LLMs, vector databases, agents, orchestration platforms, etc.).
Build and operate usage monitoring, cost tracking, compliance dashboards, and automated audit trails.
Create lightweight, developer-friendly processes for tool requests, risk assessments, exceptions, and approvals.
Partner with Legal, Security, Compliance, Procurement, and Engineering to translate policies into enforceable technical controls.
Identify and mitigate AI-specific risks: prompt injection, data leakage, model misuse, training-data exposure, etc.
Develop and deliver training, playbooks, workshops, and documentation that get used.
Stay ahead of evolving regulations, new attack vectors, and model capabilities.
Continuously optimize the balance between innovation velocity, risk, cost, and compliance.
Requirements
Strong software engineering background with deep understanding of development lifecycles, CI/CD, APIs, integrations, and versioning.
Hands-on knowledge of modern GenAI/ML stack: LLMs, embeddings, vector stores, RAG, model endpoints, agents, and orchestration tools.
Solid experience with at least one major cloud provider (Azure or AWS) – especially AI/ML services, networking, IAM, and governance features.
Proven ability to interpret security, privacy, data-classification, and responsible AI policies and turn them into practical technical controls.
Strong grasp of AI-specific security risks (prompt injection, jailbreaks, data exfiltration, inversion attacks, etc.) and mitigation patterns.
Experience implementing identity & access governance (RBAC/ABAC, least privilege, audit logging) for AI systems.
Demonstrated skill in cross-functional collaboration and communicating complex technical and risk concepts to non-technical stakeholders.
Comfort in building processes, dashboards, and lightweight automation from scratch.
Founding Engineer developing frontend of AI - driven procurement platform at NegotiateAI. Focusing on innovative solutions for procurement and cost management.
Senior Full - Stack Engineer leading technical execution for Digital Menu Board solutions at a global technology company. Leveraging expertise in TypeScript, cloud infrastructure, and mentoring engineers.
Software Engineer developing motion planning software for autonomous vehicles at Waabi. Collaborating with a multidisciplinary team to create innovative solutions for self - driving technologies.
Senior Software Engineer at Waabi developing tools and frameworks for autonomous vehicles. Collaborating with engineers and researchers in AI - driven transportation solutions.
Software Engineer creating next generation multi - sensor rendering software for autonomous driving at Waabi. Collaborating with a team of scientists and engineers to innovate scalable rendering and content creation solutions.
Staff Software Engineer at AngelList defining the architecture of the new GP dashboard and product decisions. Working closely with customers and PMs, focusing on eliminating operational friction using AI.
Senior Software Development Engineer developing analytics and research solutions for investment portfolios. Collaborating with financial professionals in an AI - based engineering team.
Senior Software Engineer developing high - quality SaaS applications for digital investigations. Collaborating with engineering teams to enhance developer experience and product scalability.