Known for being a great place to work and build a career, KPMG provides audit, tax and advisory services for organizations in today's most important industries. Our growth is driven by delivering real results for our clients. It's also enabled by our culture, which encourages individual development, embraces an inclusive environment, rewards innovative excellence and supports our communities. With qualities like those, it's no wonder we're consistently ranked among the best companies to work for by Fortune Magazine, Consulting Magazine, Seramount, Fair360 and others. If you're as passionate about your future as we are, join our team.

KPMG is currently seeking a Technical Product Manager - AI Product Operations to join our Audit Technology Alliance organization.

Responsibilities:

• Act as a "player-coach" managing a team of specialists, while treating the AI monitoring and evaluation infrastructure as an internal product with a defined strategic roadmap
• Treat the AI monitoring and evaluation infrastructure as an internal product; define its strategic roadmap, gather stakeholder requirements, and drive its continuous improvement
• Lead the creation of real-time dashboards to interpret evaluation results, building complex monitors to capture agent traces, human-in-the-loop decisions, and user feedback
• Drive root-cause analysis and cross-functional remediation for AI system issues (including documenting post-mortems), while creating scalable runbooks (SOPs) to streamline deployments
• Partner with product managers and engineering leaders to design and implement evaluators directly into the product lifecycle, leading training efforts on how to accurately interpret and use the results
• Collaborate closely with audit methodology specialists, risk, and compliance teams to ensure all AI evaluation flows, metrics, and guardrails actively support firm audit quality standards
• Act with integrity, professionalism, and personal responsibility to uphold KPMG's respectful and courteous work environment

Qualifications:

• Minimum eight years of recent overall professional experience in Technical Product Management, Product Operations, or Data Science, including a proven track record of building and managing high-performing teams
• Master's degree from an accredited college or university is preferred; minimum of a Bachelor's degree from an accredited or university is required
• Strong technical background with a distinct product management mindset; you don't need to write production code, but you must deeply understand ML/AI concepts to design sophisticated evaluation products
• Extensive knowledge of Generative AI/LLMs, prompt engineering, and GenAI evaluation techniques (for example, automated scoring, human-in-the-loop review, hallucination detection)
• Demonstrated ability to conceptualize scalable measurement frameworks, define critical KPIs, and design structured workflows out of complex, unstructured AI outputs
• Exceptional written and verbal communication skills, with a proven ability to translate highly technical AI performance metrics into clear business narratives for executive stakeholders
• Applicants must be authorized to work in the U.S. without the need for employment-based visa sponsorship now or in the future; KPMG LLP will not sponsor applicants for U.S. work visa status for this opportunity (no sponsorship is available for H-1B, L-1, TN, O-1, E-3, H-1B1, F-1, J-1, OPT, CPT or any other employment-based visa)