Principal Technical Product Manager, Evaluations & Governance
RBC is hiring a Principal Technical Product Manager, Evaluations & Governance in Toronto, Canada. Level rates it ; you can apply on RBC.
Level's read on this job
- Level rates this role Little AI ●○○○: aI is not part of the work.
- Tools and skills the posting cites include OpenAI, Claude and Anthropic.
- Level classifies it as a lead role.
- Level lists 802 other open roles at RBC.
AI in this role
Job Description
What is the opportunity?
Deploying AI at scale in Canada's largest bank is the opportunity of a lifetime. This role focuses on one of the most critical enablers of AI at RBC, connecting deep evaluation of agents' performance and accuracy with the risk-based governance that allows AI to be enabled for safe use.
Own product strategy for the evaluations and governance capabilities that let the bank build and scale agentic AI responsibly — the layer that assesses AI system quality and safety before and after deployment, and turns those assessments into risk and compliance reporting that business leaders across the bank can act on. This is the single accountable product leader for a capability area that sits at the center of how the bank governs its growing AI footprint, partnering closely with engineering leadership, risk, and compliance stakeholders to keep pace with an area that's evolving quickly both technically and regulatorily.
What will you do?
Product Strategy & Roadmap
Own end-to-end product strategy and a multi-year roadmap for the evaluations and governance capability area, prioritized against business risk, regulatory need, and platform adoption
Lead discovery and requirements definition, translating input from engineering, risk, compliance, and business stakeholders into clear product requirements
Own portfolio-level prioritization and sequencing across the capability area's roadmap, balancing near-term regulatory/compliance needs against longer-term platform investment
Evaluate build-vs-buy-vs-partner options for evaluation and governance tooling, weighing internal investment against third-party solutions
Delivery Partnership
Partner with engineering and architecture leadership on feasibility, sequencing, and trade-offs, converging on a plan both sides can commit to
Work with the project-management function to convert prioritized requirements into a funded, scheduled program of work
Stay engaged through delivery, resolving product-scope questions and re-planning trade-offs as they arise
Stakeholder & Business Engagement
Represent the capability area to risk, audit, and compliance stakeholders across the bank's business lines
Serve as the primary product voice to senior leadership on the health and trajectory of the capability area
Represent product considerations within architecture reviews, governance forums, and vendor evaluations
Partner with adjacent product and engineering leaders across the platform so requirements are considered early, not retrofitted later
Launch & Value Input
Help define value messaging and target user personas for the capability area's launches, in partnership with your peer Principal for go-to-market
Define and track success metrics for the capability area and use them to inform ongoing prioritization
Contribute the capability area's inputs into the broader business case articulating value delivered
People Leadership
Build, mentor, and lead a team of product managers focused on evaluations and governance, giving them ownership of their individual areas
Help your team apply consistent discovery, prioritization, and delivery practices as they build out their own areas
Foster a culture of iterative delivery, understanding of user needs, and decision-making backed by data
What do you need to succeed?
Must-have:
10+ years of product management experience, including several years focused on risk, compliance, safety, or governance-oriented technology products or services
Demonstrated experience delivering production AI/ML systems in an enterprise environment, including hands-on experience with LLM API integration (e.g., Anthropic Claude, OpenAI, Azure OpenAI, or equivalent) and direct ownership of how those systems are tested, evaluated, or monitored for quality and risk
Experience operating in a regulated industry (e.g., financial services, healthcare, government) with direct exposure to audit and regulatory review processes
Strong technical foundation — able to engage credibly with engineers and architects on system design, API integration patterns (authentication, rate limiting, observability), data pipelines, and vector database/retrieval-augmented generation (RAG) architecture as it relates to evaluating AI system outputs
Excellent communication skills, with proven ability to represent a complex technical and risk-related agenda credibly to both senior executives and engineering teams
University degree in a technical field (Computer Science, Engineering, or related), or equivalent experience
Nice-to-have:
Experience leading and developing other product managers, or a track record of stepping into a people-leadership role from an individual-contributor/lead-level product position
Demonstrated experience building products that convert regulatory or audit requirements into automated processes or tooling
Experience defining shared interfaces or working agreements between two or more engineering teams building interdependent systems
Prior experience specifically with AI safety, model risk management, or automated evaluation of AI/ML systems, rather than general software QA/compliance
Experience with observability or monitoring platforms for distributed or ML-based systems
Familiarity with AI-specific financial-services regulatory and risk-management frameworks (e.g., OSFI Guideline E-23, NIST AI RMF, SR 26-2, ISO/IEC 42001) — familiarity with the direction these are heading is more relevant than hands-on implementation experience, since several (e.g., OSFI E-23) are not yet in force Experience standing up a net-new function inside a scaling organization, rather than in a steady-state team
What's in it for you?
We thrive on the challenge to be our best, progressive thinking to keep growing, and working together to deliver trusted advice to help our clients thrive and communities prosper. We care about each other, reaching our potential, making a difference to our communities, and achieving success that is mutual.
A comprehensive Total Rewards Program including bonuses and flexible benefits, competitive compensation, commissions, and stock where applicable
Leaders who support your development through coaching and managing opportunities
Ability to make a difference and lasting impact
Work in a dynamic, collaborative, progressive, and high-performing team
A world-class training program in financial services
Flexible work/life balance options
Opportunities to do challenging work
About the AI Group
RBC's AI Group is the AI accelerator for RBC, with a focus on driving the shift from early-stage AI projects to scaled, client outcomes that amplify the impact of RBC's people. In addition to helping scale the biggest AI opportunities at RBC, the AI Group is responsible for advancing research into emerging use cases across generative and agentic AI, while maintaining expertise in security, responsible AI and regulatory expectations.
Inclusion and Equal Opportunity Employment
RBC is an equal opportunity employer committed to diversity and inclusion. We are pleased to consider all qualified applicants for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, protected veterans status, Aboriginal/Native American status or any other legally-protected factors. Disability-related accommodations during the application process are available upon request.
#LI-Post
#TechPJ
Job Skills
Communication, Critical Thinking, Effectiveness Measurement, Financial Regulation, Interpersonal Relationship Management, Long Term Planning, Product Development Lifecycle, Product Development Methodology, Product Services, Results-Oriented, Waterfall ModelAdditional Job Details
Address:
RBC WATERPARK PLACE, 88 QUEENS QUAY W:TORONTOCity:
TorontoCountry:
CanadaWork hours/week:
37.5Employment Type:
Full timePlatform:
Job Type:
RegularPay Type:
SalariedPosted Date:
2026-09-08Application Deadline:
2026-11-30Note: Applications will be accepted until 11:59 PM on the day prior to the application deadline date above
Our Employment Opportunities
At RBC, we are guided by living shared values of Client First, Integrity, Collaboration, Respect and Excellence and winning together as One RBC. We believe an inclusive workplace that has diverse perspectives is core to our continued growth as one of the largest and most successful banks in the world. Maintaining a workplace where our employees feel supported to perform at their best, effectively collaborate, drive innovation, and grow professionally helps to bring our Purpose to life and create value for our clients and communities. RBC strives to deliver this through policies and programs intended to foster a workplace based on respect, belonging and opportunity for all.
Join our Talent Community
Stay in-the-know about great career opportunities at RBC. Sign up and get customized info on our latest jobs, career tips and Recruitment events that matter to you.
Expand your limits and create a new future together at RBC. Find out how we use our passion and drive to enhance the well-being of our clients and communities at jobs.rbc.com.
RBC is presently inviting candidates to apply for this existing vacancy. Applying to this posting allows you to express your interest in this current career opportunity at RBC. Qualified applicants may be contacted to review their resume in more detail.
How we rate this
Principal Technical Product Manager, Evaluations & Governance at RBC rates 18 out of 100 for how much of the daily work is AI. That makes it Little AI (AI Level 1 of 4). The level is about AI in the job, not seniority.
Little AI. AI is not part of the work.
- ●●●● Builds AI80 to 100
- ●●●○ Works on AI60 to 79
- ●●○○ Uses AI40 to 59
- ●○○○ Little AI0 to 39
Levels come from how often the tools, models and workflows of the role are named in the posting itself. Read the description and count the AI tools, models and workflows it names.
Prepare for this job
Built from this posting and from similar jobs on Level.
Skills and AI tools this role asks for
Questions you could be asked
- How would you design a retrieval step so the model answers from real data instead of guessing?
- How do you think about the risk of an AI system in this kind of role failing silently?
- What are the limits of OpenAI that you've run into, and how did you work around them?
- What's a project where you used Claude hands-on?
- Walk me through how you've used Anthropic in your day-to-day work.
Adapt your resume
- List these exact terms on your resume: RAG, AI Safety, OpenAI, Claude, and Anthropic. An applicant tracking system matches the wording, not the idea.
- Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
Get your CV reviewed before you apply
Send your CV and the role you want next. Your review arrives by email within 3 days.
Get new product jobs by email
One email a week, each job rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.
Free.
Similar roles
Product roles that involve little AI, at other companies.
What kind of AI work fits you?
Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.
Find my next step