Senior Director, AI Architecture
RBC is hiring a Senior Director, AI Architecture in Toronto, Canada. Level rates it ; you can apply on RBC.
Level's read on this job
- Level rates this role Works on AI ●●●○: the daily work is on AI products, without building the model.
- The posting mentions RAG and AI agents among its tools and skills.
- Level classes it as an executive role.
- RBC has 849 other open roles on Level.
- Posted in the last few days.
AI in this role
Job Description
What is the opportunity?
This leader sets one standard way to build, secure and run AI across RBC Technology & Operations. They own the reference architecture for retrieval-augmented generation (RAG), AI agents, model access and AI-native software delivery (AI-DLC). The role turns the 2030 T&O ambitions, including AI-native delivery and 30% of GenAI volume on open-weight models, into patterns teams actually use.
Success means fewer bespoke stacks, faster delivery with maintainable code, and AI that Internal Audit, Model Risk and OSFI can trust.
What will you do?
- AI architecture standards as code. Define the enterprise AI reference architecture and approved patterns. Encode them as harness skills, agent constitutions and automated fitness checks, so standards apply at generation time rather than at review.
- Common RAG substrate. Converge the many RAG solutions onto one shared platform: ingestion, chunking, embeddings, hybrid retrieval, reranking and evaluation. Retrieval must respect source entitlements by default. Set a retirement plan for duplicate stacks.
- Agent sandboxing and security architecture. Design the sandbox standard for every agentic workload: ephemeral environments, egress allow-lists, short-lived task-scoped credentials and no standing production access. Own agent identity, tool access through a governed MCP gateway and registry, and defenses against prompt injection and poisoned tools.
- AI-DLC harness and quality gates. Own the harness architecture from spec to release. Make quality gates deterministic and mandatory: tests and coverage, static analysis, complexity and duplication limits, dependency and license checks, security scanning and architecture fitness checks. Enforce separation of duties (the agent that writes a change cannot approve it), PR size limits and traceability from spec to deployment.
- Skills and evaluation lifecycle. Treat skills like code: owned, versioned, regression-tested with evals and retired when stale. Re-run evals before any model upgrade reaches teams.
- Model gateway and inference architecture. Route work across frontier and open-weight models by cost, risk and jurisdiction. Build in token metering, caching and data-classification rules so cost and residency are enforced by the platform.
- Risk-tiered control model. Partner with Internal Audit, Model Risk and Cyber to define human-oversight tiers, from human-on-the-loop for low-risk work to human-in-the-loop for payments and core banking. Align with OSFI Guidelines E-23 and B-13.
- Design authority and innovation. Chair AI architecture review, keep decision records and manage exceptions. Graduate proven lab work into the platform and evaluate emerging technology, such as agent protocols and new open-weight models.
What do you need to succeed?
- 15+ years in architecture or engineering, including 5+ years leading architects or engineers at enterprise scale.
- Hands-on depth in LLM systems: RAG, agent frameworks, MCP, evaluation and inference serving on cloud and on-premises GPUs.
- Security architecture for AI, including the OWASP Top 10 for LLM applications, sandboxing and identity for non-human actors.
- Strong DevSecOps and SDLC background; you have shipped quality gates engineers accepted rather than routed around.
- Experience in a regulated industry, ideally financial services under OSFI.
- Credibility with engineers: you still prototype and read code. Able to explain trade-offs plainly to executives and audit.
What’s in it for you?
We thrive on the challenge to be our best, progressive thinking to keep growing, and working together to deliver trusted advice to help our clients thrive and communities prosper. We care about each other, reaching our potential, making a difference to our communities, and achieving success that is mutual.
- A comprehensive Total Rewards Program including bonuses and flexible benefits, competitive compensation, commissions, and stock where applicable
- Leaders who support your development through coaching and managing opportunities
- Ability to make a difference and lasting impact
- Work in a dynamic, collaborative, progressive, and high-performing team
- A world-class training program in financial services
- Flexible work/life balance options
- Opportunities to do challenging work
#LI-POST
#TECHPJ
Job Skills
Big Data Management, Data Modeling, Data Science, Decision Making, Deep Learning, Machine Learning (ML), Predictive Analytics, Programming Languages, Relationship BuildingAdditional Job Details
Address:
RBC WATERPARK PLACE, 88 QUEENS QUAY W:TORONTOCity:
TorontoCountry:
CanadaWork hours/week:
37.5Employment Type:
Full timePlatform:
TECHNOLOGY AND OPERATIONSJob Type:
RegularPay Type:
SalariedPosted Date:
2026-10-27Application Deadline:
2026-11-20Note: Applications will be accepted until 11:59 PM on the day prior to the application deadline date above
Our Employment Opportunities
At RBC, we are guided by living shared values of Client First, Integrity, Collaboration, Respect and Excellence and winning together as One RBC. We believe an inclusive workplace that has diverse perspectives is core to our continued growth as one of the largest and most successful banks in the world. Maintaining a workplace where our employees feel supported to perform at their best, effectively collaborate, drive innovation, and grow professionally helps to bring our Purpose to life and create value for our clients and communities. RBC strives to deliver this through policies and programs intended to foster a workplace based on respect, belonging and opportunity for all.
Join our Talent Community
Stay in-the-know about great career opportunities at RBC. Sign up and get customized info on our latest jobs, career tips and Recruitment events that matter to you.
Expand your limits and create a new future together at RBC. Find out how we use our passion and drive to enhance the well-being of our clients and communities at jobs.rbc.com.
RBC is presently inviting candidates to apply for this existing vacancy. Applying to this posting allows you to express your interest in this current career opportunity at RBC. Qualified applicants may be contacted to review their resume in more detail.
How we rate this
Senior Director, AI Architecture at RBC rates 65 out of 100 for how much of the daily work is AI. That makes it Works on AI (AI Level 3 of 4). The level is about AI in the job, not seniority.
Works on AI. The daily work is on AI products, without building the model.
- ●●●● Builds AI80 to 100
- ●●●○ Works on AI60 to 79
- ●●○○ Uses AI40 to 59
- ●○○○ Little AI0 to 39
Levels come from how often the tools, models and workflows of the role are named in the posting itself. Read the description and count the AI tools, models and workflows it names.
Prepare for this job
Built from this posting and from similar jobs on Level.
Skills and AI tools this role asks for
Questions you could be asked
- How would you design a retrieval step so the model answers from real data instead of guessing?
- How do you decide when an AI agent can act on its own versus asking for approval first?
- Describe a typical day in a role like this one: which parts run through AI directly?
- If you removed AI from this role, what would be left, and how do you decide what still needs a human?
Adapt your resume
- List these exact terms on your resume: RAG and AI agents. An applicant tracking system matches the wording, not the idea.
- Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
- Show where AI is part of your daily process, not a one-off project. This role expects it to be a running habit.
Want an expert to read your CV for this job?
Free. Send your CV and the role you want next. We reply by email within 2 to 4 business days.
Get new AI jobs (Works on AI ●●●○ or higher) by email
One email a week with the new AI jobs (Works on AI ●●●○ or higher), each rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.
Free. One email a week. Unsubscribe in one click.
Similar roles
Other roles that work on AI, at other companies.
What kind of AI work fits you?
Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.
Find my next step