Manager, AI Research
Vanguard is hiring a Manager, AI Research in Toronto, Canada. Level rates it ; you can apply on Vanguard.
Level's read on this job
- On Level's scale, this role is Builds AI ●●●●: the job is building AI systems.
- The posting mentions AI evaluation, AI safety and AI research among its tools and skills.
- Level classes it as a senior role.
- Vanguard has 353 other open roles on Level.
- Posted in the last few days.
AI in this role
Core Responsibilities
- Leads and develops a high-performing team of AI research scientists and technical practitioners. Hires, coaches, evaluates, and develops crew while establishing high standards for technical excellence, collaboration, scientific rigor, and delivery.
- Provides technical leadership across applied AI research initiatives. Guides teams in framing complex problems, evaluating emerging approaches, designing experiments, developing models and prototypes, and determining which approaches warrant further investment or transition toward production.
- Builds strategic research partnerships. Works closely with the Head of AI R&D to support and advance Vanguard’s strategic research partnership with the University of Toronto, collaborating with faculty, researchers, and students to shape joint research initiatives, provide technical leadership, and translate promising academic research into enterprise capabilities. Builds additional internal and external partnerships, where appropriate, to accelerate innovation and bring relevant advances into Vanguard.
- Drives research from exploration to enterprise application. Works with research scientists, engineers, product teams, and business partners to move promising ideas through experimentation, validation, prototyping, technology transfer, and production adoption.
- Maintains technical depth in modern AI and machine learning. Engages directly with researchers on technical approaches, experimental design, model development, evaluation, and engineering trade-offs. Critically evaluates results and helps teams navigate complex technical challenges.
- Identifies and evaluates emerging AI capabilities. Assesses advances in areas such as generative AI, language models, agentic systems, reasoning, multimodal AI, AI evaluation, trustworthy AI, and machine learning to determine their applicability and readiness for Vanguard use cases.
- Establishes rigorous research and evaluation practices. Guides experimental design, benchmarking, model evaluation, reproducibility, and validation to ensure research conclusions are technically sound and capabilities meet appropriate standards before broader adoption.
- Partners with engineering and product teams to accelerate research-to-production. Helps define technical requirements, success criteria, architectural considerations, and transition plans needed to mature research prototypes into scalable enterprise capabilities.
- Balances innovation with practical delivery. Manages a portfolio of research initiatives across different maturity horizons, balancing exploratory work with near-term opportunities that can deliver measurable client, crew, or enterprise value.
- Advances responsible and secure AI development. Ensures research appropriately considers reliability, safety, security, privacy, robustness, explainability, and other responsible AI considerations throughout the research-to-production lifecycle.
- Influences AI strategy and technology decisions. Communicates research findings, emerging technology opportunities, technical risks, and recommendations to senior technical, product, and business leaders and helps inform broader AI investments and priorities.
- Participates in special projects and performs other duties as assigned.
Minimum Qualifications:
- Minimum of 5 years of relevant experience in artificial intelligence, machine learning, computer science, statistics, or a related technical field, including experience developing or leading advanced AI/ML solutions.
- Demonstrated experience leading, mentoring, or managing research scientists, machine learning scientists, research engineers, or similarly technical talent.
- Strong technical expertise in one or more areas of modern AI and machine learning, such as generative AI, language models, agentic AI, reinforcement learning, multimodal AI, model evaluation, trustworthy AI, or AI safety and security.
- Demonstrated ability to move advanced technical work from research and experimentation into prototypes, reusable capabilities, products, or production systems.
- Strong understanding of machine learning research and development practices, including experimental design, model development, evaluation, benchmarking, statistical reasoning, and reproducibility.
- Ability to operate effectively in ambiguous environments, make sound technical decisions, and balance research exploration with practical delivery.
- Demonstrated ability to collaborate across research, engineering, product, business, risk, and other multidisciplinary teams.
- Strong communication skills with the ability to translate complex technical concepts and research findings for both technical and executive audiences.
- Master’s degree in Computer Science, Machine Learning, Statistics, Mathematics, Engineering, or another related quantitative discipline, or equivalent combination of
Preferred Qualifications:
- PhD in Computer Science, Machine Learning, Artificial Intelligence, Statistics, Engineering, or a related field.
- Experience managing or technically leading senior scientists, researchers, or machine learning engineers.
- Track record of research or advanced technical contributions demonstrated through deployed systems, publications, patents, open-source contributions, or other meaningful technical artifacts.
- Experience transitioning AI/ML research into scalable production capabilities.
- Experience partnering with engineering and product organizations on complex AI systems.
- Experience working in financial services or another highly regulated or high-stakes environment.
How We Work
Vanguard has implemented a hybrid working model for the majority of our crew members, designed to capture the benefits of enhanced flexibility while enabling in-person learning, collaboration, and connection. We believe our mission-driven and highly collaborative culture is a critical enabler to support long-term client outcomes and enrich the employee experience.
How we rate this
Manager, AI Research at Vanguard rates 97 out of 100 for how much of the daily work is AI. That makes it Builds AI (AI Level 4 of 4). The level is about AI in the job, not seniority.
Builds AI. The job is building AI systems.
- ●●●● Builds AI80 to 100
- ●●●○ Works on AI60 to 79
- ●●○○ Uses AI40 to 59
- ●○○○ Little AI0 to 39
Levels come from how often the tools, models and workflows of the role are named in the posting itself. Read the description and count the AI tools, models and workflows it names.
Prepare for this job
Built from this posting and from similar jobs on Level.
Skills and AI tools this role asks for
Questions you could be asked
- How do you decide that one model's output is better than another's for a given task?
- How do you think about the risk of an AI system in this kind of role failing silently?
- Tell me about a research question you investigated. What did you find?
- How would you decide a model or AI system is ready to ship?
- Tell me about a time a model underperformed in production. How did you find out, and what did you change?
Adapt your resume
- List these exact terms on your resume: AI Evaluation, AI Safety, and AI Research. An applicant tracking system matches the wording, not the idea.
- Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
- Lead with what you built, trained or shipped. This role is judged on the AI system itself, not the tools around it.
Want an expert to read your CV for this job?
Free. Send your CV and the role you want next. We reply by email within 2 to 4 business days.
Get new research jobs (Builds AI ●●●●) by email
One email a week with the new research jobs (Builds AI ●●●●), each rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.
Free. One email a week. Unsubscribe in one click.
Similar roles
Research roles that build AI, at other companies.
What kind of AI work fits you?
Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.
Find my next step