Staff Machine Learning Engineer, Generative AI (Auth0)

Okta is hiring a Staff Machine Learning Engineer, Generative AI (Auth0) in Toronto, Canada. It pays CAD 168k-CAD 231k a year and Level rates it ; you can apply on Okta.

Level's read on this job

Level rates this machine learning engineer role Builds AI ●●●●: the job is building AI systems.
The posting mentions OpenAI, Claude and Anthropic among its tools and skills.
Level classes it as a lead role.
Okta has 389 other open roles on Level.

AI in this role

Architect and deploy scalable Generative AI and machine learning systems, LLM-powered features, and production pipelines.

openaiclaudeanthropiclangchainllamaindexlanggraphbedrockpytorchtensorflowllmsllmops

ragai-agentsfine-tuningmachine-learninggenerative-aisystem-architecturepythonscalability

Secure Every Identity, from AI to Human

Identity is the key to unlocking the potential of AI. Okta secures AI by building the trusted, neutral infrastructure that enables organizations to safely embrace this new era. This work requires a relentless drive to solve complex challenges with real-world stakes. We are looking for builders and owners who operate with speed and urgency and execute with excellence.

This is an opportunity to do career-defining work. We're all in on this mission. If you are too, let's talk.

The Team:

Have you ever considered what powers the intelligent features behind seamless product experiences? The GenAI team is at the forefront of enabling AI-powered security and intelligent innovation across our organization. From crafting AI powered security services, to intuitive generative AI-powered chat experiences that provide instant product support, and developing the best developer experience around authentication for generative AI and AI agents, our team is instrumental in bringing the transformative power of AI to life. We collaborate closely with the Machine Learning team and various product teams to ensure the seamless and secure delivery of AI-enhanced features that provide real value to our users.

The Opportunity:

As a Staff Machine Learning Engineer on the Generative AI team, you will help shape, architect, and accelerate our Generative AI strategy by contributing across the stack of model development, infrastructure, and platform services. You’ll drive design and implementation of production-ready AI/ML systems at scale: ranging from LLM-powered features to reusable components that other teams across Okta can build on.

You will have the opportunity to:

Architect, design, and deploy robust Machine Learning & GenAI systems, ensuring seamless integration with diverse platform services and establishing scalable LLMOps pipelines in production.
Drive technical decision making while striving to hit the right balance between factors such as simplicity, flexibility, reliability, and performance.
Lead initiatives to tune, optimize, and deploy agentic applications in production with a focus on performance, reliability, and security.
Partner with Product, Security, and Platform Engineering teams to design AI-powered experiences that are both innovative and trustworthy.
Design and implement scalable infrastructure and platform services for large-scale Generative AI use cases.
Collaborate cross-functionally with product managers, researchers, and engineers to deliver secure, high-quality, and scalable AI/ML systems.

What you will do:

Spearhead the design of scalable, observable ML and Generative AI systems that integrate retrieval, inference, and evaluation pipelines.
Develop and iterate on structured prompting, context retrieval, and RAG workflows that improve accuracy, safety, and cost efficiency in Claude-based systems.
Build and refine automated evaluation pipelines to measure model quality, correctness, groundedness, and safety in production.
Implement schema validation, structured output enforcement, and other guardrails that keep AI outputs reliable, auditable, and compliant with enterprise standards.
Mentor and coach engineers, contributing to the growth of the team and the larger engineering community.

What you bring:

7+ years of software development experience, with strong programming expertise in Python (and familiarity with Go or Typescript a plus).
Hands-on experience with applied machine learning, from feature engineering to training and fine-tuning models.
Hands-on experience with modern Generative AI platforms (AWS Bedrock, OpenAI, Anthropic, etc.).
Deep understanding of retrieval-augmented generation (RAG), embeddings, and knowledge-base workflows.
Hands-on experience with LiteLLM, LangGraph, LangChain, LlamaIndex, MCP, or other related AI agent frameworks.
Familiarity with ML frameworks (FastAPI, PyTorch, TensorFlow, Spark ML) and workflow orchestration tools (Airflow, etc.).
Experience defining evaluation metrics, pipelines, and feedback loops for ML/GenAI systems.
Proven ability to collaborate with product and engineering teams to drive greenfield initiatives forward, navigate unknowns, and iterate quickly and frequently.
Experience building tools or infrastructure for AI/ML applications, with a deep understanding of the developer lifecycle in an AI-native world.

Nice to haves:

Experience integrating AI-driven systems with identity, authentication, or security products.
Exposure to ethical AI, model risk, or compliance frameworks.
Familiarity with evaluation datasets, synthetic data generation, or LLM-as-a-judge methods.

Please note that we encourage candidates to apply even if you do not have experience with all of the criteria or technologies listed above; these are provided to give insight into the tech stack and general responsibilities for the role.

#LI-HYBRID

#LI-SH1
P-2652_3522731

Below is the annual salary range for candidates located in Canada. Your actual salary will depend on factors such as your skills, qualifications, and experience. In addition, Okta offers equity (where applicable), bonus, and benefits, including health, dental, and vision insurance, RRSP with a match, healthcare spending, telemedicine, and paid leave (including PTO and parental leave) in accordance with our applicable plans and policies. To learn more about our Total Rewards program, please visit: https://rewards.okta.com/can.

The annual base salary range for this position for candidates located in Canada is between:$168,000—$231,000 CAD

The Okta Experience

We are intentional about connection. Our global community, spanning over 20 offices worldwide, is united by a drive to innovate. Your journey begins with an immersive, in-person onboarding experience designed to accelerate your impact and connect you to our mission and team from day one.

Okta is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, ancestry, marital status, age, physical or mental disability, or status as a protected veteran. We also consider for employment qualified applicants with arrest and convictions records, consistent with applicable laws.

If reasonable accommodation is needed to complete any part of the job application, interview process, or onboarding please use this Form to request an accommodation.

Notice for New York City Applicants & Employees: Okta may use Automated Employment Decision Tools (AEDT), as defined by New York City Local Law 144, that use artificial intelligence, machine learning, or other automated processes to assist in our recruitment and hiring process. In accordance with NYC Local Law 144, if you are an applicant or employee residing in New York City, please click here to view our full NYC AEDT Notice.

How we rate this

Staff Machine Learning Engineer, Generative AI (Auth0) at Okta rates 90 out of 100 for how much of the daily work is AI. That makes it Builds AI (AI Level 4 of 4). The level is about AI in the job, not seniority.

Classification

Builds AI. The job is building AI systems.

●●●● Builds AI80 to 100
●●●○ Works on AI60 to 79
●●○○ Uses AI40 to 59
●○○○ Little AI0 to 39

Levels come from how often the tools, models and workflows of the role are named in the posting itself. Read the description and count the AI tools, models and workflows it names.

Key facts

Staff Machine Learning Engineer, Generative AI (Auth0) is an open job at Okta.
Level rates this role AI Level 4 of 4: Builds AI.
The listed salary is CAD 168k-CAD 231k a year.
The role is based in Toronto, Ontario, Canada.
The job was posted on August 18, 2026.
Seniority: lead.
Applications are handled by Okta. Apply on Okta

Prepare for this job

Built from this posting and from similar jobs on Level.

Skills and AI tools this role asks for

RAGAI agentsFine-tuningMachine learningGenerative AISystem ArchitecturePythonScalability

Also common in machine learning engineer jobs at this level

Deep learning C++Kubernetes MLOps Google Cloud Azure

Pay

Typical machine learning engineer job: $199k

Use the typical machine learning engineer figure as a reference when pay comes up. See machine learning engineer jobs

Questions you could be asked

How would you design a retrieval step so the model answers from real data instead of guessing?
How do you decide when an AI agent can act on its own versus asking for approval first?
Walk me through fine-tuning a model: what data did you use, and how did you check the result?
Tell me about a project where machine learning was part of your work. What did you do?
Tell me about a project where generative ai was part of your work. What did you do?

Adapt your resume

List these exact terms on your resume: RAG, AI agents, Fine-tuning, Machine learning, and Generative AI. An applicant tracking system matches the wording, not the idea.
Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
Lead with what you built, trained or shipped. This role is judged on the AI system itself, not the tools around it.

Want an expert to read your CV for this job?

Free. Send your CV and the role you want next. We reply by email within 2 to 4 business days.

Get a free CV review Get an express CV review Check your resume with the ATS resume checker

Get new machine learning engineer jobs (Builds AI ●●●●) by email

One email a week with the new machine learning engineer jobs (Builds AI ●●●●), each rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.

Free. One email a week. Unsubscribe in one click.