Senior Software Engineer in Test

Okta is hiring a Senior Software Engineer in Test in Bengaluru, India. Level rates it ; you can apply on Level.

AI in this role

claudecopilotclaude-code

ai-agentsai-evaluation

Secure Every Identity, from AI to Human

Identity is the key to unlocking the potential of AI. Okta secures AI by building the trusted, neutral infrastructure that enables organizations to safely embrace this new era. This work requires a relentless drive to solve complex challenges with real-world stakes. We are looking for builders and owners who operate with speed and urgency and execute with excellence.

This is an opportunity to do career-defining work. We're all in on this mission. If you are too, let's talk.

We are looking for a strong Senior Software Engineer in Test (SET) to build scalable automation frameworks for multi-language SDKs, Model Context Protocol (MCP), and AI-powered workflows. The role focuses on SDK testing, MCP protocol validation, prompt automation, and developer productivity tools. Strong programming and framework development skills are essential; UI and API automation are secondary.

Key Responsibilities

Design and develop reusable automation frameworks for SDKs across multiple languages, including TypeScript/JavaScript, Python, Java, and Go.
Automate SDK functionality, compatibility, error handling, integration, and release validation.
Build and maintain MCP test frameworks to validate clients, servers, tools, resources, prompts, transports, and protocol interactions.
Develop automated tests for prompts, AI workflows, tool calling, structured outputs, and LLM response quality.
Develop and maintain automated test coverage for XAA, validating functionality, integrations, error handling, and reliability across supported workflows.
Build reusable test utilities, mocks, test harnesses, and developer productivity tools.
Integrate automated tests into CI/CD pipelines and troubleshoot flaky tests, failures, and infrastructure issues.
Leverage GitHub Copilot, Claude Code, and other GenAI tools for test generation, debugging, and framework development.
Collaborate with developers, architects, and platform teams to improve quality, reliability, and release confidence.

Required Qualifications

Bachelor's degree in Computer Science, Software Engineering, or a related field.
5–8 years of experience in SDET, software testing, test infrastructure, or software engineering.
Strong programming skills in at least one language: TypeScript/JavaScript, Python, Java, or Go.
Experience building automation frameworks, reusable libraries, or developer tools.
Strong understanding of SDK testing, integration testing, regression testing, and compatibility testing.
Experience with Git, CI/CD, and debugging complex software systems.
Familiarity with AI-assisted development tools such as GitHub Copilot or Claude Code.
Strong problem-solving, ownership, and communication skills.

Preferred Qualifications

Experience with MCP clients/servers, protocol testing, or MCP SDKs.
Experience with prompt automation, LLM evaluation, AI agents, or AI-powered applications.
Experience testing SDKs across multiple programming languages.
Familiarity with Docker, Kubernetes, cloud environments, and performance testing.
Working knowledge of API automation and UI frameworks such as Playwright or Cypress.

Key Technologies

Expected Outcomes

Scalable automation coverage across multiple SDKs and programming languages.
Reliable MCP protocol and integration testing.
Automated prompt and AI workflow regression testing.
Improved developer productivity, defect detection, and release confidence.

#LI-Hybrid

P22395_3583173

The Okta Experience

We are intentional about connection. Our global community, spanning over 20 offices worldwide, is united by a drive to innovate. Your journey begins with an immersive, in-person onboarding experience designed to accelerate your impact and connect you to our mission and team from day one.

Okta is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, ancestry, marital status, age, physical or mental disability, or status as a protected veteran. We also consider for employment qualified applicants with arrest and convictions records, consistent with applicable laws.

If reasonable accommodation is needed to complete any part of the job application, interview process, or onboarding please use this Form to request an accommodation.

Notice for New York City Applicants & Employees: Okta may use Automated Employment Decision Tools (AEDT), as defined by New York City Local Law 144, that use artificial intelligence, machine learning, or other automated processes to assist in our recruitment and hiring process. In accordance with NYC Local Law 144, if you are an applicant or employee residing in New York City, please click here to view our full NYC AEDT Notice.

How we rate this

Senior Software Engineer in Test at Okta rates 45 out of 100 for how much of the daily work is AI. That makes it Uses AI (AI Level 2 of 4). The level is about AI in the job, not seniority.

Classification

Uses AI. An ordinary role that requires AI tools.

●●●● Builds AI80 to 100
●●●○ Works on AI60 to 79
●●○○ Uses AI40 to 59
●○○○ Little AI0 to 39

Levels come from how often the tools, models and workflows of the role are named in the posting itself. Open the description and count.

Key facts

Senior Software Engineer in Test is an open job at Okta.
Level rates this role AI Level 2 of 4: Uses AI.
The role is based in Bengaluru, India.
The job was posted on October 15, 2026.
Seniority: senior.
Applications are handled by Okta. Apply on Okta

Prepare for this job

Built from this posting and from similar jobs on Level.

Skills and AI tools this role asks for

AI agentsAI EvaluationClaudeCopilotClaude Code

Also common in software engineer jobs at this level

AWS React C++SQL Azure C#

Pay

Typical software engineer job: $168k

This posting doesn't list pay. Use the typical software engineer figure when pay comes up. See software engineer jobs

Questions you could be asked

How do you decide when an AI agent can act on its own versus asking for approval first?
How do you decide that one model's output is better than another's for a given task?
What are the limits of Claude that you've run into, and how did you work around them?
What's a project where you used Copilot hands-on?
Walk me through how you've used Claude Code in your day-to-day work.

Adapt your resume

List these exact terms on your resume: AI agents, AI Evaluation, Claude, Copilot, and Claude Code. An applicant tracking system matches the wording, not the idea.
Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
Put the AI tool in a bullet point about what you did, not just in a skills list. This role treats it as a required part of the job.

Want an expert to read your CV for this job?

Free. Send your CV and the role you want next. We reply by email within 2 to 4 business days.

Get a free CV review Check your resume with the ATS resume checker

Get new software engineer jobs (Uses AI ●●○○ or higher) by email

One email a week with the new software engineer jobs (Uses AI ●●○○ or higher), each rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.

Free. One email a week. Unsubscribe in one click.