Skip to content
Level

Amazon

Sr. SDE, Alexa AI Agent Core, Alexa AI - Agent Core

Amazon is hiring a Sr. SDE, Alexa AI Agent Core, Alexa AI - Agent Core in Pune, India. Level rates it ; you can apply on Amazon.

Level's read on this job

  • On Level's scale, this software engineer role is Builds AI ●●●●: the job is building AI systems.
  • The posting mentions AI agents and AI evaluation among its tools and skills.
  • Level classes it as a senior role.
  • Amazon has 21,000+ other open roles on Level.
  • Posted in the last few days.

AI in this role

ai-agentsai-evaluation
We are looking for a passionate and experienced Sr, Software Development Engineer to help us build and scale the next generation of AI runtime infrastructure for Alexa+. You will design and implement model evaluation frameworks and contribute to Tier-1 distributed systems that orchestrate expert agent executions, manage LLM inference pipelines, and ensure reliable, low-latency delivery across Alexa-enabled devices globally.

This is a high-impact role where your work directly shapes how millions of customers experience Alexa+ every day.
Key job responsibilities
Design, build, and operate services that power Alexa+ Model evaluations — including test case storage and execution, build processes and model evaluation systems.
Contribute to multi-agent coordination systems that route requests to the right expert agents with minimal latency
Own the operational excellence of core services, ensuring 99.99%+ availability at scale
Collaborate with applied scientists and ML engineers to integrate new AI capabilities into production
Drive architectural decisions that balance performance, reliability, and cost efficiency
Mentor teammates and raise the engineering bar through code reviews, design reviews, and technical leadership
About the team
The AI Runtime team is the backbone of Alexa+. We own the infrastructure that powers Expert executions — the multi-agent systems that bring Alexa+'s intelligent capabilities to life for hundreds of millions of customers worldwide. Our services orchestrate LLM inference, coordinate expert agents, and deliver responses at massive scale with low latency. When a customer interacts with Alexa+ and it feels magical, our platform made it happen.

Key job responsibilities
Design, build, and operate large-scale services that drive Alexa+ quality flywheel
Build multi-tier frameworks that handle millions of requests to measure model accuracy
Own the operational excellence of core services, ensuring 99.99%+ availability at scale
Collaborate with applied scientists and ML engineers to integrate new AI capabilities into production
Drive architectural decisions that balance performance, reliability, and cost efficiency
Mentor teammates and raise the engineering bar through code reviews, design reviews, and technical leadership

About the team
The AI Runtime team is the backbone of Alexa+. We own the infrastructure that powers Expert executions — the multi-agent systems that bring Alexa+'s intelligent capabilities to life for hundreds of millions of customers worldwide. Our services orchestrate LLM inference, coordinate expert agents, and deliver responses at massive scale with low latency. When a customer interacts with Alexa+ and it feels magical, our platform made it happen.

Basic qualifications

- 5+ years of non-internship professional software development experience
- 5+ years of programming with at least one software programming language experience
- 5+ years of leading design or architecture (design patterns, reliability and scaling) of new and existing systems experience
- Experience as a mentor, tech lead or leading an engineering team

Preferred qualifications

- 5+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
- Bachelor's degree in computer science or equivalent

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.

How we rate this

Sr. SDE, Alexa AI Agent Core, Alexa AI - Agent Core at Amazon rates 87 out of 100 for how much of the daily work is AI. That makes it Builds AI (AI Level 4 of 4). The level is about AI in the job, not seniority.

Classification

Builds AI. The job is building AI systems.

  1. ●●●● Builds AI80 to 100
  2. ●●●○ Works on AI60 to 79
  3. ●●○○ Uses AI40 to 59
  4. ●○○○ Little AI0 to 39

Levels come from how often the tools, models and workflows of the role are named in the posting itself. Read the description and count the AI tools, models and workflows it names.

Prepare for this job

Built from this posting and from similar jobs on Level.

Skills and AI tools this role asks for

AI agentsAI Evaluation

Also common in software engineer jobs at this level

Pay

Typical software engineer job
$167k

This posting doesn't list pay. Use the typical software engineer figure when pay comes up. See software engineer jobs

Questions you could be asked

  1. How do you decide when an AI agent can act on its own versus asking for approval first?
  2. How do you decide that one model's output is better than another's for a given task?
  3. How would you decide a model or AI system is ready to ship?
  4. Tell me about a time a model underperformed in production. How did you find out, and what did you change?

Adapt your resume

  • List these exact terms on your resume: AI agents and AI Evaluation. An applicant tracking system matches the wording, not the idea.
  • Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
  • Lead with what you built, trained or shipped. This role is judged on the AI system itself, not the tools around it.

Want an expert to read your CV for this job?

Free. Send your CV and the role you want next. We reply by email within 2 to 4 business days.

Get new software engineer jobs (Builds AI ●●●●) by email

One email a week with the new software engineer jobs (Builds AI ●●●●), each rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.

Free. One email a week. Unsubscribe in one click.

Similar roles

Other roles that build AI, at other companies.

What kind of AI work fits you?

Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.

Find my next step

More jobs at Amazon

More software engineer jobs

Related searches

Same AI level

Jobs by city