AmazonSoftware Development Engineer, AI Runtime
Amazon is hiring a Software Development Engineer, AI Runtime in Pune, India. Level rates it ; you can apply on Level.
AI in this role
This is a high-impact role where your work directly shapes how millions of customers experience Alexa+ every day.
Key job responsibilities
- Design, build, and operate large-scale distributed services that power Alexa+ Expert executions
- Develop and optimize LLM orchestration pipelines — including model serving, prompt routing, and inference optimization
- Build multi-agent coordination systems that route requests to the right expert agents with minimal latency
- Own the operational excellence of Tier-1 services, ensuring 99.99%+ availability at scale
- Collaborate with applied scientists and ML engineers to integrate new AI capabilities into production
- Drive architectural decisions that balance performance, reliability, and cost efficiency
- Mentor teammates and raise the engineering bar through code reviews, design reviews, and technical leadership
About the team
The AI Runtime team is the backbone of Alexa+. We own the infrastructure that powers Expert executions — the multi-agent systems that bring Alexa+'s intelligent capabilities to life for hundreds of millions of customers worldwide. Our services orchestrate LLM inference, coordinate expert agents, and deliver responses at massive scale with low latency. When a customer interacts with Alexa+ and it feels magical, our platform made it happen.
Basic qualifications
- 3+ years of non-internship professional software development experience
- 2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience
- Bachelor's degree or foreign equivalent in Computer Science, Engineering, Mathematics, or a related field
- Experience programming with at least one software programming language
Preferred qualifications
- 3+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
- Bachelor's degree in computer science or equivalent
- System design with AI components and able to evaluate latency, cost, reliability, and accuracy.
Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.
How we rate this
Software Development Engineer, AI Runtime at Amazon rates 92 out of 100 for how much of the daily work is AI. That makes it Builds AI (AI Level 4 of 4). The level is about AI in the job, not seniority.
Builds AI. The job is building AI systems.
- ●●●● Builds AI80 to 100
- ●●●○ Works on AI60 to 79
- ●●○○ Uses AI40 to 59
- ●○○○ Little AI0 to 39
Levels come from how often the tools, models and workflows of the role are named in the posting itself. Open the description and count.
Prepare for this job
Built from this posting and from similar jobs on Level.
Also common in software engineer jobs at this level
Pay
- Typical software engineer job
- $168k
This posting doesn't list pay. Use the typical software engineer figure when pay comes up. See software engineer jobs
Want an expert to read your CV for this job?
Free. Send your CV and the role you want next. We reply by email within 2 to 4 business days.
Get new software engineer jobs (Builds AI ●●●●) by email
One email a week with the new software engineer jobs (Builds AI ●●●●), each rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.
Free. One email a week. Unsubscribe in one click.
Similar roles
Software Engineering roles that build AI, at other companies.
What kind of AI work fits you?
Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.
Find my next step