Software Dev. Engineer in Test, Conversational shopping

Amazon is hiring a Software Dev. Engineer in Test, Conversational shopping in London, United Kingdom. Level rates it ; you can apply on Amazon.

Level's read on this job

On Level's scale, this role is Works on AI ●●●○: the daily work is on AI products, without building the model.
The posting mentions Java, C and prompt engineering among its tools and skills.
Level classes it as a mid-level role.
Amazon has 21,000+ other open roles on Level.

AI in this role

Software Development Engineer in Test for Amazon's Rufus conversational AI shopping assistant focusing on GenAI quality and test automation.

javac

prompt-engineeringtest-automationgenai-validationsoftware-engineeringquality-assurance

We are looking for a passionate and skilled Software Development Engineer in Test (SDET) to join the Rufus Quality Engineering team. Rufus is Amazon's conversational AI shopping assistant, and as an SDET on this team, you will play a critical role in building scalable test automation frameworks, enabling Continuous Deployment (Full CD), and driving quality excellence across Rufus services.

This role is ideal for engineers who thrive at the intersection of software development and quality engineering — building tools, frameworks, and intelligent systems that empower developers to ship high-quality features at speed.

Key job responsibilities
Test Automation Framework Development: Design, build, and maintain scalable test automation frameworks for Rufus backend services, frontend applications, and GenAI model validation.

Tool Development: Build and maintain internal testing tools that enable SDEs to self-serve test execution and quality validation.

GenAI Quality Validation: Develop testing strategies and tooling for validating generative AI outputs, including prompt engineering evaluation, model response quality benchmarking, and regression testing.

Autonomous Test Generation: Contribute to the development of agentic AI systems for autonomous test generation, intelligent failure analysis, and predictive quality modeling.

Collaboration: Partner with feature teams to embed quality earlier in the development lifecycle, reducing production escapes through proactive testing and quality gates.

Basic qualifications

- Experience programming with at least one modern language such as Java, C++, or C# including object-oriented design
- Experience building test automation frameworks and tools

Preferred qualifications

- Knowledge of overall system architecture, scalability, reliability, and performance in a database environment
- Experience with security in service-oriented architectures and web services

Amazon is an equal opportunities employer. We believe passionately that employing a diverse workforce is central to our success. We make recruiting decisions based on your experience and skills. We value your passion to discover, invent, simplify and build. Protecting your privacy and the security of your data is a longstanding top priority for Amazon. Please consult our Privacy Notice (https://www.amazon.jobs/en/privacy_page) to know more about how we collect, use and transfer the personal data of our candidates.

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.

How we rate this

Software Dev. Engineer in Test, Conversational shopping at Amazon rates 65 out of 100 for how much of the daily work is AI. That makes it Works on AI (AI Level 3 of 4). The level is about AI in the job, not seniority.

Classification

Works on AI. The daily work is on AI products, without building the model.

●●●● Builds AI80 to 100
●●●○ Works on AI60 to 79
●●○○ Uses AI40 to 59
●○○○ Little AI0 to 39

Levels come from how often the tools, models and workflows of the role are named in the posting itself. Read the description and count the AI tools, models and workflows it names.

Key facts

Software Dev. Engineer in Test, Conversational shopping is an open job at Amazon.
Level rates this role AI Level 3 of 4: Works on AI.
The role is based in GB, London.
The job was posted on September 8, 2026.
Seniority: mid.
Applications are handled by Amazon. Apply on Amazon

Prepare for this job

Built from this posting and from similar jobs on Level.

Skills and AI tools this role asks for

Prompt engineeringTest AutomationGenAI ValidationSoftware EngineeringQuality AssuranceJavaC

Questions you could be asked

How do you structure and test a prompt to get consistent output from a language model?
Tell me about a project where test automation was part of your work. What did you do?
Tell me about a project where genai validation was part of your work. What did you do?
Tell me about a project where software engineering was part of your work. What did you do?
Tell me about a project where quality assurance was part of your work. What did you do?

Adapt your resume

List these exact terms on your resume: Prompt engineering, Test Automation, GenAI Validation, Software Engineering, and Quality Assurance. An applicant tracking system matches the wording, not the idea.
Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
Show where AI is part of your daily process, not a one-off project. This role expects it to be a running habit.

Want an expert to read your CV for this job?

Free. Send your CV and the role you want next. We reply by email within 2 to 4 business days.

Get a free CV review Get your CV rewritten Check your resume with the ATS resume checker

Get new software engineering jobs (Works on AI ●●●○ or higher) by email

One email a week with the new software engineering jobs (Works on AI ●●●○ or higher), each rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.

Free. One email a week. Unsubscribe in one click.