Software Development Manager, Product Data Quality Measurement Systems

Amazon is hiring a Software Development Manager, Product Data Quality Measurement Systems in Seattle, United States. Level rates it ; you can apply on Amazon.

Level's read on this job

On Level's scale, this role is Works on AI ●●●○: the daily work is on AI products, without building the model.
The posting mentions Bedrock, SageMaker and AI agents among its tools and skills.
Level classes it as a senior role.
Amazon has 21,000+ other open roles on Level.
Posted in the last few days.

AI in this role

bedrocksagemaker

ai-agents

Every time a customer searches, browses or asks an AI assistant for help on Amazon, the experience depends on great product data. Lead the team that defines what "high-quality" means for every product in our catalog of billions, and builds the LLM and agentic systems that measure it.

Amazon's Catalog Systems division is looking for an exceptional engineering manager to lead, architect and deliver Generative AI-powered solutions that measure and raise the quality of the world's largest product catalog. An accurate, information-rich catalog powers product discovery, helps customers make confident buying decisions and makes Amazon the first stop for shoppers. That's true whether customers shop through search and detail pages or through conversational assistants and AI agents.

You'll be the engineering leader behind the single quality score used across Amazon for every product. Brands and sellers use it to fix their listings. Category leaders use it to set goals. Search, shopping experiences and AI assistants use it to decide which products and details to show customers. Your systems use LLMs and multimodal models to find defects in titles, attributes, bullet points, rich content, variations and images. They catch text that contradicts the product image, weigh each defect by how much it hurts the customer, and roll it all into one score people trust.

There's no single right answer here, and that's what makes it interesting. Some days it's a smart heuristic or a classic ML model. Other days it's LLM-as-a-judge, multimodal reasoning or an autonomous agent that improves its own prompts. You'll do all of this at a scale few places can offer, and your work will shape how millions of customers discover and buy products worldwide.

What you'll work on:

- GenAI and LLMs: Run production LLM and multimodal pipelines at catalog scale. Benchmark models, tune prompts and fine-tune for high precision at low cost.
- Agentic systems: Build AI agents that detect defects, find root causes, check their own accuracy and close the loop with selling partners. Bring agentic coding practices to how your team builds software.
- Powering customer experiences: Supply trusted, machine-readable quality signals that search, detail pages, recommendations and AI shopping assistants use to decide which products and details customers see.
- Scale and cost: Build batch and real-time, event-driven systems on AWS (Bedrock, SageMaker, EMR/Spark, ECS, Lambda). Keep inference and compute costs growing more slowly than the catalog.
- Measuring the measurers: Track precision and recall for every detector, and use human-in-the-loop auditing and smart sampling to build ground truth.
- Insights and guardrails: Give brands and sellers fast feedback and self-service insights, and set up AI guardrails that block bad data before it reaches the catalog.
What you'll own:

- The vision, strategy and roadmap for AI-driven product quality measurement
- Hiring, mentoring and growing a high-performing team of engineers and tech leads
- Partnerships with science, image/media, catalog and selling partner teams to keep raising the quality bar
- Technical decisions that balance innovation, accuracy, cost and operational excellence
If you want your work to shape what millions of customers see every day, however they choose to shop, let's talk.

Key job responsibilities
- Own the long-term vision and strategy for AI-driven product data quality measurement, and turn it into a roadmap your team can deliver.
- Lead a team of software engineers, including senior engineers, to architect, build, test and deploy scalable batch and real-time systems with a constant focus on customers.
- Drive delivery of LLM, multimodal and agentic solutions that detect product data defects, weigh them by customer impact and roll them up into a trusted quality score.
- Partner with science teams to benchmark models, tune prompts and fine-tune, so quality signals stay accurate as costs come down.
- Set and track precision, recall and cost metrics for every detection system, and use the results to keep improving.
- Work with image/media, search, catalog and selling partner teams to define product quality and turn measurements into fixes customers can see, across search, detail pages and AI shopping assistants.
- Make technical decisions that balance speed, accuracy, cost and operational excellence. Manage technical debt and own system reliability and on-call health.
- Hire, mentor and develop engineers and future technical leaders, and keep the team performing at a high level.
- Report on progress, quality, operations and system performance to senior leadership, and influence their technical direction and investment decisions.

A day in the life
Your main job is making sure the product quality score is accurate, trusted and gets better every week. Most mornings start with your team's dashboards. Are the detectors catching real defects? Did a new LLM prompt raise precision or just cost? Is the real-time pipeline healthy?

From there, the day is a mix of people and problems. You might work through a design with your engineers on scaling a new multimodal check to billions of products. Then you might sit down with scientists to decide whether a fine-tuned model is ready for production. You'll also meet with partner teams in image, search and selling partner experience, who rely on your score and bring you the hard questions. For example, why does this product get a low grade? Or can you flag this defect before it goes live?

Your customers are both inside and outside Amazon. Brands and sellers use your signals to fix their listings. Category leaders use them to set goals. Shopping experiences, from search to AI assistants, use them to decide what customers see.

Some days go beyond the usual work. You might dig into a customer complaint that shows a gap in how quality is measured, try out an AI agent that improves its own prompts, or explain to senior leaders why a metric moved. And you'll always make time to coach your team and help your engineers grow.

About the team
We believe every customer should be able to shop on Amazon with confidence in the product information they see. Our team builds the systems that measure product data quality across billions of products, then turns them into action. Brands and sellers use our insights to improve their listings, category teams use them to set goals, and shopping experiences from search to AI assistants use them to decide what customers see. You'll work with engineers, scientists and partner teams in image, search and selling partner experience. We value trust over coverage, design for billions from day one, and believe customer stories reveal what metrics miss.

Basic qualifications

- 3+ years of engineering team management experience
- 7+ years of working directly within engineering teams experience
- 3+ years of designing or architecting (design patterns, reliability and scaling) of new and existing systems experience
- 8+ years of leading the definition and development of multi tier web services experience
- Knowledge of engineering practices and patterns for the full software/hardware/networks development life cycle, including coding standards, code reviews, source control management, build processes, testing, certification, and livesite operations
- Experience partnering with product or program management teams

Preferred qualifications

- Experience in communicating with users, other technical teams, and senior leadership to collect requirements, describe software product features, technical designs, and product strategy
- Experience in recruiting, hiring, mentoring/coaching and managing teams of Software Engineers to improve their skills, and make them more effective, product software engineers

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.

How we rate this

Software Development Manager, Product Data Quality Measurement Systems at Amazon rates 68 out of 100 for how much of the daily work is AI. That makes it Works on AI (AI Level 3 of 4). The level is about AI in the job, not seniority.

Classification

Works on AI. The daily work is on AI products, without building the model.

●●●● Builds AI80 to 100
●●●○ Works on AI60 to 79
●●○○ Uses AI40 to 59
●○○○ Little AI0 to 39

Levels come from how often the tools, models and workflows of the role are named in the posting itself. Read the description and count the AI tools, models and workflows it names.

Key facts

Software Development Manager, Product Data Quality Measurement Systems is an open job at Amazon.
Level rates this role AI Level 3 of 4: Works on AI.
The role is based in US, WA, Seattle.
The job was posted on October 29, 2026.
Seniority: senior.
Applications are handled by Amazon. Apply on Amazon

Prepare for this job

Built from this posting and from similar jobs on Level.

Skills and AI tools this role asks for

AI agentsBedrockSageMaker

Questions you could be asked

How do you decide when an AI agent can act on its own versus asking for approval first?
Walk me through how you've used Bedrock in your day-to-day work.
What are the limits of SageMaker that you've run into, and how did you work around them?
Describe a typical day in a role like this one: which parts run through AI directly?
If you removed AI from this role, what would be left, and how do you decide what still needs a human?

Adapt your resume

List these exact terms on your resume: AI agents, Bedrock, and SageMaker. An applicant tracking system matches the wording, not the idea.
Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
Show where AI is part of your daily process, not a one-off project. This role expects it to be a running habit.

Want an expert to read your CV for this job?

Free. Send your CV and the role you want next. We reply by email within 2 to 4 business days.

Get a free CV review Get your CV rewritten Check your resume with the ATS resume checker

Get new data jobs (Works on AI ●●●○ or higher) by email

One email a week with the new data jobs (Works on AI ●●●○ or higher), each rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.

Free. One email a week. Unsubscribe in one click.