AmazonSenior Program Manager, Conversational Shopping, AFS
Amazon is hiring a Senior Program Manager, Conversational Shopping, AFS for a remote role open to applicants in United States. It pays $127k-$185k a year and Level rates it ; you can apply on Amazon.
Level's read on this job
- Level rates this role Works on AI ●●●○: the daily work is on AI products, without building the model.
- The posting lists this role as remote.
- Tools and skills the posting cites include LLM, program management and quality assurance.
- Level classifies it as a senior role.
- Level lists 21,000+ other open roles at Amazon.
AI in this role
Lead an integrated quality improvement program for Alexa's conversational shopping assistant, driving AI behavioral fixes.
Key job responsibilities
You will own the program to identify and reduce the key defects impacting the assistant’s quality score, with accountability for driving the organization toward an ambitious goal. The ideal candidate is an AI-forward program leader who can understand complex AI/LLM quality problems, diagnose what is driving gaps in customer experience, and translate those gaps into clear priorities and actions. You must be comfortable understanding how AI systems behave, interpreting evaluation signals, challenging root-cause analysis, and influencing technical teams to deliver measurable improvements.
Own the quality improvement strategy: Establish the roadmap, priorities, mechanisms, and success metrics to achieve high-priority goals, focusing teams on the highest-impact defects. Drive an integrated, end-to-end quality improvement program across agents, evaluation infrastructure, and related workstreams, with clear owners, milestones, dependencies, and measurable outcomes.
Diagnose AI quality gaps: Partner with Science, Product, Engineering, and evaluation teams to interpret AI/LLM behaviors, evaluation signals, and customer-impacting defects; lead rigorous RCA to identify systemic root causes, risks, dependencies, and blockers, and drive resolution through data-backed recommendations and clear tradeoffs.
Drive cross-functional resolution: Translate complex AI problems into clear actions, influence product roadmaps without direct authority, and establish an operating cadence that drives accountability, surfaces progress, risks, and gaps, and enables timely leadership decisions to deliver measurable quality improvements.
Own the executive narrative: Establish mechanisms to track progress and cumulative impact, identify where the program is off-track, and provide senior leadership with clear insights, risks, tradeoffs, and recommendations.
Operate with a strong bias for action, removing obstacles and driving fast, iterative delivery while maintaining focus on quality and measurable outcomes.
Basic qualifications
- 5+ years of program or project management experience
- Experience using data and metrics to determine and drive improvements
- Experience owning program strategy, end to end delivery, and communicating results to senior leadership
- Experience managing conflict, escalations, negotiating compromise, influencing others and problem solving with engineering teams
- Experience with AI/ML, Generative AI, LLMs, conversational AI, or AI-powered products, with the ability to diagnose ambiguous quality problems and translate complex concepts into actionable priorities.
Preferred qualifications
- Master's degree, or MBA in business, operations, human resources, adult education, organizational development, instructional design or related field
- Knowledge of general AI tools
- Experience owning program strategy, end-to-end delivery, and communicating results to senior leadership
- Strong written and verbal communication skills, including the ability to develop crisp narratives and effectively communicate recommendations, tradeoffs, and outcomes to senior leadership.
Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.
Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.
The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits.
USA, NY, New York - 127,200.00 - 185,000.00 USD annually
USA, WA, Seattle - 115,600.00 - 160,000.00 USD annually
How we rate this
Senior Program Manager, Conversational Shopping, AFS at Amazon rates 65 out of 100 for how much of the daily work is AI. That makes it Works on AI (AI Level 3 of 4). The level is about AI in the job, not seniority.
Works on AI. The daily work is on AI products, without building the model.
- ●●●● Builds AI80 to 100
- ●●●○ Works on AI60 to 79
- ●●○○ Uses AI40 to 59
- ●○○○ Little AI0 to 39
Levels come from how often the tools, models and workflows of the role are named in the posting itself. Read the description and count the AI tools, models and workflows it names.
Prepare for this job
Built from this posting and from similar jobs on Level.
Skills and AI tools this role asks for
Questions you could be asked
- Tell me about a project where program management was part of your work. What did you do?
- Tell me about a project where quality assurance was part of your work. What did you do?
- Tell me about a project where root cause analysis was part of your work. What did you do?
- Tell me about a project where cross functional leadership was part of your work. What did you do?
- How do you decide that one model's output is better than another's for a given task?
Adapt your resume
- List these exact terms on your resume: Program Management, Quality Assurance, Root Cause Analysis, Cross Functional Leadership, and AI Evaluation. An applicant tracking system matches the wording, not the idea.
- Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
- Show where AI is part of your daily process, not a one-off project. This role expects it to be a running habit.
Want an expert to read your CV for this job?
Free. Send your CV and the role you want next. You get your review by email within 24 hours.
Get new remote operations jobs (Works on AI ●●●○ or higher) by email
One email a week with the new remote operations jobs (Works on AI ●●●○ or higher), each rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.
Free. One email a week. Unsubscribe in one click.
Similar roles
Operations roles that work on AI, at other companies.
What kind of AI work fits you?
Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.
Find my next step