Level

Amazon

Process Lead, Core Shopping

Amazon is hiring a Process Lead, Core Shopping in Bengaluru, India. Level rates it ; you can apply on Amazon.

Level's read on this job

  • On Level's scale, this role is Works on AI ●●●○: the daily work is on AI products, without building the model.
  • The posting mentions data annotation, rlhf and llm operations among its tools and skills.
  • Level classes it as a mid-level role.
  • Amazon has 21,000+ other open roles on Level.

AI in this role

Manage dataset generation and RLHF annotations to support the training and improvement of Amazon's AI and LLMs.

data-annotationrlhfllm-operationsprocess-improvementmetrics-driven
Core Shopping Operations strives to become the most reliable source for dataset generation and annotations. We work in collaboration with Shopping feature teams to enhance customer experience (CX) quality across shopping features, devices, and locales. Our primary focus lies in handling annotations for training, measuring, and improving Artificial Intelligence (AI) and Large Language Models (LLMs), enabling Amazon to deliver a superior shopping experience to customers worldwide. Our mission is to empower Amazon's LLMs through Reinforcement Learning from Human Feedback (RLHF) across various categories at high speed. We aspire to provide an end-to-end data solution for the LLM lifecycle, leveraging pioneering technology alongside our operational excellence. By joining us, you will play a pivotal role in shaping the future of the shopping experience for customers worldwide.

Key job responsibilities
The candidate actively seeks to understand Amazon’s core business values and initiatives, and translates those into everyday practices.
Some of the key result areas include, but not limited to:
· Experience in managing process and operational escalations
· Driving appropriate data oriented analysis, adoption of technology solutions and process improvement projects to achieve operational and business goal
· Managing stakeholder communication across multiple lines of business on operational milestones, process changes and escalations
· Communicate and take the lead role in identifying Gaps in process areas and work with all stakeholders to resolve the gaps
· Be a SME for the process and a referral point for peers and junior team members
· Has the ability to drive business/operational metrics through quantitative decision making, and adoption of different tools and resources
· Ability to meet deadlines in a fast paced work environment driven by complex software systems and processes
· Ability to perform deep dive in the process and come up with process improvement solutions through automation
· Shall collaborate effectively with other teams and subject matter experts (SMEs), Language Engineers (LaEs) to support launches of new process and services

About the team
Core Shopping Operations strives to become the most reliable source for dataset generation and annotations. We work in collaboration with Shopping feature teams to enhance customer experience (CX) quality across shopping features, devices, and locales. Our primary focus lies in handling annotations for training, measuring, and improving Artificial Intelligence (AI) and Large Language Models (LLMs), enabling Amazon to deliver a superior shopping experience to customers worldwide. Our mission is to empower Amazon's LLMs through Reinforcement Learning from Human Feedback (RLHF) across various categories at high speed. We aspire to provide an end-to-end data solution for the LLM lifecycle, leveraging pioneering technology alongside our operational excellence. By joining us, you will play a pivotal role in shaping the future of the shopping experience for customers worldwide.

Basic qualifications

- Bachelor's degree or equivalent
- Experience in process improvement/quality control tools and methods
- Experience collaborating with cross-functional teams
- Experience in English-language communication skills, both written and verbal
- Experience working in a fast-paced, rapidly changing operations environment
- Experience in defining and implementing process improvement initiatives using data and metrics
- Bachelor's degree or equivalent
- Analyze and interpret complex Standard Operating Procedures (SOPs) to ensure organizational adherence.
- Demonstrate excellent problem-solving skills with proactive identification of process improvement opportunities.
- Drive cross-functional optimization efforts that deliver measurable operational excellence.

Preferred qualifications

- Knowledge of CSV, JSON, Markdown or python
- Knowledge of machine learning models

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.

How we rate this

Process Lead, Core Shopping at Amazon rates 65 out of 100 for how much of the daily work is AI. That makes it Works on AI (AI Level 3 of 4). The level is about AI in the job, not seniority.

Classification

Works on AI. The daily work is on AI products, without building the model.

  1. ●●●● Builds AI80 to 100
  2. ●●●○ Works on AI60 to 79
  3. ●●○○ Uses AI40 to 59
  4. ●○○○ Little AI0 to 39

Levels come from how often the tools, models and workflows of the role are named in the posting itself. Read the description and count the AI tools, models and workflows it names.

Prepare for this job

Built from this posting and from similar jobs on Level.

Skills and AI tools this role asks for

Data AnnotationRlhfLLM OperationsProcess ImprovementMetrics Driven

Questions you could be asked

  1. Tell me about a project where data annotation was part of your work. What did you do?
  2. Tell me about a project where rlhf was part of your work. What did you do?
  3. Tell me about a project where llm operations was part of your work. What did you do?
  4. Tell me about a project where process improvement was part of your work. What did you do?
  5. Tell me about a project where metrics driven was part of your work. What did you do?

Adapt your resume

  • List these exact terms on your resume: Data Annotation, Rlhf, LLM Operations, Process Improvement, and Metrics Driven. An applicant tracking system matches the wording, not the idea.
  • Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
  • Show where AI is part of your daily process, not a one-off project. This role expects it to be a running habit.

Want an expert to read your CV for this job?

Free. Send your CV and the role you want next. We reply by email within 2 to 4 business days.

Get new AI jobs (Works on AI ●●●○ or higher) by email

One email a week with the new AI jobs (Works on AI ●●●○ or higher), each rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.

Free. One email a week. Unsubscribe in one click.

Similar roles

Other roles that work on AI, at other companies.

What kind of AI work fits you?

Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.

Find my next step

More jobs at Amazon

Related searches

Same AI level

Jobs by city