Skip to content

Amazon

Applied Scientist III, Alexa International

Amazon is hiring an Applied Scientist III, Alexa International in Bengaluru, India. Level rates it ; you can apply on Amazon.

Level's read on this job

  • Builds AI ●●●● is how Level rates this applied scientist role: the job is building AI systems.
  • Tools and skills the posting cites include AI evaluation, NLP and speech.
  • Level classifies it as a mid-level role.
  • Level lists 20,000+ other open roles at Amazon.

AI in this role

ai-evaluationnlpspeech
Alexa International is looking for passionate, talented, and inventive Senior Applied Scientists to help build industry-leading technology with Large Language Models (LLMs) and multimodal systems, requiring strong deep learning and generative models knowledge. Senior applied scientists will drive cross-team scientific strategy, influence partner teams, and deliver solutions that have broad impact across Alexa's international products and services.

Key job responsibilities
As a Senior Applied Scientist with the Alexa International team, you will work with talented peers to develop novel algorithms and modeling techniques to advance the state of the art with LLMs, particularly delivering industry-leading scientific research and applied AI for multi-lingual applications — a challenging area for the industry globally. Your work will directly impact our global customers in the form of products and services that support Alexa+. You will leverage Amazon's heterogeneous data sources and large-scale computing resources to accelerate advances in text, speech, and vision domains. The ideal candidate possesses a solid understanding of machine learning, speech and/or natural language processing, modern LLM architectures, LLM evaluation & tooling, and a passion for pushing boundaries in this vast and quickly evolving field. They thrive in fast-paced environment, like to tackle complex challenges, excel at swiftly delivering impactful solutions while iterating based on user feedback, and are able to influence and align multiple teams around a shared scientific vision.

A day in the life
* Analyze, understand, and model customer behavior and the customer experience based on large-scale data.
* Build novel online & offline evaluation metrics and methodologies for multimodal personal digital assistants.
* Fine-tune/post-train LLMs using advanced and innovative techniques like SFT, DPO, Reinforcement Learning (RLHF and RLAIF) for supporting model performance specific to a customer’s location and language.
* Quickly experiment and set up experimentation framework for agile model and data analysis or A/B testing.
* Contribute through industry-first research to drive innovation forward.
* Drive cross-team scientific strategy and influence partner teams on LLM evaluation frameworks, post-training methodologies, and best practices for international speech and language systems.
* Lead end-to-end delivery of scientifically complex solutions from research to production, including reusable science components and services that resolve architecture deficiencies across teams.
* Serve as a scientific thought leader, communicating solutions clearly to partners, stakeholders, and senior leadership.
* Actively mentor junior scientists and contribute to the broader internal and external scientific community through publications and community engagement.

Basic qualifications

- PhD, or Master's degree and 10+ years of applied research experience
- 5+ years of building machine learning models for business application experience
- Experience with neural deep learning methods and machine learning
- Experience in building speech recognition, machine translation and natural language processing systems (e.g., commercial speech products or government speech projects)
- Experience with large scale machine learning systems such as profiling and debugging and understanding of system performance and scalability
- Deep expertise in state-of-the-art LLM architectures, training, evaluation, and post-training techniques (SFT, DPO, RLHF, RLAIF)

Preferred qualifications

- Experience in patents or publications at top-tier peer-reviewed conferences or journals
- Experience in professional software and systems development

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.

How we rate this

Applied Scientist III, Alexa International at Amazon rates 100 out of 100 for how much of the daily work is AI. That makes it Builds AI (AI Level 4 of 4). The level is about AI in the job, not seniority.

Classification

Builds AI. The job is building AI systems.

  1. ●●●● Builds AI80 to 100
  2. ●●●○ Works on AI60 to 79
  3. ●●○○ Uses AI40 to 59
  4. ●○○○ Little AI0 to 39

Levels come from how often the tools, models and workflows of the role are named in the posting itself. Read the description and count the AI tools, models and workflows it names.

Prepare for this job

Built from this posting and from similar jobs on Level.

Skills and AI tools this role asks for

AI EvaluationNLPSpeech

Also common in applied scientist jobs at this level

Pay

Typical applied scientist job
$167k

This posting doesn't list pay. Use the typical applied scientist figure when pay comes up. See applied scientist jobs

Questions you could be asked

  1. How do you decide that one model's output is better than another's for a given task?
  2. What NLP problem have you worked on, and how did you measure whether it actually worked?
  3. What have you built with speech recognition or text-to-speech, and where did it break?
  4. How would you decide a model or AI system is ready to ship?
  5. Tell me about a time a model underperformed in production. How did you find out, and what did you change?

Adapt your resume

  • List these exact terms on your resume: AI Evaluation, NLP, and Speech. An applicant tracking system matches the wording, not the idea.
  • Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
  • Lead with what you built, trained or shipped. This role is judged on the AI system itself, not the tools around it.

Get your CV reviewed before you apply

Send your CV and the role you want next. Your review arrives by email within 3 days.

Get new applied scientist jobs (Builds AI ●●●●) by email

One email a week, each job rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.

Free.

Similar roles

Research roles that build AI, at other companies.

What kind of AI work fits you?

Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.

Find my next step

More jobs at Amazon

More applied scientist jobs

Related searches

Same AI level

Jobs by city