AmazonPosted 6mo ago

Applied Scientist III, Alexa International

Applied Scientist III, Alexa International at Amazon scores 100 out of 100 on AI centrality, which makes it AI Level 4 of 4 (Builds AI) on this board. The level measures how much of the work is AI, not seniority.

IN, KA, Bengalurumidfull-time

AI in this role

ai-evaluationnlpspeech

Alexa International is looking for passionate, talented, and inventive Senior Applied Scientists to help build industry-leading technology with Large Language Models (LLMs) and multimodal systems, requiring strong deep learning and generative models knowledge. Senior applied scientists will drive cross-team scientific strategy, influence partner teams, and deliver solutions that have broad impact across Alexa's international products and services.

Key job responsibilities
As a Senior Applied Scientist with the Alexa International team, you will work with talented peers to develop novel algorithms and modeling techniques to advance the state of the art with LLMs, particularly delivering industry-leading scientific research and applied AI for multi-lingual applications — a challenging area for the industry globally. Your work will directly impact our global customers in the form of products and services that support Alexa+. You will leverage Amazon's heterogeneous data sources and large-scale computing resources to accelerate advances in text, speech, and vision domains. The ideal candidate possesses a solid understanding of machine learning, speech and/or natural language processing, modern LLM architectures, LLM evaluation & tooling, and a passion for pushing boundaries in this vast and quickly evolving field. They thrive in fast-paced environment, like to tackle complex challenges, excel at swiftly delivering impactful solutions while iterating based on user feedback, and are able to influence and align multiple teams around a shared scientific vision.

A day in the life
* Analyze, understand, and model customer behavior and the customer experience based on large-scale data.
* Build novel online & offline evaluation metrics and methodologies for multimodal personal digital assistants.
* Fine-tune/post-train LLMs using advanced and innovative techniques like SFT, DPO, Reinforcement Learning (RLHF and RLAIF) for supporting model performance specific to a customer’s location and language.
* Quickly experiment and set up experimentation framework for agile model and data analysis or A/B testing.
* Contribute through industry-first research to drive innovation forward.
* Drive cross-team scientific strategy and influence partner teams on LLM evaluation frameworks, post-training methodologies, and best practices for international speech and language systems.
* Lead end-to-end delivery of scientifically complex solutions from research to production, including reusable science components and services that resolve architecture deficiencies across teams.
* Serve as a scientific thought leader, communicating solutions clearly to partners, stakeholders, and senior leadership.
* Actively mentor junior scientists and contribute to the broader internal and external scientific community through publications and community engagement.

Basic qualifications

- PhD, or Master's degree and 10+ years of applied research experience
- 5+ years of building machine learning models for business application experience
- Experience with neural deep learning methods and machine learning
- Experience in building speech recognition, machine translation and natural language processing systems (e.g., commercial speech products or government speech projects)
- Experience with large scale machine learning systems such as profiling and debugging and understanding of system performance and scalability
- Deep expertise in state-of-the-art LLM architectures, training, evaluation, and post-training techniques (SFT, DPO, RLHF, RLAIF)

Preferred qualifications

- Experience in patents or publications at top-tier peer-reviewed conferences or journals
- Experience in professional software and systems development

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.

Prepare for this job

A free preview built only from this posting: what it asks for, what you could be asked in an interview, and how to adjust your resume.

Skills and AI tools this role asks for

AI EvaluationNlpSpeech

Questions you could be asked

How do you decide that one model's output is better than another's for a given task?
What NLP problem have you worked on, and how did you measure whether it actually worked?
What have you built with speech recognition or text-to-speech, and where did it break?
How would you decide a model or AI system is ready to ship?
Tell me about a time a model underperformed in production. How did you find out, and what did you change?

Adapt your resume

List these exact terms on your resume: AI Evaluation, Nlp, and Speech. An applicant tracking system matches the wording, not the idea.
Attach one line of real, concrete experience to at least one of them — a tool named with nothing behind it rarely survives a human read.
Lead with what you built, trained or shipped — this role is judged on the AI system itself, not the tools around it.

Want your resume actually rewritten for this job?

The free preview above is everything we have today. A full resume rewrite is not live yet and has no price set. Join the waitlist and we will email you if we open it.