AmazonPosted 3mo ago

Applied Scientist II, Perception

Applied Scientist II, Perception at Amazon scores 94 out of 100 on AI centrality, which makes it AI Level 4 of 4 (Builds AI) on this board. The level measures how much of the work is AI, not seniority.

US, CA, San Franciscomidfull-time$172k-$222k

AI in this role

pytorchjax

ai-automationcomputer-vision

Amazon is on a mission to redefine the future of automation — and we're looking for exceptional talent to help lead the way. We are building the next generation of advanced robotic systems that seamlessly blend cutting-edge AI, sophisticated control systems, and novel mechanical design to create adaptable, intelligent automation solutions capable of operating safely alongside humans in dynamic, real-world environments.

At Amazon, we leverage the power of machine learning, artificial intelligence, and advanced robotics to solve some of the most complex operational challenges at a scale unlike anywhere else in the world. Our fleet of robots spans hundreds of facilities globally, working in sophisticated coordination to deliver on our promise of customer excellence — and we're just getting started.

As a Applied Scientist in Robot Perception, you will be at the forefront of this transformation. You will develop and deploy state-of-the-art perception algorithms that enable robots to truly understand and interact with the physical world — bridging the gap between theoretical research and real-world impact. Bringing deep expertise in Computer Vision and a nuanced understanding of the capabilities and limitations of modern Vision-Language Models (VLMs), you will innovate boldly and push the boundaries of what's possible. Our vision for the Perception layer is ambitious: to enable seamless, intelligent interaction between the user, the robot, and its environment.

This is a rare opportunity to work at the intersection of deep learning, large language models, and robotics — contributing to research that doesn't just advance the field, but reshapes it. You will collaborate with world-class teams pioneering breakthroughs in dexterous manipulation, locomotion, and human-robot interaction, all at an unprecedented scale.

Join us in building intelligent robotic systems that will define the future of automation and human-robot collaboration.

Key job responsibilities
- Design, develop, and deploy perception algorithms for robotics systems, including object detection, segmentation, tracking, depth estimation, and scene understanding
- Lead research initiatives in computer vision, sensor fusion and 3D perception
- Collaborate with cross-functional teams including robotics engineers, software engineers, and product managers to define and deliver perception capabilities
- Drive end-to-end ownership of ML models — from data collection and labeling strategy to training, evaluation, and deployment
- Mentor junior scientists and engineers; contribute to a culture of technical excellence
- Define and track key metrics to measure perception system performance in real-world environments
- Publish research findings in top-tier venues (CVPR, ICCV, ECCV, ICRA, NeurIPS, etc.) and contribute to patents

A day in the life
- Train ML models for deployment in simulation and real-world robots, identify and document their limitations post-deployment
- Drive technical discussions within your team and with key stakeholders to develop innovative solutions to address identified limitations
- Actively contribute to brainstorming sessions on adjacent topics, bringing fresh perspectives that help peers grow and succeed — and in doing so, build lasting trust across the team
- Mentor team members while maintaining significant hands-on contribution to technical solutions

Basic qualifications

- PhD in engineering, technology, computer science, machine learning, robotics, operations research, statistics, mathematics or equivalent quantitative field
- 2+ years of building machine learning models for business application experience
- Experience with Java, C++, or pother programming languages
- Experience with neural deep learning methods and machine learning
- Have publications at top-tier peer-reviewed conferences or journals

Preferred qualifications

- Experience with large scale distributed systems such as Hadoop, Spark etc.
- PhD in Robotics, with a focus on Robot Perception
- Experience leading research initiatives in full-stack robotics or foundation models
- Track record of successful production robotics deployments
- History of technical leadership and team mentorship
- Experience bridging research with practical engineering implementation in robotics systems
- Extensive programming skills in Python and PyTorch/JAX

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.

Los Angeles County applicants: Job duties for this position include: work safely and cooperatively with other employees, supervisors, and staff; adhere to standards of excellence despite stressful conditions; communicate effectively and respectfully with employees, supervisors, and staff to ensure exceptional customer service; and follow all federal, state, and local laws and Company policies. Criminal history may have a direct, adverse, and negative relationship with some of the material job duties of this position. These include the duties and responsibilities listed above, as well as the abilities to adhere to company policies, exercise sound judgment, effectively manage stress and work safely and respectfully with others, exhibit trustworthiness and professionalism, and safeguard business operations and the Company’s reputation. Pursuant to the Los Angeles County Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.

Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.

The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits.

USA, CA, SAN FRANCISCO - 171,600.00 - 222,200.00 USD annually
USA, CA, Sunnyvale - 171,600.00 - 222,200.00 USD annually

Prepare for this job

A free preview built only from this posting: what it asks for, what you could be asked in an interview, and how to adjust your resume.

Skills and AI tools this role asks for

AI AutomationComputer VisionPyTorchJax

Questions you could be asked

Tell me about a workflow you automated with AI tools, end to end.
Walk me through a computer vision problem you solved, from raw data to a deployed model.
What are the limits of PyTorch that you've run into, and how did you work around them?
What's a project where you used Jax hands-on?
How would you decide a model or AI system is ready to ship?

Adapt your resume

List these exact terms on your resume: AI Automation, Computer Vision, PyTorch, and Jax. An applicant tracking system matches the wording, not the idea.
Attach one line of real, concrete experience to at least one of them — a tool named with nothing behind it rarely survives a human read.
Lead with what you built, trained or shipped — this role is judged on the AI system itself, not the tools around it.

Want your resume actually rewritten for this job?

The free preview above is everything we have today. A full resume rewrite is not live yet and has no price set. Join the waitlist and we will email you if we open it.