Senior Staff Machine Learning Engineer - Perception

Zoox is hiring a Senior Staff Machine Learning Engineer - Perception in Boston, United States. It pays $277k-$389k a year and Level rates it ; you can apply on Zoox.

Level's read on this job

Level rates this machine learning engineer role Builds AI ●●●●: the job is building AI systems.
The listed pay starts 39% above the typical machine learning engineer posting on Level.
Tools and skills the posting cites include computer vision.
Level classifies it as a lead role.
Level lists 224 other open roles at Zoox.

AI in this role

computer-vision

Our Perception team is responsible for using our sensor data to understand the complex and dynamic environments where we drive. In this role, you will have access to the best sensor data in the world and an incredible infrastructure for testing and validating your algorithms. We are creating new algorithms for segmentation, tracking, classification, and high-level scene understanding, and you could work on any (or all!) of these components. As a Senior Staff ML Engineer, you will lead the development of machine learning algorithms that can range in influence from onboard autonomy to offboard autonomy and validation. You will collaborate closely with other teams specializing in Prediction, Planning, Simulation, and Safety Validation, influencing our overall technical stack. Your role will look at problems in a way that crosses team boundaries to prototype new approaches that influence the long term technical direction of multiple organizations within the company. The impact of the role can be in the form of impacting immediate company milestones to leading forward-looking exploratory projects.

Responsibilities

Develop new algorithms to understand the scene around the robot, and how that scene would evolve through time
Build multi-modal foundation models for on-vehicle and offline applications
Develop new algorithms to apply generative AI to simulation to improve the realism of our offline validation systems
Leverage our large-scale machine learning infrastructure to discover new solutions and push the boundaries of the field
Provide technical mentorship to the broader group of ML developers at Zoox
Collaborate with engineers on Prediction, Planning, and Simulation to solve the overall Autonomous Driving problem in complex urban environments

Qualifications

BS, MS, or PhD degree in computer science or related field
Experience with training and deploying Deep Learning models on sensor data-Experience with production Machine Learning pipelines: dataset creation, training frameworks, metrics pipelines
Experience with modern computer vision techniques
Strong mathematical skills and understanding of probabilistic techniques
Fluency in C++ or Fluency in Python with a basic understanding of C++
Extensive experience with programming and algorithm design-Strong mathematics skills

Bonus Qualifications

Publications in your field (CVPR, ICCV, RSS, ICRA preferred)
Experience with autonomous robots
Experience with realtime sensor fusion (e.g. LiDAR, camera, radar)
Experience with novel pipelines and architectures for convolutional neural nets
Experience with 3D data and representations (pointclouds, meshes, etc.)

About ZooxZoox is developing the first ground-up, fully autonomous vehicle fleet and the supporting ecosystem required to bring this technology to market. Sitting at the intersection of robotics, machine learning, and design, Zoox aims to provide the next generation of mobility-as-a-service in urban environments. We’re looking for top talent that shares our passion and wants to be part of a fast-moving and highly execution-oriented team.
Follow us on LinkedIn
AccommodationsIf you need an accommodation to participate in the application or interview process please reach out to accommodations@zoox.com or your assigned recruiter.
A Final Note:You do not need to match every listed expectation to apply for this position. Here at Zoox, we know that diverse perspectives foster the innovation we need to be successful, and we are committed to building a team that encompasses a variety of backgrounds, experiences, and skills.

How we rate this

Senior Staff Machine Learning Engineer - Perception at Zoox rates 96 out of 100 for how much of the daily work is AI. That makes it Builds AI (AI Level 4 of 4). The level is about AI in the job, not seniority.

Classification

Builds AI. The job is building AI systems.

●●●● Builds AI80 to 100
●●●○ Works on AI60 to 79
●●○○ Uses AI40 to 59
●○○○ Little AI0 to 39

Levels come from how often the tools, models and workflows of the role are named in the posting itself. Read the description and count the AI tools, models and workflows it names.

Key facts

Senior Staff Machine Learning Engineer - Perception is an open job at Zoox.
Level rates this role AI Level 4 of 4: Builds AI.
The listed salary is $277k-$389k a year.
The role is based in Boston, MA.
The job was posted on November 12, 2024.
Seniority: lead.
Applications are handled by Zoox. Apply on Zoox

Prepare for this job

Built from this posting and from similar jobs on Level.

Skills and AI tools this role asks for

Computer vision

Also common in machine learning engineer jobs at this level

PyTorch LLM TensorFlow AWS Spark Kubernetes

Pay

This job starts at: $277k
Typical machine learning engineer job: $200k

This posting starts 39% above the typical machine learning engineer job. See machine learning engineer jobs

Questions you could be asked

Walk me through a computer vision problem you solved, from raw data to a deployed model.
How would you decide a model or AI system is ready to ship?
Tell me about a time a model underperformed in production. How did you find out, and what did you change?

Adapt your resume

List these exact terms on your resume: Computer vision. An applicant tracking system matches the wording, not the idea.
Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
Lead with what you built, trained or shipped. This role is judged on the AI system itself, not the tools around it.

Get your CV reviewed before you apply

Send your CV and the role you want next. Your review arrives by email within 3 days.

Get a free CV review Check your resume with the ATS resume checker