Software Engineer - Perception (Fallback Stack)
Applied Intuition is hiring a Software Engineer - Perception (Fallback Stack) in Sunnyvale, United States. It pays $150k-$250k a year and Level rates it ; you can apply on Applied Intuition.
Level's read on this job
- Level rates this software engineer role Builds AI ●●●●: the job is building AI systems.
- Tools and skills the posting cites include PyTorch, TensorFlow and Docker.
- Level classifies it as a senior role.
- Level lists 327 other open roles at Applied Intuition.
AI in this role
Design, train, and deploy deep learning models for 3D object detection and sensor fusion in autonomous vehicle perception stacks.
Applied Intuition, Inc. is powering the future of physical AI. Founded in 2017 and now valued at $15 billion, the Silicon Valley company is creating the digital infrastructure needed to bring intelligence to every moving machine on the planet. Applied Intuition services the automotive, defense, trucking, construction, mining and agriculture industries in three core areas: tools and infrastructure, operating systems, and autonomy. Eighteen of the top 20 global automakers, as well as the United States military and its allies, trust the company’s solutions to deliver physical intelligence. Applied Intuition is headquartered in Sunnyvale, California, with offices in Washington, D.C.; San Diego; Ft. Walton Beach, Florida; Ann Arbor, Michigan; London; Stuttgart; Munich; Stockholm; Bangalore; Seoul; and Tokyo. Learn more at applied.co.
We are an in-office company, and our expectation is that full-time employees primarily work from their Applied Intuition office 5 days a week. However, we also recognize the importance of flexibility and trust our employees to manage their schedules responsibly. This may include occasional remote work, starting the day with morning meetings from home before heading to the office, or leaving earlier when needed to accommodate family commitments. This in-office expectation does not apply to contractor positions
About the role
As a Perception Software Engineer on the Autonomy team, you will build the perception system for L4 autonomous trucks operating at highway speeds. The stack combines state-of-the-art machine learning - multi-modal 3D detection, BEV representations, learned tracking - with rigorous classical perception: state estimation, multi-object tracking, and sensor fusion. You will own problems end-to-end, from model architecture and training through onboard deployment and on-road validation. This is safety-critical software: every capability passes formal simulation, closed-course, and safety sign-off gates before it reaches public roads.
You will collaborate daily with behavior/planning engineers, systems and safety engineers, and validation teams.
At Applied Intuition, you will:
Design, train, and deploy deep learning models for 3D object detection across LiDAR, camera, and radar sensors
Build multi-sensor fusion architectures that combine independent detection and classification streams
Characterize perception failure modes, build targeted evaluation sets, and hill-climb system-level metrics
Build and operate the data engine: shadow-mode comparison against production, automated data mining, and retraining loops
Contribute to camera- and LiDAR-based localization perception under degraded conditions
Take your work through the full safety validation pipeline before it operates on public roads
We're looking for someone who has:
Bachelor's degree in Computer Science, Robotics, Electrical Engineering, or a related field
4+ years of professional experience in ML-based perception, computer vision, or robotics
Strong proficiency in Python and C++
Hands-on experience training and deploying deep learning models in production (e.g., PyTorch)
Solid grounding in classical perception: multi-object tracking, state estimation, and 3D geometry
Nice to have:
Experience working in modern ML-based perception for autonomous systems
Experience with multi-sensor calibration and fusion
Experience optimizing models for onboard/embedded GPU inference
Background in safety-critical or automotive software development
Experience in a startup or fast-paced environment
Compensation at Applied Intuition for eligible roles includes base salary, equity, and benefits. Base salary is a single component of the total compensation package, which may also include equity in the form of options and/or restricted stock units, comprehensive health, dental, vision, life and disability insurance coverage, 401k retirement benefits with employer match, learning and wellness stipends, and paid time off. Note that benefits are subject to change and may vary based on jurisdiction of employment.
Applied Intuition pay ranges reflect the minimum and maximum intended target base salary for new hire salaries for the position. The actual base salary offered to a successful candidate will additionally be influenced by a variety of factors including experience, credentials & certifications, educational attainment, skill level requirements, interview performance, and the level and scope of the position.
Don’t meet every single requirement? If you’re excited about this role but your past experience doesn’t align perfectly with every qualification in the job description, we encourage you to apply anyway. You may be just the right candidate for this or other roles.
Applied Intuition is an equal opportunity employer and federal contractor or subcontractor. Consequently, the parties agree that, as applicable, they will abide by the requirements of 41 CFR 60-1.4(a), 41 CFR 60-300.5(a) and 41 CFR 60-741.5(a) and that these laws are incorporated herein by reference. These regulations prohibit discrimination against qualified individuals based on their status as protected veterans or individuals with disabilities, and prohibit discrimination against all individuals based on their race, color, religion, sex, sexual orientation, gender identity or national origin. These regulations require that covered prime contractors and subcontractors take affirmative action to employ and advance in employment individuals without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, protected veteran status or disability. The parties also agree that, as applicable, they will abide by the requirements of Executive Order 13496 (29 CFR Part 471, Appendix A to Subpart A), relating to the notice of employee rights under federal labor laws.
FOR US-BASED ROLES: Applied Intuition is committed to providing an accessible and inclusive application and interview experience to applicants who are disabled veterans and other applicants with disabilities or medical conditions. Reasonable accommodations are available, requesting an accommodation will not affect your candidacy in any way, and you are not required to disclose the nature of your disability or medical condition in order to make a request. If you require an accommodation please contact careers@applied.co. We will work with you!
How we rate this
Software Engineer - Perception (Fallback Stack) at Applied Intuition rates 95 out of 100 for how much of the daily work is AI. That makes it Builds AI (AI Level 4 of 4). The level is about AI in the job, not seniority.
Builds AI. The job is building AI systems.
- ●●●● Builds AI80 to 100
- ●●●○ Works on AI60 to 79
- ●●○○ Uses AI40 to 59
- ●○○○ Little AI0 to 39
Levels come from how often the tools, models and workflows of the role are named in the posting itself. Read the description and count the AI tools, models and workflows it names.
Prepare for this job
Built from this posting and from similar jobs on Level.
Skills and AI tools this role asks for
Also common in software engineer jobs at this level
Pay
- This job starts at
- $150k
- Typical software engineer job
- $168k
This posting starts 11% below the typical software engineer job. See software engineer jobs
Questions you could be asked
- Walk me through a computer vision problem you solved, from raw data to a deployed model.
- Tell me about a project where deep learning was part of your work. What did you do?
- Tell me about a project where sensor fusion was part of your work. What did you do?
- Tell me about a project where 3d detection was part of your work. What did you do?
- Tell me about a project where state estimation was part of your work. What did you do?
Adapt your resume
- List these exact terms on your resume: Computer vision, Deep learning, Sensor Fusion, 3d Detection, and State Estimation. An applicant tracking system matches the wording, not the idea.
- Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
- Lead with what you built, trained or shipped. This role is judged on the AI system itself, not the tools around it.
Want an expert to read your CV for this job?
Free. Send your CV and the role you want next. We reply by email within 2 to 4 business days.
Get new software engineer jobs (Builds AI ●●●●) by email
One email a week with the new software engineer jobs (Builds AI ●●●●), each rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.
Free. One email a week. Unsubscribe in one click.
Similar roles
Software Engineering roles that build AI, at other companies.
What kind of AI work fits you?
Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.
Find my next step