Senior Software Engineer - Robotics Real2Sim Applications

NVIDIA's Isaac‑NuRec team is building neural reconstruction and Real2Sim systems that turn real‑world sensor data into high‑fidelity, simulation‑ready environments and objects for robotics simulation, learning, and deployment. As a Senior Systems Engineer, you will build dense 3D reconstruction systems, high‑performance simulation workflows, and robotics software that bridge research innovations with production‑grade systems, owning end‑to‑end pipelines that transform sensor streams into structured assets and environment representations for downstream robotic applications. We are looking for strategic, ambitious, and creative individuals passionate about advancing the boundaries of robotics!

What you’ll be doing:

• Build end‑to‑end Real2Sim pipelines that ingest multi‑modal sensor data (RGB/RGB‑D, LiDAR, IMU) and produce high‑fidelity scene and object representations for Isaac Sim.

• Develop neural 3D reconstruction systems and related 3D vision components to build digital twins of real‑world environments and objects.

• Integrate reconstruction outputs with mapping, localization, and multi‑sensor fusion systems for robust perception and navigation.

• Collaborate with ML researchers to integrate, deploy, and optimize workflows to enable training and validation in sim.

• Deploy and optimize reconstruction, data generation, and data augmentation pipelines at scale.

• Optimize, validate, and debug cross‑stack systems spanning sensors, models, simulation, and downstream robot policies.

• Instrument and monitor production Real2Sim and reconstruction services, ensuring reliability, performance, and debuggability in large‑scale deployments.

What we need to see:

• BS, MS, or PhD in Computer Science, Electrical Engineering, Robotics, or related field (or equivalent experience).

• 5+ years in robotics systems, 3D vision, simulation, or closely related software engineering roles.

• Hands-on experience with neural 3D reconstruction, mesh/object reconstruction, or deep‑learning–based 3D vision.

• Exposure to reinforcement or imitation learning workflows for robotic perception and control.

• Experience with ROS 2 and real‑time constraints, plus familiarity with Isaac Sim, Isaac Lab, or MuJoCo.

• Proven ability to drive technical direction or architecture for complex robotics or 3D perception systems, with strong Python and C++ skills and experience shipping production‑quality systems.

Ways to stand out from the crowd:

• Experience with neural scene representations (NeRF, 3D Gaussian Splatting, occupancy networks).

• Experience with object reconstruction and sim‑ready asset generation pipelines (for example, mesh extraction, material and collision setup, USD export).

• Familiarity with multi‑sensor fusion, sim‑to‑real transfer, and data augmentation workflows.

• Experience building or integrating agentic frameworks, including LLM/VLM‑based task planners, tool‑use pipelines, or multi‑step reasoning systems.

• Contributions to robotics or 3D vision open source, or publications at venues such as CVPR, ICCV, ICRA, RSS, or CoRL.

You will also be eligible for equity and benefits.

This posting is for an existing vacancy. 

NVIDIA uses AI tools in its recruiting processes.