Object Detection and Tracking Engineer (R5244)
Shield AI is hiring an Object Detection and Tracking Engineer (R5244) in London, United Kingdom. Level rates it ; you can apply on Shield AI.
Level's read on this job
- Builds AI ●●●● is how Level rates this role: the job is building AI systems.
- The posting mentions PyTorch, TensorFlow and computer vision among its tools and skills.
- Level classes it as a senior role.
- Shield AI has 659 other open roles on Level.
AI in this role
This position is ideal for an individual who thrives on building advanced perception systems that enable autonomous aircraft to operate effectively in complex and contested environments. A successful candidate will be skilled in developing real-time object detection, sensor fusion, and state estimation algorithms using data from diverse mission sensors such as EO/IR cameras, radars, and IMUs. The role requires strong algorithmic thinking, deep familiarity with airborne sensing systems, and the ability to deliver performant software in simulation and real-world conditions. Our Perception Engineers are instrumental in creating the situational awareness that underpins autonomy, ensuring our systems understand and respond to the operational environment with speed, precision, and resilience.
What you’ll do:
- Develop advanced perception algorithms — Design and implement robust algorithms for object detection, classification, and multi-target tracking across diverse sensor modalities.
- Implement sensor fusion frameworks — Integrate data from vision systems, radars, and other mission sensors using probabilistic and deterministic fusion techniques to generate accurate situational awareness.
- Develop state estimation capabilities — Design and refine algorithms for localization and pose estimation using IMU, GPS, vision, and other onboard sensing inputs to enable stable and accurate navigation.
- Analyze and utilize sensor ICDs — Interpret interface control documents (ICDs) and technical specifications for aircraft-mounted sensors to ensure correct data handling, interpretation, and synchronization.
- Optimize perception performance — Tune and evaluate perception pipelines for performance, robustness, and real-time efficiency in both simulation and real-world environments.
- Support autonomy integration — Work closely with autonomy, systems, and integration teams to interface perception outputs with planning, behaviors, and decision-making modules.
- Validate in simulated and operational settings — Leverage synthetic data, simulation environments, and field testing to validate algorithm accuracy and mission readiness.
- Collaborate with hardware and sensor teams — Ensure seamless integration of perception algorithms with onboard compute platforms and diverse sensor payloads.
- Drive innovation in airborne sensing — Contribute novel ideas and state-of-the-art techniques to advance real-time perception capabilities for unmanned aircraft operating in complex, GPS-denied, or contested environments.
- Travel Requirement – Members of this team typically travel around 10-15% of the year (to different office locations, customer sites, and flight integration events).
Required Qualifications:
- BS/MS in Computer Science, Electrical Engineering, Mechanical Engineering, Aerospace Engineering, and/or similar degree, or equivalent practical experience
- Typically requires a minimum of 10 years of related experience with a Bachelor’s degree; or 9 years and a Master’s degree; or 7 years with a PhD; or equivalent work experience.
- Background in implementing algorithms such as Kalman Filters, multi-target tracking, or deep learning-based detection models.
- Familiarity with fusing data from radar, EO/IR cameras, or other sensors using probabilistic or rule-based approaches.
- Familiarity with SLAM, visual-inertial odometry, or sensor-fused localization approaches in real-time applications.
- Ability to interpret and work with Interface Control Documents (ICDs) and hardware integration specs.
- Proficiency with version control, debugging, and test-driven development in cross-functional teams.
Preferred Qualifications:
- Hands-on integration or algorithm development with airborne sensing systems.
- Experience with ML frameworks such as PyTorch or Tensorflow, particularly for vision-based object detection or classification tasks. * Experience deploying perception software on SWaP-constrained platforms.
- Familiarity with validating perception systems during flight test events or operational environments.
- Understanding of sensing challenges in denied or degraded conditions.
- Exposure to perception applications across air, maritime, and ground platforms.
Why join Shield AI:
- Help build the defining defence technology company of this century.
- Work at the forefront of AI, autonomy, and next-generation defence systems.
- Operate in a highly entrepreneurial and mission-driven environment.
- Make a direct impact on international growth and strategic defence partnerships.
- Collaborate with exceptional teams solving some of the world’s most complex operational challenges.
How we rate this
Object Detection and Tracking Engineer (R5244) at Shield AI rates 88 out of 100 for how much of the daily work is AI. That makes it Builds AI (AI Level 4 of 4). The level is about AI in the job, not seniority.
Builds AI. The job is building AI systems.
- ●●●● Builds AI80 to 100
- ●●●○ Works on AI60 to 79
- ●●○○ Uses AI40 to 59
- ●○○○ Little AI0 to 39
Levels come from how often the tools, models and workflows of the role are named in the posting itself. Read the description and count the AI tools, models and workflows it names.
Prepare for this job
Built from this posting and from similar jobs on Level.
Skills and AI tools this role asks for
Questions you could be asked
- Walk me through a computer vision problem you solved, from raw data to a deployed model.
- Walk me through how you've used PyTorch in your day-to-day work.
- What are the limits of TensorFlow that you've run into, and how did you work around them?
- How would you decide a model or AI system is ready to ship?
- Tell me about a time a model underperformed in production. How did you find out, and what did you change?
Adapt your resume
- List these exact terms on your resume: Computer vision, PyTorch, and TensorFlow. An applicant tracking system matches the wording, not the idea.
- Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
- Lead with what you built, trained or shipped. This role is judged on the AI system itself, not the tools around it.
Get your CV reviewed before you apply
Send your CV and the role you want next. Your review arrives by email within 3 days.
Get new software engineering jobs (Builds AI ●●●●) by email
One email a week, each job rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.
Free.
Similar roles
Software Engineering roles that build AI, at other companies.
What kind of AI work fits you?
Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.
Find my next step