Level

Shield AI

Engineer II, Automated Test (R6288)

Shield AI is hiring an Engineer II, Automated Test (R6288) in San Diego, United States. It pays $110k-$160k a year and Level rates it ; you can apply on Shield AI.

Level's read on this job

  • Uses AI ●●○○ is how Level rates this role: an ordinary role that requires AI tools.
  • The posting mentions Claude, Claude Code and Codex among its tools and skills.
  • Level classes it as a mid-level role.
  • Shield AI has 666 other open roles on Level.
  • Posted within the past two weeks.

AI in this role

Design automated testing and CI/CD infrastructure for autonomy platforms using AI-assisted engineering workflows.

claudeclaude-codecodexpythonci-cd
ai-automationautomated-testingsoftware-engineeringdistributed-systemsai-assisted-engineering
Shield AI is a venture-backed defense-tech company with the mission of protecting service members and civilians with intelligent systems. Its products include Hivemind autonomy software, V-BAT and X-BAT aircraft, and Aechelon simulation and synthetic reality technologies. With offices and facilities across the U.S., Europe, the Middle East, and Asia-Pacific, Shield AI’s technology actively supports operations worldwide. For more information, visit www.shield.ai. Follow Shield AI on LinkedIn, X, Instagram, and YouTube. 

Job Description:

The Hivemind Software Engineering Integration and Test team is seeking an Automated Test Engineer to design, develop, and scale advanced automated testing and CI/CD infrastructure for our next-generation autonomy platform. You will help develop test frameworks that enable this software ecosystem to create, test and deploy resilient autonomy capabilities for unmanned aircraft and robotic platforms operating in complex, contested, and GPS-denied environments. You will work with a robust suite of autonomy and mission software components, including production flight code, simulation and synthetic environment tooling, mission planning and orchestration systems, operator-facing Ground Control Station (GCS) applications, telemetry and data pipelines, and cloud-native developer infrastructure. 

In this role, you will help ensure the reliability, scalability, and quality of the Hivemind ecosystem through advanced automation, validation infrastructure, and AI-assisted engineering workflows. You will develop automated test frameworks, CI/CD systems, and verification tooling that support distributed autonomy software spanning onboard edge compute, APIs, web-based operator interfaces, simulation environments, and hardware-in-the-loop systems. Working closely with software, autonomy, simulation, and systems engineering teams, you will contribute to a high-assurance development environment focused on mission-critical reliability, rapid iteration, and engineering excellence. The ideal candidate has strong experience in Python-based automation, distributed systems testing, developer tooling, and modern CI/CD practices, along with an interest in autonomy, aerospace, robotics, or safety-critical software systems. Experience leveraging AI-assisted development and intelligent automation tools to accelerate testing, debugging, analytics, and developer productivity is highly valued. 

What you'll do:

  • Design, develop, and maintain automated test frameworks for Autonomy and UI applications.  
  • Develop scalable automated test infrastructure for functional, integration, regression, system, and end-to-end testing across distributed software and hardware environments.  
  • Create and maintain CI/CD pipelines in GitLab using YAML configurations and shell scripting to support automated build, test, and deployment workflows.  
  • Build workflow automation tools and utilities in Python to improve test execution efficiency, reporting, environment setup, and developer productivity.  
  • Develop and maintain UI and API test automation using Go and TypeScript for modern web-based operator interfaces and mission control applications.  
  • Integrate automated testing into continuous integration environments to support rapid software delivery and high reliability standards.  
  • Collaborate closely with software, autonomy, simulation, and systems engineering teams to define verification strategies and improve software quality throughout the development lifecycle.  
  • Develop automated validation solutions for safety-critical and mission-critical aerospace software systems.  
  • Create test harnesses, simulators, stubs, and mocks to support automated verification in both simulated and hardware-in-the-loop (HIL) environments.  
  • Analyze test results, troubleshoot failures, and work with development teams to isolate root causes and improve system reliability.  
  • Improve test coverage, execution speed, maintainability, and observability of automated test systems.  
  • Contribute to software quality standards, coding best practices, and automation architecture decisions.  
  • Maintain clear technical documentation for test frameworks, automation workflows, CI/CD infrastructure, and validation procedures.  
  • Support release qualification activities and ensure traceability between requirements, tests, and verification results where applicable.  
  • Represent the Integration and Test Role in design reviews and advocate for a culture of engineering excellence and continuous improvement.  
  • Develop AI-assisted engineering workflows and analytics tools using modern coding agents such as Claude Code, Codex, and related LLM-based development platforms to improve test generation, failure triage, debugging, and developer productivity.  
  • Design intelligent automation pipelines that leverage AI-assisted code generation, log analysis, test analysis, and workflow orchestration to accelerate software verification and validation processes.  
  • Evaluate and integrate emerging AI-driven software engineering tools into automated test and CI/CD ecosystems while maintaining reliability, traceability, and engineering quality standards. 

Required qualificatons:

  • 2+ years of experience building scalable, maintainable automation frameworks and/or developer tooling in Python.  
  • 2+ years of experience working with package management, dependency management, and build systems using tools such as conan, pip, setuptools, poetry, and nix or similar. 
  • 2+ years of experience building tooling for automated log collection, analytics, reporting, and failure triage. 
  • Strong understanding of asynchronous and concurrent programming in Python for scalable automation and parallel test execution.  
  • Experience developing and maintaining CI/CD pipelines using GitLab CI, YAML, and shell scripting.  
  • Experience with automated testing of distributed systems, backend services, APIs, and web-based UIs.  
  • Familiarity with modern test frameworks, automated validation strategies, and software quality methodologies.  
  • Experience working in Linux-based development environments.  
  • Strong debugging and problem-solving skills in complex software systems.  
  • Excellent collaboration and communication skills in cross-functional engineering environments.  

Preferred qualifications:

  • Experience integrating Python with native C/C++ libraries and applications using bindings, wrappers, subprocess interfaces, or interoperability tooling. 
  • Proficiency with Go and/or TypeScript for automation tooling or UI test development. 
  • Experience with C++ development or testing.  
  • Aerospace, robotics, autonomy, or safety-critical software experience.  
  • Familiarity with simulation, hardware-in-the-loop (HIL), or embedded system testing. 
#LI-DS5 #LB
Full-time regular employee offer package: Pay within range listed + Bonus + Benefits + Equity   Temporary employee offer package: Pay within range listed above + temporary benefits package (applicable after 60 days of employment)   Salary compensation is influenced by a wide array of factors including but not limited to skill set, level of experience, licenses and certifications, and specific work location. All offers are contingent on a cleared background and possible reference check. Military fellows and part-time employees are not eligible for benefits. Please speak to your talent acquisition representative for more information.   ###   Shield AI is proud to be an equal opportunity workplace and is an affirmative action employer. We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, marital status, disability, gender identity or Veteran status. If you have a disability or special need that requires accommodation, please let us know. 

How we rate this

Engineer II, Automated Test (R6288) at Shield AI rates 40 out of 100 for how much of the daily work is AI. That makes it Uses AI (AI Level 2 of 4). The level is about AI in the job, not seniority.

Classification

Uses AI. An ordinary role that requires AI tools.

  1. ●●●● Builds AI80 to 100
  2. ●●●○ Works on AI60 to 79
  3. ●●○○ Uses AI40 to 59
  4. ●○○○ Little AI0 to 39

Levels come from how often the tools, models and workflows of the role are named in the posting itself. Read the description and count the AI tools, models and workflows it names.

Prepare for this job

Built from this posting and from similar jobs on Level.

Skills and AI tools this role asks for

AI AutomationAutomated TestingSoftware EngineeringDistributed SystemsAI Assisted EngineeringClaudeClaude CodeCodex

Questions you could be asked

  1. Tell me about a workflow you automated with AI tools, end to end.
  2. Tell me about a project where automated testing was part of your work. What did you do?
  3. Tell me about a project where software engineering was part of your work. What did you do?
  4. Tell me about a project where distributed systems was part of your work. What did you do?
  5. Tell me about a project where ai assisted engineering was part of your work. What did you do?

Adapt your resume

  • List these exact terms on your resume: AI Automation, Automated Testing, Software Engineering, Distributed Systems, and AI Assisted Engineering. An applicant tracking system matches the wording, not the idea.
  • Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
  • Put the AI tool in a bullet point about what you did, not just in a skills list. This role treats it as a required part of the job.

Want an expert to read your CV for this job?

Free. Send your CV and the role you want next. We reply by email within 2 to 4 business days.

Get new software engineering jobs (Uses AI ●●○○ or higher) by email

One email a week with the new software engineering jobs (Uses AI ●●○○ or higher), each rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.

Free. One email a week. Unsubscribe in one click.

Similar roles

Software Engineering roles that use AI, at other companies.

What kind of AI work fits you?

Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.

Find my next step

More jobs at Shield AI

Related searches

Same AI level

Jobs by city