Director of Quality Engineering
Sword Health is hiring a Director of Quality Engineering for a remote role open to applicants in Portugal. It pays €64k-€101k a year and Level rates it ; you can apply on Sword Health.
Level's read on this job
- Level rates this role Works on AI ●●●○: the daily work is on AI products, without building the model.
- This is listed as a remote role.
- The posting mentions quality assurance, test automation and regulatory compliance among its tools and skills.
- Sword Health has 68 other open roles on Level.
- Posted within the past week.
AI in this role
Lead the end-to-end quality strategy for Software as a Medical Device, AI/ML models, and connected healthcare products at Sword.
At Sword, we’re building AI to heal billions and unlock humanity’s full potential. In doing so, we’re pioneering AI Care, a fundamentally new approach to healthcare built for medical reasoning, safety, and real-time treatment, not generic technology applied after the fact. As both a clinical-centric frontier AI lab and an applied AI platform, Sword is reimagining how care is delivered at scale, removing traditional barriers like appointments, waiting rooms, and stigma so more people can access the care they need—and ultimately get back to lives lived in full.
Since 2020, Sword has expanded across physical therapy, women’s health, cardiometabolic, and mental health, and is now moving beyond the session to a fully AI-native, 24/7 care program that brings physical activity, therapeutic exercise, psychotherapy, nutrition, and behavior change into one connected experience. More than 700,000 members across three continents have completed over 10 million AI sessions, helping 1,000+ enterprise clients avoid more than $1 billion in unnecessary healthcare costs. Backed by 42 clinical studies, 44+ patents, and more than $500 million raised from leading investors including Khosla Ventures, General Catalyst, and Founders Fund, Sword is defining a new standard for healthcare.
AI Proficiency at Sword
AI fluency is a core expectation at Sword. Every candidate is assessed against our three-level framework — be ready to share real examples of how AI is already part of how you work.
-
Explorer (Level 1) — Uses AI daily to boost personal productivity
-
Builder (Level 2) — Creates workflows and tools that elevate the whole team
-
Integrator (Level 3) — Embeds AI into products and processes at scale
Every hire must demonstrate at least Level 1. The expected level will vary depending on the seniority of the role.
Role
We are looking for an experienced Director of QARA (Engineering) to define and lead our end to end quality strategy across our Software as a Medical Device (SaMD) software, AI/ML, and connected-device products. Reporting to the VP of QARA, you will own how we build confidence in what we ship, from test automation and release readiness to verification and validation evidence that satisfies regulators. You will work closely with Engineering, Product, and AI teams to make sure we can move fast and stay compliant.
What you’ll be doing
- Help set the vision for quality in software/AI engineering across web, mobile, backend, firmware/hardware integration, and AI, where quality becomes a natural output of well-designed processes.
- Own software verification and validation (V&V) strategy for Software as a Medical Device (SaMD), ensuring rigorous, bi-directional traceability from requirements and risk controls through to test evidence.
- Help define how AI/ML systems are tested and monitored: model performance validation, dataset quality, bias and robustness testing, regression across model versions, and post-deployment drift and performance monitoring.
- Embed quality into the SDLC: shift-left practices, CI/CD quality gates, automated regression, performance, security, and accessibility testing, with release processes that are fast and auditable.
- Work within QARA to keep engineering processes aligned with the Quality Management System and serve as a technical authority during audits by notified bodies and authorities.
- Drive risk-based thinking, working with product and clinical teams on risk analysis, hazard mitigation, and verification of risk controls under ISO 14971.
- Evaluate and introduce tooling for test management, automation, and automated traceability, balancing build vs. buy.
What you need to have
- 7+ years in software quality engineering, with 5+ years leading quality organizations (managers and ICs) in a regulated environment.
- Hands-on experience with medical device software or comparable regulated domains, including working knowledge of IEC 62304, ISO 13485, ISO 14971, ISO/IEC 42001, IEC 81001-5-1 and FDA 21 CFR Part 820 / QMSR and/or EU MDR.
- Proven track record building and scaling test automation and CI/CD quality practices across multiple product teams.
- Experience defining V&V strategies and producing evidence that stood up to audits or regulatory submissions.
- Strong technical credibility: able to review architectures, test frameworks, and code, and to coach engineers.
- Demonstrated people management capability, with a proven track record as a Team Lead or manager directly hiring, mentoring, and steering technical quality teams.
- Excellent communication and influence skills, with the ability to work with executives, engineers, clinicians, and regulators.
*The range below reflects base, variable, and equity for this role.
This is a starting point, not a ceiling — once someone joins and proves they're outlier talent, we adjust quickly to make sure their compensation matches their impact.
Job titles may span more than one career level, so actual pay depends on skills, qualifications, experience, location, and market demand, among other factors. The range reflects base salary plus any variable, bonus, or sales incentives, and our estimate of the value of private company stock options where applicable. It's subject to change, and future stock value isn't guaranteed. Sword also offers additional benefits beyond total compensation.
Total Compensation Range€64.400—€101.200 EUR Country-specific benefits may vary and will be detailed separately. Sword Health complies with applicable Federal and State civil rights laws and does not discriminate on the basis of Age, Ancestry, Color, Citizenship, Gender, Gender expression, Gender identity, Gender information, Marital status, Medical condition, National origin, Physical or mental disability, Pregnancy, Race, Religion, Caste, Sexual orientation, and Veteran status.How we rate this
Director of Quality Engineering at Sword Health rates 65 out of 100 for how much of the daily work is AI. That makes it Works on AI (AI Level 3 of 4). The level is about AI in the job, not seniority.
Works on AI. The daily work is on AI products, without building the model.
- ●●●● Builds AI80 to 100
- ●●●○ Works on AI60 to 79
- ●●○○ Uses AI40 to 59
- ●○○○ Little AI0 to 39
Levels come from how often the tools, models and workflows of the role are named in the posting itself. Read the description and count the AI tools, models and workflows it names.
Prepare for this job
Built from this posting and from similar jobs on Level.
Skills and AI tools this role asks for
Questions you could be asked
- Tell me about a project where quality assurance was part of your work. What did you do?
- Tell me about a project where test automation was part of your work. What did you do?
- Tell me about a project where regulatory compliance was part of your work. What did you do?
- Tell me about a project where samd was part of your work. What did you do?
- Tell me about a project where ai ml was part of your work. What did you do?
Adapt your resume
- List these exact terms on your resume: Quality Assurance, Test Automation, Regulatory Compliance, Samd, and AI ML. An applicant tracking system matches the wording, not the idea.
- Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
- Show where AI is part of your daily process, not a one-off project. This role expects it to be a running habit.
Get your CV reviewed before you apply
Send your CV and the role you want next. Your review arrives by email within 3 days.
Get new remote software engineering jobs (Works on AI ●●●○ or higher) by email
One email a week, each job rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.
Free.
Similar roles
Software Engineering roles that work on AI, at other companies.
What kind of AI work fits you?
Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.
Find my next step