Staff ML Engineer (ML/AI)
Lyra Health is hiring a Staff ML Engineer (ML/AI) for a remote role open to applicants in United States. It pays $161k-$222k a year and Level rates it ; you can apply on Lyra Health.
Level's read on this job
- On Level's scale, this machine learning engineer role is Builds AI ●●●●: the job is building AI systems.
- This is listed as a remote role.
- The posting mentions RAG, fine tuning and MLOps among its tools and skills.
- Level classes it as a lead role.
- Lyra Health has 480 other open roles on Level.
AI in this role
About the Role
We are seeking a Staff ML/AI Engineer to define and drive the architectural vision for Lyra’s machine learning and generative AI technology landscape. In this role, you will serve as a technical anchor across the engineering and data organizations—architecting enterprise-scale AI platforms, setting technical strategy for high-impact AI/ML initiatives, and ensuring our AI products operate with top-tier reliability, security, and medical precision.
The ideal candidate is a seasoned technical leader who excels at translating complex healthcare challenges into scalable platform solutions, building consensus across cross-functional leadership, and elevating the technical bar for the entire engineering organization.
Lyra is for you if you
-
Thrive on working with brilliant teammates to solve complex, meaningful problems
-
Are passionate about making a social impact and supporting people at their most challenging moments
-
Enjoy cross-functional collaboration with physicians, therapists, data scientists, data analysts and product managers
Responsibilities
-
Drive AI Platform Architecture: Design and execute the long-term roadmap for Lyra’s machine learning and generative AI platform, enabling fast, safe, and reliable deployment of frontier models across the company.
-
Lead AI Infrastructure Vision: Architect end-to-end training, fine-tuning, and low-latency inference platforms, including centralized RAG architecture, vector databases, and enterprise evaluation/guardrail frameworks.
-
Set Engineering Excellence Standards: Establish organizational standards for the full AI/ML SDLC—from dataset lineage and CI/CD pipelines to automated model evaluation, red-teaming, and production monitoring.
-
Cross-Functional Technical Leadership: Partner closely with Product Management, Data Science, Security, and Clinical leaders to translate strategic clinical goals into foundational AI capability roadmaps.
-
Mentor and Multiply Impact: Elevate the engineering culture by mentoring Senior ML Engineers, conducting high-leverage architectural reviews, and establishing engineering best practices across teams.
-
Hands-On Leadership: Lead by example through technical prototypes, critical-path architecture, and strategic coding contributions.
-
And of course, you will be coding!
Qualifications
-
8+ years of experience deploying complex ML/AI solutions into mission-critical production environments, with a proven track record of technical leadership.
-
Deep System & Software Engineering Expertise: Mastery of Python, RESTful API design, Protobuf, and microservices architecture.
-
Production AI/ML Infrastructure Mastery: Deep expertise with Docker, Kubernetes, container orchestration, and real-time inference services.
-
Modern Generative AI Architecture: Hands-on experience designing and deploying RAG pipelines, fine-tuning LLMs, managing vector databases, and building robust LLM evaluation/guardrail frameworks.
-
Data Layer Systems: Expertise with relational databases, low-latency key-value stores, distributed queueing system architectures (e.g., Celery, Kafka), and data pipeline orchestration.
-
Cloud Architecture: Strong experience architecting cloud-native solutions on AWS (or equivalent cloud providers).
-
Strategic Communication: Exceptional ability to distill highly ambiguous technical problems into clear strategic priorities and influence leadership across engineering, product, and business domain disciplines.
Preferred Qualifications
-
Polyglot Engineering Background: Experience writing high-performance production code in Java or Kotlin.
-
Healthcare & Sensitive Data Expertise: Experience architecting AI/ML systems within highly regulated environments (HIPAA compliance, SOC2, handling PHI/PII).
-
MLOps / Platform Productization: Experience building internal developer platforms or ML tooling used by dozens of data scientists and engineers.
How we rate this
Staff ML Engineer (ML/AI) at Lyra Health rates 92 out of 100 for how much of the daily work is AI. That makes it Builds AI (AI Level 4 of 4). The level is about AI in the job, not seniority.
Builds AI. The job is building AI systems.
- ●●●● Builds AI80 to 100
- ●●●○ Works on AI60 to 79
- ●●○○ Uses AI40 to 59
- ●○○○ Little AI0 to 39
Levels come from how often the tools, models and workflows of the role are named in the posting itself. Read the description and count the AI tools, models and workflows it names.
Prepare for this job
Built from this posting and from similar jobs on Level.
Skills and AI tools this role asks for
Also common in machine learning engineer jobs at this level
Pay
- This job starts at
- $161k
- Typical machine learning engineer job
- $200k
This posting starts 19% below the typical machine learning engineer job. See machine learning engineer jobs
Questions you could be asked
- How would you design a retrieval step so the model answers from real data instead of guessing?
- Walk me through fine-tuning a model: what data did you use, and how did you check the result?
- How do you monitor a model once it's live, and how do you know it needs retraining?
- How do you decide that one model's output is better than another's for a given task?
- How would you decide a model or AI system is ready to ship?
Adapt your resume
- List these exact terms on your resume: RAG, Fine-tuning, ML Ops, and AI Evaluation. An applicant tracking system matches the wording, not the idea.
- Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
- Lead with what you built, trained or shipped. This role is judged on the AI system itself, not the tools around it.
Want an expert to read your CV for this job?
Free. Send your CV and the role you want next. You get your review by email within 24 hours.
Get new remote machine learning engineer jobs (Builds AI ●●●●) by email
One email a week with the new remote machine learning engineer jobs (Builds AI ●●●●), each rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.
Free. One email a week. Unsubscribe in one click.
Similar roles
Data roles that build AI, at other companies.
What kind of AI work fits you?
Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.
Find my next step