Senior AI/ML Platform Engineer
Lyra Health is hiring a Senior AI/ML Platform Engineer for a remote role open to applicants in United States. It pays $143k-$197k a year and Level rates it ; you can apply on Lyra Health.
Level's read on this job
- On Level's scale, this role is Builds AI ●●●●: the job is building AI systems.
- The posting lists this role as remote.
- Tools and skills the posting cites include OpenAI, Anthropic and LangChain.
- Level classifies it as a senior role.
- Level lists 481 other open roles at Lyra Health.
AI in this role
We are looking for an experienced Senior AI/ML Platform Engineer who is eager to build the platforms, infrastructure and services necessary to deliver ML and generative AI based products that make a significant impact within the organization. The ideal candidate will be enthusiastic about taking ownership of their work, spearheading cross-functional projects, and providing guidance and mentorship to other team members.
Lyra is for you if you
-
Thrive on working with brilliant teammates to solve complex, meaningful problems
-
Are passionate about making a social impact and supporting people at their most challenging moments
-
Enjoy cross-functional collaboration with therapists, data scientists, engineers and product managers
In this role, you will
-
Be part of a team working on building our machine learning and generative AI platforms that will be used by teams across the company
-
Create the necessary backend infrastructure to enable scalable, resilient and highly performant solutions
-
Build services that expose machine learning and AI based products
-
Deploy and manage various applications in production
-
And of course, you will be coding every day!
We are looking for someone with:
-
6+ years of experience delivering production ready products
-
Ability to write high-quality code in Python
-
Experience with modern async Python web frameworks (e.g., FastAPI) and handling data streaming (WebSockets, Server-Sent Events)
-
Experience working with Docker and deploying applications to Kubernetes
-
Experience with relational and low-latency databases
-
Experience building RAG based AI solutions
-
Experience setting up and maintaining vector databases
-
Familiarity with LLM orchestration frameworks (e.g., LangChain, LlamaIndex) and integrating with foundation model APIs (e.g., OpenAI, Anthropic, AWS Bedrock)
-
A desire to learn new technologies quickly
-
A love of building systems from scratch
-
A thoughtful approach to balancing quality and deadlines in fast-paced settings
-
Excellent communication skills with a talent for building consensus and alignment
-
Strong organizational skills and the ability to distill complex problems into clear priorities that move the team and business forward
Nice to haves:
-
Experience with Graph Databases (e.g., Neo4j, AWS Neptune) and integrating them into AI/Knowledge systems (e.g., GraphRAG)
-
Experience with LLM observability and monitoring tools (e.g., Langfuse) to track latency, token usage, and output quality.
-
Experience working with Celery
-
Experience defining and using Protobuf messages
-
Experience writing production code in Java/Kotlin
-
Experience building solutions on cloud infrastructure, particularly AWS
-
Experience working with highly sensitive data in a healthcare environment
How we rate this
Senior AI/ML Platform Engineer at Lyra Health rates 86 out of 100 for how much of the daily work is AI. That makes it Builds AI (AI Level 4 of 4). The level is about AI in the job, not seniority.
Builds AI. The job is building AI systems.
- ●●●● Builds AI80 to 100
- ●●●○ Works on AI60 to 79
- ●●○○ Uses AI40 to 59
- ●○○○ Little AI0 to 39
Levels come from how often the tools, models and workflows of the role are named in the posting itself. Read the description and count the AI tools, models and workflows it names.
Prepare for this job
Built from this posting and from similar jobs on Level.
Skills and AI tools this role asks for
Questions you could be asked
- How would you design a retrieval step so the model answers from real data instead of guessing?
- Walk me through how you've used OpenAI in your day-to-day work.
- What are the limits of Anthropic that you've run into, and how did you work around them?
- What's a project where you used LangChain hands-on?
- Walk me through how you've used LlamaIndex in your day-to-day work.
Adapt your resume
- List these exact terms on your resume: RAG, OpenAI, Anthropic, LangChain, and LlamaIndex. An applicant tracking system matches the wording, not the idea.
- Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
- Lead with what you built, trained or shipped. This role is judged on the AI system itself, not the tools around it.
Get your CV reviewed before you apply
Send your CV and the role you want next. Your review arrives by email within 3 days.
Get new remote software engineering jobs (Builds AI ●●●●) by email
One email a week, each job rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.
Free.
Similar roles
Software Engineering roles that build AI, at other companies.
What kind of AI work fits you?
Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.
Find my next step