Level

TruvetaPosted 3mo ago

Senior Software Engineer - ML Ops

Senior Software Engineer - ML Ops at Truveta scores 68 out of 100 on AI centrality, which makes it AI Level 3 of 4 (Works on AI) on this board. The level measures how much of the work is AI, not seniority.

Seattle, WAsenior$155k-$190k

AI in this role

vllm
ml-ops

Senior Software Engineer - ML Ops

Truveta is the world’s first health provider led data platform with a vision of Saving Lives with Data. Our mission is to enable researchers to find cures faster, empower every clinician to be an expert, and help families make the most informed decisions about their care. Achieving Truveta’ s ambitious vision requires an incredible team of talented and inspired people with a special combination of health, software and big data experience who share our company values.

This position is based out of our headquarters in the Greater Seattle area.  #LI-hybrid

Who We Need 

Truveta is rapidly building a talented and diverse team to tackle complex health and technical challenges. We are seeking candidates inspired by the opportunity to apply data in the development of real-world health solutions. Beyond core capabilities, we are seeking problem solvers, passionate and collaborative teammates, and those willing to roll up their sleeves while making a difference.   

If you are interested in the opportunity to pursue purposeful work, join a mission-driven team, and build a rewarding career while having fun, Truveta may be the perfect fit for you.  

This Opportunity 

If you are seeking a sense of purpose in your software job and are motivated by solving computing problems that can have a direct impact on people’s lives, then we have opportunities for you in an exciting startup environment. 

We are looking for a Senior Engineer to participate in note processor. This role requires deep technical expertise in cloud-native infrastructure, distributed systems, as well as strong product thinking. You will partner closely with Compute Platform, security, ML engineering, and applied AI teams to understand business needs, define platform requirements, and build self-service capabilities that help teams move quickly and safely. Success in this role will directly influence how Truveta delivers data at using AI development and tools.

Responsibilities

  • Leverage software engineering skills to build and deliver reliable, secure and scalable software solutions using modern cloud-based paradigms across different components in Truveta.
  • Collaborate closely with partner teams inside & outside of Truveta.
  • Show creativity and curiosity to build integration proof of concepts across the Truveta and partner ecosystems.
  • Bring your curiosity, entrepreneurial spirit, and passion to deliver on the promise of technology in the difficult, competitive, and exciting industry of healthcare.

We are seeking software engineers who:

  • Have proven experience designing and building reliable, secure, and scalable software solutions using modern cloud-based architectures and engineering practices.
  • Have hands-on experience with machine learning infrastructure, including scaling GPU resources to optimize model throughput, performance, and efficiency at scale.
  • Are familiar with vLLM and GPU optimization techniques, with an understanding of how to maximize compute utilization and improve inference performance.
  • Have experience working with large language models (LLMs), generative AI, and related applications.
  • Have experience deploying and operating large-scale machine learning models in production environments.
  • Ideally, have prior experience building or working with agentic AI platforms and systems.
  • Are quick learners who can iterate on and evolve distributed software systems while thoughtfully balancing privacy, security, reliability, and rapidly changing product requirements.
  • Have strong knowledge of distributed systems, data pipelines, APIs, and data consumption experiences, with experience designing and building these systems at scale.
  • Demonstrate a strong commitment to the Truveta principles and to advancing responsible and ethical innovation.
  • Are committed to ongoing learning and training in critical areas such as privacy, ethics, and security.

Key Qualifications: 

  • 5+ years of experience building production quality software in a team setting. 
  • 2+ years of experience working on modern cloud-native platforms and languages (AWS, GCP, Azure) 
  • Some familiarity with crafting modular APIs and building engaging and intuitive web experiences.
  • B.S. or M.S. in Computer Science or related field.

Why Truveta?

Be a part of building something special. Now is the perfect time to join Truveta. We have strong, established leadership with decades of success. We are well-funded. We are building a culture that prioritizes people and their passions across personal, professional, and everything in between. Join us as we build an amazing company together.

We Offer:

  • Interesting and meaningful work for every career stage
  • Great benefits package
  • Comprehensive benefits with strong medical, dental and vision insurance plans
  • 401K plan
  • Professional development & training opportunities for continuous learning
  • Work/life autonomy via flexible work hours and flexible paid time off
  • Generous parental leave
  • Regular team activities (virtual and in-person)
  • The base pay for this position is $155,000 to $190,000. The pay range reflects the minimum and maximum target. Pay is based on several factors including location and may vary depending on job-related knowledge, skills, and experience. Certain roles are eligible for additional compensation such as incentive pay and stock options.

If you are based in California, we encourage you to read this important information for California residents linked here.

Truveta is committed to creating a diverse, inclusive, and empowering workplace. We believe that having employees, interns, and contractors with diverse backgrounds enables Truveta to better meet our mission and serve patients and health communities around the world. We recognize that opportunities in technology historically excluded and continue to disproportionately exclude Black and Indigenous people, people of color, people from working class backgrounds, people with disabilities, and LGBTQIA+ people. We strongly encourage individuals with these identities to apply even if you don’t meet all of the requirements.

Please note that all applicants must be authorized to work in the United States for any employer as we are unable to sponsor work visas or permits (e.g. F-1 OPT, H1-B) at this time. We appreciate your interest in the position and encourage you to explore future opportunities with us.

 

Prepare for this job

A free preview built only from this posting: what it asks for, what you could be asked in an interview, and how to adjust your resume.

Skills and AI tools this role asks for

Ml OpsvLLM

Questions you could be asked

  1. How do you monitor a model once it's live, and how do you know it needs retraining?
  2. Walk me through how you've used vLLM in your day-to-day work.
  3. Describe a typical day in a role like this one: which parts run through AI directly?
  4. If you removed AI from this role, what would be left, and how do you decide what still needs a human?

Adapt your resume

  • List these exact terms on your resume: Ml Ops and vLLM. An applicant tracking system matches the wording, not the idea.
  • Attach one line of real, concrete experience to at least one of them — a tool named with nothing behind it rarely survives a human read.
  • Show where AI is part of your daily process, not a one-off project — this role expects it to be a running habit.

Want your resume actually rewritten for this job?

The free preview above is everything we have today. A full resume rewrite is not live yet and has no price set. Join the waitlist and we will email you if we open it.

Similar roles

Software Engineering roles rated AI Level 3 at other companies.

What kind of AI work fits you?

Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.

Find my next step

More jobs at Truveta

Related searches

Same AI level