Intermediate/ Senior Software Engineer - Cortex LLM Training Platform
Snowflake is hiring an Intermediate/ Senior Software Engineer - Cortex LLM Training Platform for a remote role open to applicants in United States. It pays $200k-$288k a year and Level rates it ; you can apply on Snowflake.
Level's read on this job
- Level rates this software engineer role Builds AI ●●●●: the job is building AI systems.
- The listed pay starts 19% above the typical software engineer posting on Level.
- The posting lists this role as remote.
- Tools and skills the posting cites include vLLM, PyTorch and Deepspeed.
- Level lists 367 other open roles at Snowflake.
AI in this role
Design and build distributed infrastructure and APIs for LLM post-training and distributed GPU execution.
At Snowflake, we are powering the era of the agentic enterprise. To usher in this new era, we seek AI-native thinkers across every function who are energized by the opportunity to reinvent how they work. You don’t just use tools; you possess an innate curiosity, treating AI as a high-trust collaborator that is core to how you solve problems and accelerate your impact. We look for low-ego individuals who thrive in dynamic and fast-moving environments and move with an experimental mindset — who rapidly test emerging capabilities to discover simpler, more powerful ways to deliver results. At Snowflake, your role isn't just to execute a function, but to help redefine the future of how work gets done.
Senior Software Engineer — Cortex TrainingThe Snowflake ML Platform team's mission is to let customers run their most demanding ML/AI workloads inside Snowflake. Cortex Training is our LLM post-training platform: it turns scarce, expensive GPU capacity into a simple, composable service, so customers can adapt open-weight foundation models to their own business problems while we handle the hard distributed-systems parts, including scheduling, orchestration, multi-node training and inference, fault tolerance, and throughput.
The platform already runs post-training at scale. Under the hood, it decouples GPU computation from the training loop and exposes it as primitive APIs that compose into everything from SFT to full RL workflows. You'll work alongside a team that ships fast & sweats reliability and the researchers behind DeepSpeed. We're looking for an engineer who thrives in the ML infrastructure layer and brings a solid understanding of LLMs and post-training to help us scale and grow it.
YOU WILL:
Design and build across the full stack — from the public training APIs and SDK through the control plane to the GPU data plane.
Scale the distributed systems that make GPU compute serverless — multi-tenant scheduling, placement, and capacity-aware routing across regional GPU pools, with fault tolerance built in.
Drive end-to-end performance at scale — keep the training, inference, and RL loops fast and the data plane responsive under heavy concurrent load, with GPUs kept saturated.
Productionize research building blocks — partner with Snowflake Research to turn state-of-the-art training and inference techniques into reliable, composable components customers can run at enterprise scale.
QUALIFICATIONS:
3 + years (Intermediate) | 6+ years (Senior) building and shipping production ML systems
Strong distributed systems and infrastructure foundation — designing scalable, fault-tolerant services and operating them on Kubernetes in production.
Familiarity with GPU and LLM infrastructure — e.g., PyTorch, DeepSpeed/FSDP, Ray, CUDA/NCCL, vLLM; able to debug across the data, infrastructure, and GPU layers.
Demonstrated ability to harden complex systems for reliability, throughput, and cost efficiency.
BS in Computer Science or a related field (MS/PhD a plus).
(Bonus) Hands-on LLM post-training / modeling experience — the strongest candidates pair deep infra skills with real post-training intuition.
Snowflake is growing fast, and we’re scaling our team to help enable and accelerate our growth. We are looking for people who share our values, challenge ordinary thinking, and push the pace of innovation while building a future for themselves and Snowflake.
How do you want to make your impact?
For jobs located in the United States, please visit the job posting on the Snowflake Careers Site for salary and benefits information: careers.snowflake.com
How we rate this
Intermediate/ Senior Software Engineer - Cortex LLM Training Platform at Snowflake rates 90 out of 100 for how much of the daily work is AI. That makes it Builds AI (AI Level 4 of 4). The level is about AI in the job, not seniority.
Builds AI. The job is building AI systems.
- ●●●● Builds AI80 to 100
- ●●●○ Works on AI60 to 79
- ●●○○ Uses AI40 to 59
- ●○○○ Little AI0 to 39
Levels come from how often the tools, models and workflows of the role are named in the posting itself. Read the description and count the AI tools, models and workflows it names.
Prepare for this job
Built from this posting and from similar jobs on Level.
Skills and AI tools this role asks for
Pay
- This job starts at
- $200k
- Typical software engineer job
- $168k
This posting starts 19% above the typical software engineer job. See software engineer jobs
Questions you could be asked
- Tell me about a project where distributed systems was part of your work. What did you do?
- Tell me about a project where llm was part of your work. What did you do?
- Tell me about a project where machine learning infrastructure was part of your work. What did you do?
- Tell me about a project where gpu compute was part of your work. What did you do?
- Walk me through how you've used vLLM in your day-to-day work.
Adapt your resume
- List these exact terms on your resume: Distributed Systems, LLM, Machine Learning Infrastructure, GPU Compute, and vLLM. An applicant tracking system matches the wording, not the idea.
- Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
- Lead with what you built, trained or shipped. This role is judged on the AI system itself, not the tools around it.
Want an expert to read your CV for this job?
Free. Send your CV and the role you want next. You get your review by email within 24 hours.
Get new remote software engineer jobs (Builds AI ●●●●) by email
One email a week with the new remote software engineer jobs (Builds AI ●●●●), each rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.
Free. One email a week. Unsubscribe in one click.
Similar roles
Software Engineering roles that build AI, at other companies.
What kind of AI work fits you?
Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.
Find my next step