Senior Software Engineer - Kubernetes AI Infrastructure
NVIDIA is hiring a Senior Software Engineer - Kubernetes AI Infrastructure in Tel Aviv, Israel. Level rates it ; you can apply on NVIDIA.
Level's read on this job
- Builds AI ●●●● is how Level rates this software engineer role: the job is building AI systems.
- The posting mentions Kubernetes, Go and GPU among its tools and skills.
- Level classes it as a senior role.
- NVIDIA has 2,600+ other open roles on Level.
AI in this role
Build the future of AI workload scheduling and infrastructure as a Senior Software Engineer for the KAI-Scheduler project.
KAI-Scheduler is an open-source CNCF project focused on delivering the best scheduling experience for AI workloads on Kubernetes. Adopted by AI frontier labs, leading enterprises, and some of the largest AI infrastructure deployments in the world, KAI helps organizations efficiently run AI at scale.
KAI is designed to support any AI infrastructure—from the latest GPU and networking technologies to future hardware generations—while maximizing performance, utilization, and scalability. As a Senior Software Engineer for KAI, you will help build the future of AI scheduling in the Kubernetes ecosystem, working on challenging problems spanning workload scheduling, Kubernetes internals, and large-scale AI infrastructure.
What you’ll be doing:
- Develop clean, maintainable, and well-tested software in Go.
- Design and implement scalability improvements for KAI, helping it operates efficiently in massive-scale deployments (thousands of nodes) while addressing Kubernetes scaling constraints and bottlenecks.
- Apply strong algorithmic thinking to solve complex AI workload scheduling and placement challenges, balancing performance, fairness, cluster utilization, topology constraints, and scalability.
- Conduct code and design reviews to uphold high-quality standards and mentor team members.
- Work closely with contributors, users, and customers, helping translate feedback from production deployments into product and engineering improvements.
- Collaborate with related upstream projects (schedulers, AI frameworks, cluster autoscalers, Kubernetes SIGs/WGs, etc.) and contribute to community and ecosystem discussions.
What we need to see:
- B.Sc. or M.Sc. in Computer Science or a related field or equivalent experience
- 8+ years of experience in backend software development, including system design and architecture
- 4+ years of advanced Kubernetes development experience, including designing and implementing CRDs and controllers, with deep expertise in Kubernetes internals, networking, storage, and cluster architecture.
- Strong algorithmic skills with experience tackling complex optimization and distributed systems challenges.
- Strong technical skills and a proven ability to collaborate with and mentor other engineers.
We are an equal-opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, sex, gender, gender expression, sexual orientation, age, marital status, veteran status, or disability status. We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation.
How we rate this
Senior Software Engineer - Kubernetes AI Infrastructure at NVIDIA rates 90 out of 100 for how much of the daily work is AI. That makes it Builds AI (AI Level 4 of 4). The level is about AI in the job, not seniority.
Builds AI. The job is building AI systems.
- ●●●● Builds AI80 to 100
- ●●●○ Works on AI60 to 79
- ●●○○ Uses AI40 to 59
- ●○○○ Little AI0 to 39
Levels come from how often the tools, models and workflows of the role are named in the posting itself. Read the description and count the AI tools, models and workflows it names.
Prepare for this job
Built from this posting and from similar jobs on Level.
Skills and AI tools this role asks for
Pay
- Typical software engineer job
- $167k
This posting doesn't list pay. Use the typical software engineer figure when pay comes up. See software engineer jobs
Questions you could be asked
- Tell me about a project where distributed systems was part of your work. What did you do?
- Tell me about a project where cloud native was part of your work. What did you do?
- Tell me about a project where infrastructure was part of your work. What did you do?
- Tell me about a project where software engineering was part of your work. What did you do?
- Walk me through how you've used Kubernetes in your day-to-day work.
Adapt your resume
- List these exact terms on your resume: Distributed Systems, Cloud Native, Infrastructure, Software Engineering, and Kubernetes. An applicant tracking system matches the wording, not the idea.
- Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
- Lead with what you built, trained or shipped. This role is judged on the AI system itself, not the tools around it.
Get new software engineer jobs (Builds AI ●●●●) by email
One email a week, each job rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.
Free.
Similar roles
Software Engineering roles that build AI, at other companies.
What kind of AI work fits you?
Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.
Find my next step