Senior Software Engineer - IT Infrastructure
NVIDIA is hiring a Senior Software Engineer - IT Infrastructure in Bengaluru, India. Level rates it ; you can apply on NVIDIA.
Level's read on this job
- Uses AI ●●○○ is how Level rates this software engineer role: an ordinary role that requires AI tools.
- The posting mentions LangChain, LlamaIndex and AutoGen among its tools and skills.
- Level classes it as a senior role.
- NVIDIA has 2,700+ other open roles on Level.
- Posted within the past two weeks.
AI in this role
Design and operate storage and automation platforms integrating intelligent observability and agentic AI workflows for infrastructure.
We are seeking a Senior Software Engineer with strong infrastructure expertise to design, build, and operate the next generation of our enterprise Automation, and AI-driven Reliability Platform.
This role involves developing and implement innovative architecture and software for large-scale storage and backup services, ensuring continuous availability, performance, and self-service for all key services supporting our AI/ML, Software and engineering teams. This position offers a rare chance to contribute to revenue-driving initiatives and the foundation of our engineering services.
What you'll be doing:
- Develop and manage enterprise-scale platforms that unify storage infrastructure and services, integrating enterprise appliances, networks, and open-source technologies.
- Develop and scale REST APIs in Python/Go, enabling thousands of engineers to seamlessly run on-demand storage workflows.
- Automate storage operations — provisioning, monitoring, metrics, telemetry, and solving — ensuring high reliability and performance.
- Integrate intelligent observability and tracing into workflows to improve accuracy, reduce latency, and optimize efficiency across infrastructure services.
- Implement agentic workflows that empower self-healing, proactive remediation, and automation to decrease operational overhead.
- Build proof-of-concept integrations between infrastructure services and emerging agentic AI frameworks, laying the foundation for intelligent infrastructure platforms.
- Document practices and procedures, evaluate new technologies, and drive adoption of next-gen automation in enterprise storage services.
What we need to see:
- BS in Computer Science (or equivalent experience) with 12+ years of relevant experience, MS with 10+ years, or Ph.D. with 8+ years.
- Extensive expertise building large-scale, multi-threaded, distributed backend systems.
- Experience designing and building RESTful APIs using Python or Go.
- Familiarity with containerization & orchestration (Docker, Kubernetes).
- Exposure to cloud platforms (AWS, Azure, GCP).
- Experience with telemetry stacks (Prometheus, Grafana, Alert manager, ELK/Kibana).
- Ability to collaborate across teams and communicate technical solutions effectively.
- Growth mindset to quickly adopt new frameworks in observability, AI automation, and infrastructure management.
Ways to stand out from the crowd:
- Contributions to open-source projects (infrastructure, storage, or Python-based libraries).
- Strong background in Linux storage systems and solving at enterprise scale.
- Experience with Enterprise NAS (NetApp, Pure Storage), distributed filesystems (Lustre, GPFS, Ceph), or S3-compatible object storage.
- Experience with GenAI/agentic application frameworks (LangChain, LlamaIndex, AutoGen) or observability platforms (LangSmith, Arize Phoenix, W&B Weave).
- Proven track record to prototype and productionize intelligent automation workflows, especially for self-service, large-scale infrastructure.
NVIDIA is widely considered to be one of the technology world’s most desirable employers. NVIDIA offers highly competitive salaries and a comprehensive benefits package. We have some of the most forward-thinking people in the world working for us. If you're creative and autonomous, we want to hear from you!
We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.
How we rate this
Senior Software Engineer - IT Infrastructure at NVIDIA rates 55 out of 100 for how much of the daily work is AI. That makes it Uses AI (AI Level 2 of 4). The level is about AI in the job, not seniority.
Uses AI. An ordinary role that requires AI tools.
- ●●●● Builds AI80 to 100
- ●●●○ Works on AI60 to 79
- ●●○○ Uses AI40 to 59
- ●○○○ Little AI0 to 39
Levels come from how often the tools, models and workflows of the role are named in the posting itself. Read the description and count the AI tools, models and workflows it names.
Prepare for this job
Built from this posting and from similar jobs on Level.
Skills and AI tools this role asks for
Also common in software engineer jobs at this level
Pay
- Typical software engineer job
- $168k
This posting doesn't list pay. Use the typical software engineer figure when pay comes up. See software engineer jobs
Questions you could be asked
- How do you decide when an AI agent can act on its own versus asking for approval first?
- Tell me about a workflow you automated with AI tools, end to end.
- Tell me about a project where distributed systems was part of your work. What did you do?
- Tell me about a project where rest apis was part of your work. What did you do?
- Tell me about a project where infrastructure was part of your work. What did you do?
Adapt your resume
- List these exact terms on your resume: AI agents, AI Automation, Distributed Systems, REST APIs, and Infrastructure. An applicant tracking system matches the wording, not the idea.
- Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
- Put the AI tool in a bullet point about what you did, not just in a skills list. This role treats it as a required part of the job.
Want an expert to read your CV for this job?
Free. Send your CV and the role you want next. We reply by email within 2 to 4 business days.
Get new software engineer jobs (Uses AI ●●○○ or higher) by email
One email a week with the new software engineer jobs (Uses AI ●●○○ or higher), each rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.
Free. One email a week. Unsubscribe in one click.
Similar roles
Software Engineering roles that use AI, at other companies.
What kind of AI work fits you?
Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.
Find my next step