Level

Intel

AI Software Architect

Intel is hiring an AI Software Architect in Bengaluru, India. Level rates it ; you can apply on Level.

AI in this role

vllmpytorch
fine-tuning
Job Details:

Job Description: 

The Role and Impact
We are seeking a dynamic AI Software Architect to contribute to Intel's cutting-edge AI frameworks software stack. In this role, you will design, develop, and optimize software features for AI frameworks, focusing on inference serving frameworks like PyTorch vLLM and SGLang. You will play a key role in enhancing deep learning inference and training/fine-tuning capabilities, while identifying optimization opportunities to boost workload performance across software and hardware layers.

Business Group
The position is part of Intel's Data Center Group (DCG), a global leader in driving innovation across data center platforms. The AI Software Architects team focuses on advancing AI software solutions to enable Intel's AI accelerators and next-generation GPUs, supporting Intel's mission to shape the future of technology for data-driven industries.

Key Responsibilities
- Design and develop software features for AI frameworks, including hardware-agnostic and hardware-aware capabilities.
- Architect and analyze state-of-the-art features across frameworks to drive development throughout the software stack.
- Enhance and extend deep learning training and inference capabilities within Intel's AI frameworks software stack.
- Optimize software stack performance for deep learning workloads on GPUs and AI accelerators.
- Participate in discussions and development within open-source communities, contributing to upstream adoption and integration.
- Debug complex issues in multi-layered software systems and ensure seamless integration within large open-source frameworks.
- Conduct performance analysis using open-source and proprietary profilers to optimize code efficiency on host and accelerator platforms.
- Build technology demonstrators and proof-of-concepts for new features in the Intel AI Software Stack for current and upcoming GPUs

Qualifications:

Minimum Qualifications
- Bachelor's degree in Computer Science, Electrical and Computer Engineering, or related fields with 6+ years of industry experience; or Master's degree with 4+ years; or PhD with 2+ years.
- Proficiency in Python for developing complex software implementations.
- Intermediate expertise in advanced C++ programming (C++14/17), including parallel programming.
- Hands-on experience with frameworks such as PyTorch, vLLM, and SGLang.
- In-depth knowledge of Large Language Models (LLMs).
- Strong understanding of computer architecture and hardware-software optimization techniques.
- Proven ability to debug complex issues across multi-layered software systems.

Preferred Qualifications
- Practical experience with deep learning models for image and video generation.
- Expertise in developing and integrating kernels (e.g., GEMM, Convolution, Flash Attention) using frameworks like CUTLASS or Triton.
- Knowledge of compiler algorithms for heterogeneous systems and Fuser optimizations.
- Effective communication skills and experience collaborating with cross-geo teams.

Join us to drive innovation in AI software solutions and shape the future of data-driven technologies with Intel's cutting-edge platforms.

          

Job Type:

Experienced Hire

Shift:

Shift 1 (India)

Primary Location: 

India, Bangalore

Additional Locations:

Posting Statement:

All qualified applicants will receive consideration for employment without regard to race, color, religion, religious creed, sex, national origin, ancestry, age, physical or mental disability, medical condition, genetic information, military and veteran status, marital status, pregnancy, gender, gender expression, gender identity, sexual orientation, or any other characteristic protected by local law, regulation, or ordinance.

Position of Trust

N/A

Work Model for this Role

This role will be eligible for our hybrid work model which allows employees to split their time between working on-site at their assigned Intel site and off-site. * Job posting details (such as work model, location or time type) are subject to change.

*

ADDITIONAL INFORMATION: Intel is committed to Responsible Business Alliance (RBA) compliance and ethical hiring practices. We do not charge any fees during our hiring process. Candidates should never be required to pay recruitment fees, medical examination fees, or any other charges as a condition of employment. If you are asked to pay any fees during our hiring process, please report this immediately to your recruiter.

How we rate this

AI Software Architect at Intel rates 92 out of 100 for how much of the daily work is AI. That makes it Builds AI (AI Level 4 of 4). The level is about AI in the job, not seniority.

Classification

Builds AI. The job is building AI systems.

  1. ●●●● Builds AI80 to 100
  2. ●●●○ Works on AI60 to 79
  3. ●●○○ Uses AI40 to 59
  4. ●○○○ Little AI0 to 39

Levels come from how often the tools, models and workflows of the role are named in the posting itself. Open the description and count.

Prepare for this job

Built from this posting and from similar jobs on Level.

Skills and AI tools this role asks for

Fine-tuningvLLMPyTorch

Questions you could be asked

  1. Walk me through fine-tuning a model: what data did you use, and how did you check the result?
  2. Walk me through how you've used vLLM in your day-to-day work.
  3. What are the limits of PyTorch that you've run into, and how did you work around them?
  4. How would you decide a model or AI system is ready to ship?
  5. Tell me about a time a model underperformed in production. How did you find out, and what did you change?

Adapt your resume

  • List these exact terms on your resume: Fine-tuning, vLLM, and PyTorch. An applicant tracking system matches the wording, not the idea.
  • Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
  • Lead with what you built, trained or shipped. This role is judged on the AI system itself, not the tools around it.

Want an expert to read your CV for this job?

Free. Send your CV and the role you want next. We reply by email within 2 to 4 business days.

Get new software engineering jobs (Builds AI ●●●●) by email

One email a week with the new software engineering jobs (Builds AI ●●●●), each rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.

Free. One email a week. Unsubscribe in one click.

Similar roles

Software Engineering roles that build AI, at other companies.

What kind of AI work fits you?

Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.

Find my next step

More jobs at Intel

Related searches

Same AI level

Jobs by city