High Performance Computing Software Engineer - Supercomputing

IFM is hiring a High Performance Computing Software Engineer - Supercomputing in Abu Dhabi, United Arab Emirates. Level rates it ; you can apply on IFM.

Level's read on this job

Builds AI ●●●● is how Level rates this software engineer role: the job is building AI systems.
The posting mentions PyTorch, TensorFlow and JAX among its tools and skills.
IFM has 43 other open roles on Level.

AI in this role

PyTorchTensorFlowJAX

About the Institute of Foundation Models We are a dedicated research lab for building, understanding, using, and risk-managing foundation models. Our mandate is to advance research, nurture the next generation of AI builders, and drive transformative contributions to a knowledge-driven economy. As part of our team, you’ll have the opportunity to work on the core of cutting-edge foundation model training, alongside world-class researchers, data scientists, and engineers, tackling the most fundamental and impactful challenges in AI development. You will participate in the development of groundbreaking AI solutions that have the potential to reshape entire industries. Strategic and innovative problem-solving skills will be instrumental in establishing MBZUAI as a global hub for high-performance computing in deep learning, driving impactful discoveries that inspire the next generation of AI pioneers.
The Role
IFM is building the foundational compute infrastructure that will power tomorrow’s breakthroughs in AI and computational science. We’re looking for a High Performance Computing Software Engineer to help us design, develop, and operate the software systems that run our large-scale AI workloads.
In this role, you’ll work at the intersection of high-performance computing and machine learning. You’ll be part of a team responsible for crafting the software stack that enables training of cutting-edge ML models—spanning 1000+ GPUs—and ensuring our infrastructure is robust, performant, and developer-friendly.

Job Responsibilities

Design and implement high-performance, distributed software solutions for large-scale AI/ML training.
Optimize low-level system components including Linux kernel, GPU/accelerator kernels, and interconnects.
Develop and tune communication libraries such as NCCL, MPI, UCX, RCCL, and RDMA-based systems.
Partner with ML researchers and engineers to support frameworks like PyTorch, MegatronLM, and DeepSpeed in large-scale production environments.
Contribute to our scheduling, orchestration, and job management systems, including Slurm and Kubernetes.
Debug and resolve complex issues across the stack—from kernel to container to model.
Work closely with hardware vendors, upstream open-source communities, and internal teams to drive performance and reliability improvements.

Skills & Experience

Proven experience developing and optimizing software for large-scale ML workloads (1000+ GPUs preferred).
Deep understanding of Linux kernel internals and accelerator (GPU) kernel development.
Proficiency with distributed communication libraries (e.g., NCCL, RCCL, MPI, UCX, SHARP, Libfabric).
Experience with ML frameworks like PyTorch, TensorFlow, JAX, or MegatronLM.
Strong knowledge of HPC job scheduling and orchestration tools (e.g., Slurm, Kubernetes, Pyxis).
Excellent debugging and systems performance tuning skills.
A collaborative mindset with a focus on shared success and technical excellence.

How we rate this

High Performance Computing Software Engineer - Supercomputing at IFM rates 100 out of 100 for how much of the daily work is AI. That makes it Builds AI (AI Level 4 of 4). The level is about AI in the job, not seniority.

Classification

Builds AI. The job is building AI systems.

●●●● Builds AI80 to 100
●●●○ Works on AI60 to 79
●●○○ Uses AI40 to 59
●○○○ Little AI0 to 39

Levels come from how often the tools, models and workflows of the role are named in the posting itself. Read the description and count the AI tools, models and workflows it names.

Key facts

High Performance Computing Software Engineer - Supercomputing is an open job at IFM.
Level rates this role AI Level 4 of 4: Builds AI.
The role is based in Abu Dhabi.
The job was posted on August 15, 2025.
Applications are handled by IFM. Apply on IFM

Prepare for this job

Built from this posting and from similar jobs on Level.

Skills and AI tools this role asks for

PyTorchTensorFlowJAX

Also common in software engineer jobs at this level

Python LLM C++AWS AI agents Generative AI

Pay

Typical software engineer job: $167k

This posting doesn't list pay. Use the typical software engineer figure when pay comes up. See software engineer jobs

Questions you could be asked

What's a project where you used PyTorch hands-on?
Walk me through how you've used TensorFlow in your day-to-day work.
What are the limits of JAX that you've run into, and how did you work around them?
How would you decide a model or AI system is ready to ship?
Tell me about a time a model underperformed in production. How did you find out, and what did you change?

Adapt your resume

List these exact terms on your resume: PyTorch, TensorFlow, and JAX. An applicant tracking system matches the wording, not the idea.
Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
Lead with what you built, trained or shipped. This role is judged on the AI system itself, not the tools around it.

Get your CV reviewed before you apply

Send your CV and the role you want next. Your review arrives by email within 3 days.

Get a free CV review Check your resume with the ATS resume checker