Skip to content

IFM

Research Scientist - World Modeling

IFM is hiring a Research Scientist - World Modeling in Sunnyvale, United States. It pays $150k-$450k a year and Level rates it ; you can apply on IFM.

Level's read on this job

  • Level rates this research scientist role Builds AI ●●●●: the job is building AI systems.
  • Tools and skills the posting cites include PyTorch, Sora and AI data labeling.
  • Level lists 42 other open roles at IFM.

AI in this role

PyTorchSora
ai-data-labeling

About the Institute of Foundation Models

We are a dedicated research lab for building, understanding, using, and risk-managing foundation models. Our mandate is to advance research, nurture the next generation of AI builders, and drive transformative contributions to a knowledge-driven economy.

As part of our team, you’ll have the opportunity to work on the core of cutting-edge foundation model training, alongside world-class researchers, data scientists, and engineers, tackling the most fundamental and impactful challenges in AI development. You will participate in the development of groundbreaking AI solutions that have the potential to reshape entire industries. Strategic and innovative problem-solving skills will be instrumental in establishing MBZUAI as a global hub for high-performance computing in deep learning, driving impactful discoveries that inspire the next generation of AI pioneers.

The Role We are the AllWorld Team under the Institute of Foundation Model (IFM) at MBZUAI. At AllWorld, we are pioneering the development of the PAN (Physical, Agentic, and Networked) world models—the next-generation foundation models to unlock machine intelligence beyond lingual. Our mission is to tackle the fundamental challenges of world modeling and establish a new paradigm for next-generation machine reasoning. We are looking for passionate individuals who share our vision and are eager to push the boundaries of AI together.

Key Responsibilities

  • Develop the foundational world model to accurately simulate the physical world.
  • Collaborate with engineering and data teams to tackle key challenges in training the world model on large-scale clusters.
  • Develop metrics and evaluation benchmarks to better assess model performance.
  • Design and implement a scalable and efficient data annotation pipeline to ensure high-quality labeled data for training and evaluation.
  • Optimize inference efficiency to enable real-time interaction.

Areas of Focus

  • Scalable Training Systems: Develop and optimize infrastructure for training multimodal LLMs and video diffusion models at massive scale.
  • Efficient Data Pipelines: Build scalable video data pipelines and annotation frameworks to support high-quality training data.
  • Inference Optimization: Enhance inference efficiency through optimization and distillation techniques to enable real-time interaction.
  • Visual Tokenization: Develop methods for discretizing visual features into tokens for improved model representation.
  • Quantitative Evaluation: Establish rigorous benchmarks to assess physical accuracy, controllability, and intelligence.
  • Scaling Laws for Video Pretraining: Investigate scaling law principles to guide efficient video pre-training strategies.

Academic Qualifications

  • MSc or PhD in Machine Learning or Computer Science, or equivalent industry experience.

Professional Experience

  • Experience in large-scale model training (LLMs or Diffusion Models) on large clusters.
  • Hands-on experience with state-of-the-art video generative models (e.g., Sora, Veo2, MovieGen, CogVideoX, etc.).
  • Experiences in building and optimizing large-scale video data pipelines.
  • Experience in accelerating diffusion model inference for improved efficiency.
  • Exceptional problem-solving and troubleshooting skills to tackle complex technical challenges.
  • Strong systems and engineering expertise in deep learning frameworks such as PyTorch.
  • Strong communication and collaboration skills for effective cross-functional teamwork.
  • Ability to navigate ambiguity and drive projects in rapidly evolving research areas.
  • Research contributions to top-tier conferences or journals (e.g., ICML, ICLR, NeurIPS, ACL, CVPR, COLM, etc.), with published work in relevant domains.

Compensation

$150,000 – $450,000/year + discretionary performance bonus + benefits

The posted salary range represents the company’s good faith estimate of the base compensation for this position upon hire. The actual base compensation offered may vary within this range depending on individual qualifications, including but not limited to relevant skills, experience, education, certifications, and specific business needs. In addition to base salary, total compensation includes an annual discretionary performance bonus and comprehensive benefits.

Benefits Include

  • Comprehensive medical, dental, and vision benefits
  • Bonus
  • 401K Plan
  • Generous paid time off, sick leave and holidays
  • Paid Parental Leave
  • Employee Assistance Program
  • Life insurance and disability

How we rate this

Research Scientist - World Modeling at IFM rates 98 out of 100 for how much of the daily work is AI. That makes it Builds AI (AI Level 4 of 4). The level is about AI in the job, not seniority.

Classification

Builds AI. The job is building AI systems.

  1. ●●●● Builds AI80 to 100
  2. ●●●○ Works on AI60 to 79
  3. ●●○○ Uses AI40 to 59
  4. ●○○○ Little AI0 to 39

Levels come from how often the tools, models and workflows of the role are named in the posting itself. Read the description and count the AI tools, models and workflows it names.

Prepare for this job

Built from this posting and from similar jobs on Level.

Skills and AI tools this role asks for

AI Data LabelingPyTorchSora

Also common in research scientist jobs at this level

Pay

This job starts at
$150k
Typical research scientist job
$192k

This posting starts 22% below the typical research scientist job. See research scientist jobs

Questions you could be asked

  1. How do you keep labeling instructions consistent across a large annotation team?
  2. Walk me through how you've used PyTorch in your day-to-day work.
  3. What are the limits of Sora that you've run into, and how did you work around them?
  4. How would you decide a model or AI system is ready to ship?
  5. Tell me about a time a model underperformed in production. How did you find out, and what did you change?

Adapt your resume

  • List these exact terms on your resume: AI Data Labeling, PyTorch, and Sora. An applicant tracking system matches the wording, not the idea.
  • Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
  • Lead with what you built, trained or shipped. This role is judged on the AI system itself, not the tools around it.

Get your CV reviewed before you apply

Send your CV and the role you want next. Your review arrives by email within 3 days.

Get new research scientist jobs (Builds AI ●●●●) by email

One email a week, each job rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.

Free.

Similar roles

Research roles that build AI, at other companies.

What kind of AI work fits you?

Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.

Find my next step

More jobs at IFM

More research scientist jobs

Related searches

Same AI level

Jobs by city