Skip to content

IFM

Research Engineer/Scientist - Speech/Audio Machine Learning

IFM is hiring a Research Engineer/Scientist - Speech/Audio Machine Learning in Paris, France. Level rates it ; you can apply on IFM.

Level's read on this job

  • Level rates this role Builds AI ●●●●: the job is building AI systems.
  • IFM has 43 other open roles on Level.

AI in this role

About the Institute of Foundation Models We are a dedicated research lab for building, understanding, using, and risk-managing foundation models. Our mandate is to advance research, nurture the next generation of AI builders, and drive transformative contributions to a knowledge-driven economy. As part of our team, you’ll have the opportunity to work on the core of cutting-edge foundation model training, alongside world-class researchers, data scientists, and engineers, tackling the most fundamental and impactful challenges in AI development. You will participate in the development of groundbreaking AI solutions that have the potential to reshape entire industries. Strategic and innovative problem-solving skills will be instrumental in establishing MBZUAI as a global hub for high-performance computing in deep learning, driving impactful discoveries that inspire the next generation of AI pioneers. The Role As a Research Scientist specializing in speech/audio machine learning, you will contribute to the design and training of SoTA end-to-end neural speech models. You will be responsible for developing the core intellectual property, moving beyond cascaded ASR → TTS systems toward native audio-to-audio multimodal architectures.

Key responsibilities

  • Architectural Design: Develop novel neural architectures for low-latency speech-to-speech translation and generation (e.g., Diffusion, Flow-matching, Transformer-based audio LLMs).
  • Loss Function Engineering: Design and implement custom objective functions to optimize prosody (emotions, intelligibility, naturalness).
  • Experimental Iteration: Conduct large-scale training runs, performing ablation studies on model architecture and tokenization strategies.
  • Evaluation Frameworks: Establish rigorous internal benchmarks using both objective metrics (WER, MCD) and subjective human-in-the-loop (MOS) testing.

Qualifications

  • PhD or MSc in Computer Science with a focus on Deep Learning, Signal Processing, or Computational Linguistics.
  • Record of Research: Published work in top-tier venues (NeurIPS, ICLR, ICASSP, Interspeech).

How we rate this

Research Engineer/Scientist - Speech/Audio Machine Learning at IFM rates 99 out of 100 for how much of the daily work is AI. That makes it Builds AI (AI Level 4 of 4). The level is about AI in the job, not seniority.

Classification

Builds AI. The job is building AI systems.

  1. ●●●● Builds AI80 to 100
  2. ●●●○ Works on AI60 to 79
  3. ●●○○ Uses AI40 to 59
  4. ●○○○ Little AI0 to 39

Levels come from how often the tools, models and workflows of the role are named in the posting itself. Read the description and count the AI tools, models and workflows it names.

Get new research jobs (Builds AI ●●●●) by email

One email a week, each job rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.

Free.

Similar roles

Research roles that build AI, at other companies.

What kind of AI work fits you?

Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.

Find my next step

More jobs at IFM

Related searches

Same AI level

Jobs by city