Member of Technical Staff - LLM Pre-Training

About us

Albs is an AI research lab building real-time multimodal intelligence for machines, enabling them to see, hear, reason, and interact. We treat model architecture, inference, and runtime as one system. Our purpose-built models and optimized runtimes unlock the full potential of each device within defined limits for hardware cost, power consumption, and response time. Companies can adapt our technology to their own machines without building the underlying AI from scratch.

We founded Albs at the intersection of LLM architecture research and on-device engineering, and we are currently in stealth, but well funded, with dedicated compute for large-scale training and experimentation. Publishing is a core part of our research culture, and we contribute our work to top venues. We share more details about the company, the team and our backing in the first conversation.

Who we're looking for

This is a Staff / Senior IC role. We are looking for experienced researchers and engineers, typically with a PhD and several years of research or industry experience or an equivalent track record. The exact scope of each role depends on your background: some people go deep on one part of the stack, others shape the technical direction of a whole area. We agree on scope together with you during the interview process. We welcome applications from all qualified candidates, regardless of gender, age, ethnic origin, religion, disability or sexual orientation.

What you'll work on

• Work across the pre-training stack, including data pipeline, model architecture, model optimization, training and evaluation.

• Develop and evaluate novel ideas across architecture, optimizers, and training algorithms.

• Make training run efficiently on multi-node GPU clusters, down to low-level system optimizations.

• Design for the hardware from the start: co-design architectures with the hardware optimization team so our models run efficiently on-device.

• Publish at top venues and help shape our research agenda in LLM architecture and optimization.

What we're looking for

• You hold a PhD in a relevant field and have several years of research experience after it, in academia or industry, or an equivalent track record.

• You are an expert in LLM architectures and/or deep learning optimization, with design decisions that measurably improved model quality or efficiency.

• You have pre-trained LLMs on budgets of 100k+ GPU hours, with large-scale distributed training (FSDP, TP, PP, CP).

• You have a strong research track record in the field (e.g. NeurIPS, ICML, ICLR).

• You have deep Python and PyTorch proficiency and are comfortable reading and modifying low-level training code.

How We Work Together

We are a small, focused team of experts. You would join early, work directly with the founders, and help shape how we build. Fast iteration, short lines of communication, and in-person discussion matter a lot to us. Our culture is built around the office in Freiburg, Germany, with a default of three days a week on site. Alternatively, you can work remotely and join us on a regular cadence. We will discuss what works best for you during the interview process.

We hold ourselves to a high standard: the research must be rigorous, the understanding deep, and the product well crafted. Ideas are judged on their merit, not on who proposed them, credit belongs to the team, and no task is beneath anyone. We make ambitious bets and ship early instead of waiting for perfect conditions. Above all, we care about each other, because initiative only works when it comes with respect for the people around you.

What we offer

Expect a competitive base salary plus equity, and dedicated compute for your research and experiments. We give you the time and support to publish and present at top conferences, and flexibility in how you work, whether on site or remote with regular in-person visits. With flat hierarchies and short decision paths, good ideas move from discussion to experiment quickly. And yes, the coffee is excellent, and we regularly get together as a team outside of work. We go through compensation and all other details with you early in the process.