Level

Braintrust

Director, Product Engineering

Braintrust is hiring a Director, Product Engineering in San Francisco, United States. Level rates it ; you can apply on Braintrust.

Level's read on this job

  • On Level's scale, this role is Works on AI ●●●○: the daily work is on AI products, without building the model.
  • The posting mentions OpenAI, LLM and frontend architecture among its tools and skills.
  • Level classes it as a lead role.
  • Braintrust has 28 other open roles on Level.

AI in this role

Lead product engineering for Braintrust, building agent observability interfaces, prompt playgrounds, and LLM analysis tooling.

openaillm
frontend-architectureproduct-managementinteraction-designengineering-leadership

About the company

Braintrust is the agent observability platform. By actively applying intelligence to agent traces and automatically surfacing the most critical patterns, Braintrust gives teams the visibility to understand how agents behave in production and the tools to improve them.

Teams at Notion, Stripe, Box, OpenAI, and Cloudflare use Braintrust to trace their agents, find the issues in their observability data, and run evals that tell them how to improve.

About the role

We're looking for a Director of Product Engineering to lead the team building Braintrust's core product experience.

This is a hands-on engineering leadership role for someone who cares deeply about both building great products and great engineering teams. You’ll shape how we build: setting technical direction, raising our product bar, and growing an exceptional product engineering team.

What you'll do

  • Build and lead an exceptional product engineering team. Build a culture of ownership, ambition, and consistently strong execution.

  • Make Braintrust’s UI exceptional. Raise the bar across interaction design, performance, reliability, and product polish.

  • Own the technical direction of the product. Evolve our frontend architecture to support increasingly sophisticated workflows, larger datasets, and a rapidly growing customer base without sacrificing speed or quality.

  • Stay close to the product, customers, and code. Work alongside Product and Design to understand our users, shape the roadmap, and make the technical decisions that matter most.

  • Deliver ambitious product capabilities at scale. Lead the team building experiences like our prompt playground, prompt management and versioning, multiplayer human review, and LLM analysis across arbitrarily large datasets.

  • Build products at the frontier of how teams work with AI. From prompt experimentation and versioning to multiplayer review and large-scale LLM analysis, you’ll lead the engineering behind some of our hardest product problems.

Ideal candidate credentials

  • A proven engineering leader who has built, managed, and scaled high-performing teams, with a track record of recruiting exceptional engineers and developing future leaders.

  • Exceptional product judgment and UI craft. You know what separates a good product from a world-class one and care deeply about usability, performance, interaction design, and the details.

  • Deep technical expertise in modern web applications. You’ve built sophisticated, data-intensive products and are comfortable with technologies like TypeScript, React, SQL, and Next.js.

  • A builder's mindset. You can think about organizational strategy one minute and dig into an architecture decision the next.

  • High ownership and a bias toward action. You thrive in fast-moving environments, make pragmatic decisions, and know how to create teams that move quickly without sacrificing quality.

  • Experience with startups or AI is valuable, but not required. We’d especially value experience building LLM-powered products or leading teams through rapid growth.

Benefits include

  • Medical, dental, and vision insurance

  • Daily lunch, snacks, and beverages

  • Flexible time off

  • Competitive salary and equity

  • Wifi & cellphone stipend

Equal opportunity

Braintrust is an equal opportunity employer. All applicants will be considered for employment without attention to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran or disability status.

How we rate this

Director, Product Engineering at Braintrust rates 65 out of 100 for how much of the daily work is AI. That makes it Works on AI (AI Level 3 of 4). The level is about AI in the job, not seniority.

Classification

Works on AI. The daily work is on AI products, without building the model.

  1. ●●●● Builds AI80 to 100
  2. ●●●○ Works on AI60 to 79
  3. ●●○○ Uses AI40 to 59
  4. ●○○○ Little AI0 to 39

Levels come from how often the tools, models and workflows of the role are named in the posting itself. Read the description and count the AI tools, models and workflows it names.

Prepare for this job

Built from this posting and from similar jobs on Level.

Skills and AI tools this role asks for

Frontend ArchitectureProduct ManagementInteraction DesignEngineering LeadershipOpenAILLM

Questions you could be asked

  1. Tell me about a project where frontend architecture was part of your work. What did you do?
  2. Tell me about a project where product management was part of your work. What did you do?
  3. Tell me about a project where interaction design was part of your work. What did you do?
  4. Tell me about a project where engineering leadership was part of your work. What did you do?
  5. Walk me through how you've used OpenAI in your day-to-day work.

Adapt your resume

  • List these exact terms on your resume: Frontend Architecture, Product Management, Interaction Design, Engineering Leadership, and OpenAI. An applicant tracking system matches the wording, not the idea.
  • Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
  • Show where AI is part of your daily process, not a one-off project. This role expects it to be a running habit.

Want an expert to read your CV for this job?

Free. Send your CV and the role you want next. We reply by email within 2 to 4 business days.

Get new software engineering jobs (Works on AI ●●●○ or higher) by email

One email a week with the new software engineering jobs (Works on AI ●●●○ or higher), each rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.

Free. One email a week. Unsubscribe in one click.

Similar roles

Software Engineering roles that work on AI, at other companies.

What kind of AI work fits you?

Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.

Find my next step

More jobs at Braintrust

Related searches

Same AI level

Jobs by city