Level

Braintrust

Software Engineer, SDK

Braintrust is hiring a Software Engineer, SDK for a remote role open to applicants in United States. Level rates it ; you can apply on Level.

AI in this role

openaianthropicgemini
ai-evaluation

About the company

Braintrust is the agent observability platform. By actively applying intelligence to agent traces and automatically surfacing the most critical patterns, Braintrust gives teams the visibility to understand how agents behave in production and the tools to improve them.

Teams at Notion, Stripe, Box, OpenAI, and Cloudflare use Braintrust to trace their agents, find the issues in their observability data, and run evals that tell them how to improve.

About the Role

We’re hiring engineers to build the open-source libraries that customers use to observe, understand, and optimize how AI operates inside their production applications. These SDKs are a critical part of Braintrust’s platform. They power evaluation and observability pipelines across a wide range of environments, frameworks, and AI providers.

This role is ideal for engineers who are passionate about developer experience, API craftsmanship, and building fast, reliable, and idiomatic libraries. You’ll own the full SDK lifecycle: design, implementation, release, documentation, and community support. Your work will be embedded in thousands of applications and help define how AI is adopted and operationalized across industries.

What You’ll Do

  • Build elegant, idiomatic, and resilient SDKs that power Braintrust’s LLM evaluation and AI observability platform.

  • Ensure our libraries are easy to use, efficient to run, and a delight to work with, prioritizing developer experience and performance.

  • Integrate with major AI providers, frameworks, and platforms our customers rely on, such as OpenAI, Anthropic, and Gemini.

  • Build tools and automation to improve testing, profiling and simplify release workflows.

  • Collaborate closely with backend, platform, and product teams to ensure a cohesive and polished developer experience.

  • Be a great community ambassador: talk with our users, understand their issues, help them get their fixes merged and have deep empathy for our users.

You Might Be a Fit If You:

  • Are customer-obsessed and passionate about solving real-world problems for developers.

  • Have deep expertise in either Javascript, Python, or Go, and understand what it takes to build fast, idiomatic, and reliable libraries in that ecosystem.

  • Are proficient with the tooling needed to build robust SDKs, such as testing frameworks, profilers, CI/CD pipelines, and packaging systems.

  • Care deeply about developer experience, from clean APIs and clear docs to thoughtful error handling and backward compatibility.

  • Know how to wrap, patch, or extend existing frameworks and SDKs to inject observability and control without breaking developer workflows.

  • Have experience maintaining or contributing to production-grade open-source libraries, ideally used across multiple environments.

  • Bonus: You’ve contributed to popular open source projects, led SDK adoption at your organization, are familiar with tracing and observability tools like OpenTelemetry, or worked on tools in the LLM/AI ecosystem.

Benefits include

  • Medical, dental, and vision insurance

  • Daily lunch, snacks, and beverages

  • Flexible time off

  • Competitive salary and equity

  • Wifi & cellphone stipend

Equal opportunity

Braintrust is an equal opportunity employer. All applicants will be considered for employment without attention to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran or disability status.

How we rate this

Software Engineer, SDK at Braintrust rates 68 out of 100 for how much of the daily work is AI. That makes it Works on AI (AI Level 3 of 4). The level is about AI in the job, not seniority.

Classification

Works on AI. The daily work is on AI products, without building the model.

  1. ●●●● Builds AI80 to 100
  2. ●●●○ Works on AI60 to 79
  3. ●●○○ Uses AI40 to 59
  4. ●○○○ Little AI0 to 39

Levels come from how often the tools, models and workflows of the role are named in the posting itself. Open the description and count.

Prepare for this job

Built from this posting and from similar jobs on Level.

Skills and AI tools this role asks for

AI EvaluationOpenAIAnthropicGemini

Also common in software engineer jobs at this level

Pay

Typical software engineer job
$168k

This posting doesn't list pay. Use the typical software engineer figure when pay comes up. See software engineer jobs

Questions you could be asked

  1. How do you decide that one model's output is better than another's for a given task?
  2. Walk me through how you've used OpenAI in your day-to-day work.
  3. What are the limits of Anthropic that you've run into, and how did you work around them?
  4. What's a project where you used Gemini hands-on?
  5. Describe a typical day in a role like this one: which parts run through AI directly?

Adapt your resume

  • List these exact terms on your resume: AI Evaluation, OpenAI, Anthropic, and Gemini. An applicant tracking system matches the wording, not the idea.
  • Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
  • Show where AI is part of your daily process, not a one-off project. This role expects it to be a running habit.

Want an expert to read your CV for this job?

Free. Send your CV and the role you want next. We reply by email within 2 to 4 business days.

Get new remote software engineer jobs (Works on AI ●●●○ or higher) by email

One email a week with the new remote software engineer jobs (Works on AI ●●●○ or higher), each rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.

Free. One email a week. Unsubscribe in one click.

Similar roles

Software Engineering roles that work on AI, at other companies.

What kind of AI work fits you?

Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.

Find my next step

More jobs at Braintrust

More software engineer jobs

Related searches

Same AI level