Level

LangChain

Software Engineering Manager, Database (SmithDB)

LangChain is hiring a Software Engineering Manager, Database (SmithDB) in San Francisco, United States. It pays $240k-$300k a year and Level rates it ; you can apply on LangChain.

Level's read on this job

  • Level rates this role Works on AI ●●●○: the daily work is on AI products, without building the model.
  • The posting mentions LangGraph, Clay and Rust among its tools and skills.
  • Level classes it as a lead role.
  • LangChain has 103 other open roles on Level.

AI in this role

Lead the internal database team building a high-performance storage and query layer for AI observability and evaluation data in Rust.

langgraphclayrustkubernetess3gcsazure-blob
ai-agentssystems-engineeringdatabase-engineeringdistributed-systemsobservability
About Us

At LangChain, our mission is to make intelligent agents ubiquitous. We build the foundation for agent engineering in the real world, helping developers move from prototypes to production-ready AI agents that teams can rely on. We began as widely adopted open-source tools and have grown to also offer a platform for building, evaluating, deploying, and operating agents at scale.

With $125M raised at Series B from IVP, Sequoia, Benchmark, CapitalG, and Sapphire Ventures, we’re at a stage where we’re continuing to develop new products, growth is accelerating, and all team members have meaningful impact on what we build and how we work together. LangChain is a place where your contributions can shape how this technology shows up in the real world.

Today, our platform includes LangSmith (Observability, Evaluation, Deployment, Fleet, and Sandboxes), our open source frameworks (LangChain, LangGraph, and Deep Agents), and the newly launched LangSmith Engine for autonomous agent improvement. We have 100M+ monthly open source downloads, 6,000+ active LangSmith customers, and 5 of the Fortune 10 use LangSmith in production (+ 35% of the Fortune 500 overall), including teams at Klarna, Clay, Coinbase, Workday, Lyft, Cloudflare, Harvey, Rippling, Vanta, LinkedIn, Monday.com, Nvidia, and Bridgewater.

About the team

SmithDB is LangChain's internal database team. We're building a storage and query layer purpose-built for AI observability and evaluation. Within six months we went from idea to a production system that offers industry leading performance and scalability for agent observability data. We're a small, fast team of systems engineers tackling genuinely hard problems: storage layout, query execution, compaction, and scaling toward trillions of agent traces. We develop in Rust, run on Kubernetes, and integrate tightly with S3/GCS/Azure Blob. There are no legacy constraints; this is a greenfield system with real production load and ambitious engineering goals.

 

About the role

We're looking for a hands-on Engineering Manager to lead the SmithDB team. This is not a pure people-management role. You'll write production code, review PRs at the systems level, make architectural calls, and be in the weeds alongside your engineers. At the same time, you'll own team health, hiring, technical roadmap, and coordination with the broader LangSmith platform. The ideal candidate has deep systems or database engineering experience and genuinely prefers to stay technical while growing a team.

 

What you'll do

  • Write and review production Rust code across ingestion, query execution, and storage layers

  • Lead architectural decisions on storage format, compaction, indexing, and query planning

  • Drive performance investigations using memory and CPU profiling tools; own the path from profiling to shipped fix

  • Design and harden the distributed deployment of SmithDB services on Kubernetes (multi-tenant, high-throughput, low-latency)

  • Contribute to cloud object store integrations (S3, GCS, Azure Blob) and set the standard for how SmithDB manages data at rest and in flight

  • Build and maintain observability for the engine itself: metrics, tracing, debug tooling

  • Manage a small but growing team of systems engineers: set goals, run 1:1s, provide technical mentorship, and grow careers

  • Own the SmithDB technical roadmap in partnership with LangSmith product and engineering leadership

  • Communicate progress, risks, and tradeoffs clearly to the broader organization: you write concise, decision-ready updates

 

What you'll bring

  • 7+ years in systems or database engineering, with at least 2 years in a technical lead or engineering management role

  • Production Rust experience — you can write it, review it, and have opinions on how to structure it at scale

  • Deep understanding of database or storage engine internals: query execution, storage layouts, indexing, compaction

  • Proficiency in systems performance analysis: memory allocators, CPU hotspots, lock contention, async runtimes (Tokio)

  • Experience deploying and operating distributed services on Kubernetes in a production, multi-tenant environment

  • Familiarity with cloud object storage (S3-compatible APIs, consistency models, cost/performance tradeoffs)

  • Proven track record of managing engineers — you can recruit, retain, and level-up a team without losing your technical edge

Nice-to-have:

  • Experience building or contributing to columnar storage formats (Parquet, Arrow), OLAP query engines, or time-series stores

  • Background in observability infrastructure or tracing pipelines (OpenTelemetry, ClickHouse, Prometheus)

  • Experience scaling a system from early-stage to hundreds of billions / trillions of records

 

Compensation

Salary Range: $240,000-$300,000 USD

Compensation Philosophy:

We offer competitive compensation that includes base salary, variable compensation for relevant roles, meaningful equity, benefits, and perks.

We are hiring for this role across a range of scope, and the compensation band reflects that. Your offer depends on what we learn about your impact, craft, leadership, and communication during the interview process. We will tell you early where you’re tracking and talk comp with you before offer stage. Team members in the EU, UK, and APAC receive locally competitive benefits aligned with regional norms and regulations.

Benefits

Benefits include medical, dental, and vision coverage, flexible vacation, a 401(k) plan, meals on in-office days in the US and more.

How we rate this

Software Engineering Manager, Database (SmithDB) at LangChain rates 65 out of 100 for how much of the daily work is AI. That makes it Works on AI (AI Level 3 of 4). The level is about AI in the job, not seniority.

Classification

Works on AI. The daily work is on AI products, without building the model.

  1. ●●●● Builds AI80 to 100
  2. ●●●○ Works on AI60 to 79
  3. ●●○○ Uses AI40 to 59
  4. ●○○○ Little AI0 to 39

Levels come from how often the tools, models and workflows of the role are named in the posting itself. Read the description and count the AI tools, models and workflows it names.

Prepare for this job

Built from this posting and from similar jobs on Level.

Skills and AI tools this role asks for

AI agentsSystems EngineeringDatabase EngineeringDistributed SystemsObservabilityLangGraphClayRust

Questions you could be asked

  1. How do you decide when an AI agent can act on its own versus asking for approval first?
  2. Tell me about a project where systems engineering was part of your work. What did you do?
  3. Tell me about a project where database engineering was part of your work. What did you do?
  4. Tell me about a project where distributed systems was part of your work. What did you do?
  5. Tell me about a project where observability was part of your work. What did you do?

Adapt your resume

  • List these exact terms on your resume: AI agents, Systems Engineering, Database Engineering, Distributed Systems, and Observability. An applicant tracking system matches the wording, not the idea.
  • Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
  • Show where AI is part of your daily process, not a one-off project. This role expects it to be a running habit.

Want an expert to read your CV for this job?

Free. Send your CV and the role you want next. We reply by email within 2 to 4 business days.

Get new software engineering jobs (Works on AI ●●●○ or higher) by email

One email a week with the new software engineering jobs (Works on AI ●●●○ or higher), each rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.

Free. One email a week. Unsubscribe in one click.

Similar roles

Software Engineering roles that work on AI, at other companies.

What kind of AI work fits you?

Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.

Find my next step

More jobs at LangChain

Related searches

Same AI level

Jobs by city