Senior Software Engineer, Database (SmithDB)
LangChain is hiring a Senior Software Engineer, Database (SmithDB) in San Francisco, United States. It pays $185k-$250k a year and Level rates it ; you can apply on LangChain.
Level's read on this job
- On Level's scale, this software engineer role is Works on AI ●●●○: the daily work is on AI products, without building the model.
- The listed pay starts 10% above the typical software engineer posting on Level.
- Tools and skills the posting cites include LangGraph, Clay and Rust.
- Level classifies it as a senior role.
- Level lists 103 other open roles at LangChain.
AI in this role
Build high-performance storage and query layers for AI observability and evaluation data in Rust.
At LangChain, our mission is to make intelligent agents ubiquitous. We build the foundation for agent engineering in the real world, helping developers move from prototypes to production-ready AI agents that teams can rely on. We began as widely adopted open-source tools and have grown to also offer a platform for building, evaluating, deploying, and operating agents at scale.
With $125M raised at Series B from IVP, Sequoia, Benchmark, CapitalG, and Sapphire Ventures, we’re at a stage where we’re continuing to develop new products, growth is accelerating, and all team members have meaningful impact on what we build and how we work together. LangChain is a place where your contributions can shape how this technology shows up in the real world.
Today, our platform includes LangSmith (Observability, Evaluation, Deployment, Fleet, and Sandboxes), our open source frameworks (LangChain, LangGraph, and Deep Agents), and the newly launched LangSmith Engine for autonomous agent improvement. We have 100M+ monthly open source downloads, 6,000+ active LangSmith customers, and 5 of the Fortune 10 use LangSmith in production (+ 35% of the Fortune 500 overall), including teams at Klarna, Clay, Coinbase, Workday, Lyft, Cloudflare, Harvey, Rippling, Vanta, LinkedIn, Monday.com, Nvidia, and Bridgewater.
About the team
SmithDB is LangChain's internal database team. We're building a storage and query layer purpose-built for AI observability and evaluation. Within six months we went from idea to a production system that offers industry leading performance and scalability for agent observability data. We're a small, fast team of systems engineers tackling genuinely hard problems: storage layout, query execution, compaction, and scaling toward trillions of agent traces. We develop in Rust, run on Kubernetes, and integrate tightly with S3/GCS/Azure Blob. There are no legacy constraints; this is a greenfield system with real production load and ambitious engineering goals.
About the role
We're a fast-moving team looking for a systems / database engineer to help design, optimize, and harden our system. Within 6 months, we've gone from idea to production system but there is still lots to build and optimize. You'll be working on execution, storage layout, performance profiling, and scaling to trillions of traces. This role is based in San Francisco.
What you'll do
Engineer performant Rust code for ingestion and query execution
Optimize for cost and speed, heavily utilizing memory and CPU profiling
Integrate tightly with cloud object stores (S3/GCS/Azure Blob)
Deploy our distributed database services on Kubernetes (multi-tenant, high throughput, low latency)
Contribute to observability for the storage engine itself (metrics, tracing, debug tooling)
What you'll bring
5+ years in systems/database engineering with strong experience in a systems programming language (Rust, C++). Rust strongly preferred, as it is the language we use.
Knowledge of database internals is a plus: query engines, storage systems, indexing, and compaction
Proficiency in systems performance analysis: memory allocation, CPU hotspots, lock contention, async runtimes.
Familiarity with similar query execution engines is a plus
Experience with Kubernetes, distributed systems, and cloud object storage is a plus.
Strong fundamentals in networking, OS concepts, and systems debugging.
Compensation
Salary Range: $185,000-$250,000 USD
Compensation Philosophy:
We offer competitive compensation that includes base salary, variable compensation for relevant roles, meaningful equity, benefits, and perks.
We are hiring for this role across a range of scope, and the compensation band reflects that. Your offer depends on what we learn about your impact, craft, leadership, and communication during the interview process. We will tell you early where you’re tracking and talk comp with you before offer stage. Team members in the EU, UK, and APAC receive locally competitive benefits aligned with regional norms and regulations.
BenefitsBenefits include medical, dental, and vision coverage, flexible vacation, a 401(k) plan, meals on in-office days in the US and more.
How we rate this
Senior Software Engineer, Database (SmithDB) at LangChain rates 70 out of 100 for how much of the daily work is AI. That makes it Works on AI (AI Level 3 of 4). The level is about AI in the job, not seniority.
Works on AI. The daily work is on AI products, without building the model.
- ●●●● Builds AI80 to 100
- ●●●○ Works on AI60 to 79
- ●●○○ Uses AI40 to 59
- ●○○○ Little AI0 to 39
Levels come from how often the tools, models and workflows of the role are named in the posting itself. Read the description and count the AI tools, models and workflows it names.
Prepare for this job
Built from this posting and from similar jobs on Level.
Skills and AI tools this role asks for
Pay
- This job starts at
- $185k
- Typical software engineer job
- $168k
This posting starts 10% above the typical software engineer job. See software engineer jobs
Questions you could be asked
- How do you decide when an AI agent can act on its own versus asking for approval first?
- Tell me about a project where database engineering was part of your work. What did you do?
- Tell me about a project where storage systems was part of your work. What did you do?
- Tell me about a project where performance profiling was part of your work. What did you do?
- Tell me about a project where distributed systems was part of your work. What did you do?
Adapt your resume
- List these exact terms on your resume: AI agents, Database Engineering, Storage Systems, Performance Profiling, and Distributed Systems. An applicant tracking system matches the wording, not the idea.
- Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
- Show where AI is part of your daily process, not a one-off project. This role expects it to be a running habit.
Want an expert to read your CV for this job?
Free. Send your CV and the role you want next. We reply by email within 2 to 4 business days.
Get new software engineer jobs (Works on AI ●●●○ or higher) by email
One email a week with the new software engineer jobs (Works on AI ●●●○ or higher), each rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.
Free. One email a week. Unsubscribe in one click.
Similar roles
Software Engineering roles that work on AI, at other companies.
What kind of AI work fits you?
Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.
Find my next step