Senior Fullstack Engineer, AI Observability & Evals Platform
LangChain is hiring a Senior Fullstack Engineer, AI Observability & Evals Platform in Boston, United States. It pays $175k-$240k a year and Level rates it ; you can apply on LangChain.
Level's read on this job
- On Level's scale, this software engineer role is Builds AI ●●●●: the job is building AI systems.
- Pay on this posting starts 5% higher than the typical software engineer posting on Level.
- The posting mentions LangGraph, Clay and Go among its tools and skills.
- Level classes it as a senior role.
- LangChain has 103 other open roles on Level.
AI in this role
Lead fullstack architecture and implementation for LangSmith, an AI observability and evaluation platform.
At LangChain, our mission is to make intelligent agents ubiquitous. We build the foundation for agent engineering in the real world, helping developers move from prototypes to production-ready AI agents that teams can rely on. We began as widely adopted open-source tools and have grown to also offer a platform for building, evaluating, deploying, and operating agents at scale.
With $125M raised at Series B from IVP, Sequoia, Benchmark, CapitalG, and Sapphire Ventures, we’re at a stage where we’re continuing to develop new products, growth is accelerating, and all team members have meaningful impact on what we build and how we work together. LangChain is a place where your contributions can shape how this technology shows up in the real world.
Today, our platform includes LangSmith (Observability, Evaluation, Deployment, Fleet, and Sandboxes), our open source frameworks (LangChain, LangGraph, and Deep Agents), and the newly launched LangSmith Engine for autonomous agent improvement. We have 100M+ monthly open source downloads, 6,000+ active LangSmith customers, and 5 of the Fortune 10 use LangSmith in production (+ 35% of the Fortune 500 overall), including teams at Klarna, Clay, Coinbase, Workday, Lyft, Cloudflare, Harvey, Rippling, Vanta, LinkedIn, Monday.com, Nvidia, and Bridgewater.
About The TeamThe LangSmith team owns and builds LangChain's core platform for observability, evaluation, and production reliability of AI systems. From tracing and annotation to run rules, evaluations, and beyond, this team owns LangSmith end-to-end. If you want to define what great AI observability looks like at production scale, this is where that work gets done.
About the roleThis role is onsite 5 days/week in Boston, MA
We're looking for a Senior Fullstack Engineer to work on LangSmith. In this role, you'll have the opportunity to shape the technical direction of our platform while working closely with our enterprise customers, developer end-users, and cross functional internal stakeholders.
What You Will Do
Lead the technical architecture and implementation of key product features for LangSmith, working across our entire Go, Python, and Typescript stack.
Collaborate closely with product and design teams to iterate on new features.
Help drive aggressive project timelines while ensuring high engineering standards are being met.
Lead by example in writing clean, maintainable, and well-tested code.
5+ years of experience in software engineering working on complex platform products
Fullstack engineering experience with Go or Python on the backend and React + Typescript on the frontend.
Strong understanding of database systems, particularly Postgres and Redis
Experience designing and scaling APIs, preferably in a high-performance, data-intensive application
A “get stuff done” attitude - comfortable shipping fast and iterating based on user feedback
Strong communicator with the ability to collaborate closely with various internal stakeholders and engage directly with our top-tier customers
Strong ownership mindset
Bonus: Experience with AI/LLM-powered applications, developer tools, or observability platforms
Compensation
Annual salary range: $175,000-$240,000 USD
Compensation Philosophy:
We offer competitive compensation that includes base salary, variable compensation for relevant roles, meaningful equity, benefits, and perks.
We are hiring for this role across a range of scope, and the compensation band reflects that. Your offer depends on what we learn about your impact, craft, leadership, and communication during the interview process. We will tell you early where you’re tracking and talk comp with you before offer stage. Team members in the EU, UK, and APAC receive locally competitive benefits aligned with regional norms and regulations.
BenefitsBenefits include medical, dental, and vision coverage, flexible vacation, a 401(k) plan, meals on in-office days in the US and more.
How we rate this
Senior Fullstack Engineer, AI Observability & Evals Platform at LangChain rates 90 out of 100 for how much of the daily work is AI. That makes it Builds AI (AI Level 4 of 4). The level is about AI in the job, not seniority.
Builds AI. The job is building AI systems.
- ●●●● Builds AI80 to 100
- ●●●○ Works on AI60 to 79
- ●●○○ Uses AI40 to 59
- ●○○○ Little AI0 to 39
Levels come from how often the tools, models and workflows of the role are named in the posting itself. Read the description and count the AI tools, models and workflows it names.
Prepare for this job
Built from this posting and from similar jobs on Level.
Skills and AI tools this role asks for
Also common in software engineer jobs at this level
Pay
- This job starts at
- $175k
- Typical software engineer job
- $167k
This posting starts 5% above the typical software engineer job. See software engineer jobs
Questions you could be asked
- How do you decide when an AI agent can act on its own versus asking for approval first?
- Tell me about a project where fullstack engineering was part of your work. What did you do?
- Tell me about a project where ai observability was part of your work. What did you do?
- Tell me about a project where evaluations was part of your work. What did you do?
- Tell me about a project where distributed systems was part of your work. What did you do?
Adapt your resume
- List these exact terms on your resume: AI agents, Fullstack Engineering, AI Observability, Evaluations, and Distributed Systems. An applicant tracking system matches the wording, not the idea.
- Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
- Lead with what you built, trained or shipped. This role is judged on the AI system itself, not the tools around it.
Want an expert to read your CV for this job?
Free. Send your CV and the role you want next. We reply by email within 2 to 4 business days.
Get new software engineer jobs (Builds AI ●●●●) by email
One email a week with the new software engineer jobs (Builds AI ●●●●), each rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.
Free. One email a week. Unsubscribe in one click.
Similar roles
Software Engineering roles that build AI, at other companies.
What kind of AI work fits you?
Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.
Find my next step