Senior Fullstack Software Engineer, AI Observability & Evals Platform (NY)
LangChain is hiring a Senior Fullstack Software Engineer, AI Observability & Evals Platform (NY) in San Francisco, United States. It pays $180k-$240k a year and Level rates it ; you can apply on Level.
AI in this role
At LangChain, our mission is to make intelligent agents ubiquitous. We build the foundation for agent engineering in the real world, helping developers move from prototypes to production-ready AI agents that teams can rely on. We began as widely adopted open-source tools and have grown to also offer a platform for building, evaluating, deploying, and operating agents at scale.
With $125M raised at Series B from IVP, Sequoia, Benchmark, CapitalG, and Sapphire Ventures, we’re at a stage where we’re continuing to develop new products, growth is accelerating, and all team members have meaningful impact on what we build and how we work together. LangChain is a place where your contributions can shape how this technology shows up in the real world.
Today, our platform includes LangSmith (Observability, Evaluation, Deployment, Fleet, and Sandboxes), our open source frameworks (LangChain, LangGraph, and Deep Agents), and the newly launched LangSmith Engine for autonomous agent improvement. We have 100M+ monthly open source downloads, 6,000+ active LangSmith customers, and 5 of the Fortune 10 use LangSmith in production (+ 35% of the Fortune 500 overall), including teams at Klarna, Clay, Coinbase, Workday, Lyft, Cloudflare, Harvey, Rippling, Vanta, LinkedIn, Monday.com, Nvidia, and Bridgewater.
About the role:
We're looking for a Senior Fullstack Engineer for our commercial product LangSmith, an observability and evals platform. In this role, you'll have the opportunity to shape the technical direction of our platform while working closely with enterprise customers, developer end-users and internal stakeholders.
What You Will Do:
Lead the technical architecture and implementation of key product features for LangSmith, working across our entire Go, Python, and Typescript stack.
Collaborate closely with product and design teams to iterate on new features.
Mentor and guide more junior members of the team. Drive aggressive project timelines while ensuring high engineering standards are being met.
Lead by example in writing clean, maintainable, and well-tested code
What You Bring:
5+ years of experience in software engineering working on complex platform products
Fullstack engineering experience with Go or Python on the backend and React + Typescript on the frontend.
Strong understanding of database systems, particularly Postgres and Redis
Experience designing and scaling APIs, preferably in a high-performance, data-intensive application
A “get stuff done” attitude - comfortable shipping fast and iterating based on user feedback
Strong communicator with the ability to collaborate closely with various internal stakeholders and engage directly with our top-tier customers
Strong ownership mindset
Bonus: Experience with AI/LLM-powered applications, developer tools, or observability platforms
Annual salary range: $180,000-$240,000 USD
Compensation Philosophy:
We offer competitive compensation that includes base salary, variable compensation for relevant roles, meaningful equity, benefits, and perks. Actual compensation and offerings will vary based on role, level, and location. Team members in the EU, UK, and APAC receive locally competitive benefits aligned with regional norms and regulations.
BenefitsBenefits include medical, dental, and vision coverage, flexible vacation, a 401(k) plan, meals on in-office days in the US and more.
How we rate this
Senior Fullstack Software Engineer, AI Observability & Evals Platform (NY) at LangChain rates 83 out of 100 for how much of the daily work is AI. That makes it Builds AI (AI Level 4 of 4). The level is about AI in the job, not seniority.
Builds AI. The job is building AI systems.
- ●●●● Builds AI80 to 100
- ●●●○ Works on AI60 to 79
- ●●○○ Uses AI40 to 59
- ●○○○ Little AI0 to 39
Levels come from how often the tools, models and workflows of the role are named in the posting itself. Open the description and count.
Prepare for this job
A free preview built only from this posting: what it asks for, what you could be asked in an interview, and how to adjust your resume.
Skills and AI tools this role asks for
Questions you could be asked
- How do you decide when an AI agent can act on its own versus asking for approval first?
- Walk me through how you've used LangGraph in your day-to-day work.
- What are the limits of Clay that you've run into, and how did you work around them?
- How would you decide a model or AI system is ready to ship?
- Tell me about a time a model underperformed in production. How did you find out, and what did you change?
Adapt your resume
- List these exact terms on your resume: AI agents, LangGraph, and Clay. An applicant tracking system matches the wording, not the idea.
- Attach one line of real, concrete experience to at least one of them — a tool named with nothing behind it rarely survives a human read.
- Lead with what you built, trained or shipped — this role is judged on the AI system itself, not the tools around it.
Want an expert to read your CV for this job?
Free. Send your CV and the role you want next. We reply by email within 2 to 4 business days.
Get a free CV reviewGet new software engineer jobs (Builds AI ●●●●) by email
One email a week with the new software engineer jobs (Builds AI ●●●●), each rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.
Free. One email a week. Unsubscribe in one click.
Similar roles
Software Engineering roles that build AI, at other companies.
What kind of AI work fits you?
Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.
Find my next step