Skip to content

Shepherd

Software Engineer, Applied AI

Shepherd is hiring a Software Engineer, Applied AI in San Francisco, United States. It pays $170k-$400k a year and Level rates it ; you can apply on Shepherd.

Level's read on this job

  • Works on AI ●●●○ is how Level rates this software engineer role: the daily work is on AI products, without building the model.
  • The listed pay starts close to the typical software engineer posting on Level.
  • Tools and skills the posting cites include prompt engineering, RAG and AI agents.
  • Level classifies it as a senior role.
  • Level lists 24 other open roles at Shepherd.

AI in this role

prompt-engineeringragai-agents
What we do

Build the insurance behind the physical world.

The world is building data centers, energy projects, hospitals, schools, and critical infrastructure. Every one of those projects needs insurance to move forward. Yet the process of getting that insurance still depends on scattered documents, manual work, and weeks of back-and-forth.

Shepherd is rebuilding commercial insurance with software, data, AI, and deep underwriting expertise. We started in construction and energy, where understanding the specifics of a project matters and better decisions have consequences far beyond a screen.

We develop insurance products, decide which risks to insure and how to price them, and partner with established insurers to back the coverage. We own the platform our team uses to turn complex submissions into coverage for the builders and operators shaping the world around us.

Real problems. Real ownership.

Our engineers, designers, underwriters, CX, and actuaries build together. The problems span turning messy documents into reliable data, making pricing more precise, and designing AI agents that can take on increasingly complex underwriting work.

The ambition is a platform where experts spend more time on judgment and relationships, supported by software that handles the work around them. Join us to build systems whose decisions help real projects get built.

630+ customers / $500B+ insured project value

Our investors

Capital to build. Partners to grow with.

$67M total funding / $42M Series B in March 2026

Shepherd is backed by Intact Private Capital, Costanoa Ventures, Spark Capital, Susa Ventures, and Y Combinator. In March 2026, we announced a $42M Series B led by Intact Private Capital, bringing our total funding to $67M.

Intact is also a capacity partner. Alongside its investment, Intact works with Shepherd to bring insurance products to market. That relationship connects our platform and underwriting expertise with the resources of a global insurer.

A bigger opportunity ahead

We are investing in new insurance products, our underwriting team, and the path toward autonomous underwriting. For the people joining Shepherd, that means the chance to shape both the technology and the business it makes possible.

Our backing brings together investors who build technology companies and partners who understand insurance. We are building a company that earns the confidence of both.

The Role

We are hiring a Software Engineer focused on Applied AI to build intelligent systems that directly power our underwriting and pricing engine. This role sits at the intersection of product engineering, AI infrastructure, and real-world insurance workflows.

You will design and ship production AI systems that meaningfully improve how we evaluate risk, price policies, and operate our business.

What You’ll Do

  • Partner with product, engineering, underwriting, and data teams to identify high-leverage AI opportunities

  • Design, build, and deploy LLM-powered features across underwriting, pricing, and internal tooling

  • Develop AI agents and retrieval-augmented systems that extract structured insights from unstructured insurance data

  • Build production-grade AI infrastructure for model serving, inference, evaluation, and monitoring

  • Create internal AI tools that enable underwriters and operators to move faster with higher quality decisions

  • Establish best practices for prompt engineering, evaluation frameworks, and model reliability

  • Own AI features end-to-end from ideation to production

What We’re Looking For

  • Strong backend engineering experience building scalable APIs and distributed systems

  • Hands-on experience shipping AI-powered products into production

  • Familiarity with LLMs, RAG architectures, embeddings, and vector databases

  • Experience integrating AI systems into user-facing or workflow-driven applications

  • Comfort with cloud infrastructure and deploying AI workloads at scale

  • A product mindset and the ability to translate ambiguous business problems into concrete AI systems

  • You have at least 5+ years of working experience (preferably as a full-stack engineer) with a track record of delivering high-impact products

Bonus Points

  • Experience building AI agents or multi-step reasoning systems

  • Background in applied machine learning beyond generative AI

  • Experience with pricing systems, financial infrastructure, or risk modeling

  • Interest in transforming legacy industries with modern AI systems

Why This Role Matters

Insurance is one of the largest industries in the world, yet much of underwriting and pricing remains manual and fragmented. At Shepherd, AI is not a side project – it is core to how we build durable competitive advantage.

You will help define how applied AI transforms risk evaluation in high-hazard industries and shape the future of AI-native insurance infrastructure.

Our Tech Stack

Frontend

  • React & Next.js

  • Typescript

  • GraphQL w/ Apollo

Backend

  • Node.js

  • Postgres & Redis

  • Typescript

  • GraphQL APIs

How we work

Shepherd runs on four values. Here's what each one means in this seat.

  • Think big, build big. We exist to protect progress and the industries that rely on it. The work here is aimed at a system that runs on its own, and the roadmap gets sequenced backward from that rather than forward from what's easy.

  • Win together. We rise as one. We support each other, raise the bar, and celebrate collective success. Come set a standard the rest of the team inherits.

  • Cross the aisle. Collaboration wins. We listen deeply, work across boundaries, and prioritize shared success over individual lanes. The best product calls here come from engineers who've sat with underwriters and underwriters who understand where the model breaks, and much of this job is listening closely enough on both sides to make that happen.

  • Go get it. We act with urgency, move with confidence, take smart risks, and push forward with intention. Nobody hands you the roadmap, the data, or the meeting invite. You pull the failing runs, book the time with the underwriters, and decide what matters.

Benefits

🏥 Premium Healthcare
100% contribution to health, dental, and vision

🥕 Fertility benefits and family building support

🏖️ Flexible PTO
Flexibility to take the time off, recharge, and perform

🥗 Daily lunches, dinners, and snacks
We work together, and enjoy meals together too

🖥️ SF, NYC, Dallas-Fort Worth, Chicago and LA Offices

📚 Professional Development
Access to premium coaching, including leadership development

🏦 Competitive 401(k) Plan

🐶 Dog-friendly office
Plenty of dogs to play with and make friends with in the SF office

How we rate this

Software Engineer, Applied AI at Shepherd rates 68 out of 100 for how much of the daily work is AI. That makes it Works on AI (AI Level 3 of 4). The level is about AI in the job, not seniority.

Classification

Works on AI. The daily work is on AI products, without building the model.

  1. ●●●● Builds AI80 to 100
  2. ●●●○ Works on AI60 to 79
  3. ●●○○ Uses AI40 to 59
  4. ●○○○ Little AI0 to 39

Levels come from how often the tools, models and workflows of the role are named in the posting itself. Read the description and count the AI tools, models and workflows it names.

Prepare for this job

Built from this posting and from similar jobs on Level.

Skills and AI tools this role asks for

Prompt engineeringRAGAI agents

Also common in software engineer jobs at this level

Pay

This job starts at
$170k
Typical software engineer job
$168k

This posting starts close to the typical software engineer job. See software engineer jobs

Questions you could be asked

  1. How do you structure and test a prompt to get consistent output from a language model?
  2. How would you design a retrieval step so the model answers from real data instead of guessing?
  3. How do you decide when an AI agent can act on its own versus asking for approval first?
  4. Describe a typical day in a role like this one: which parts run through AI directly?
  5. If you removed AI from this role, what would be left, and how do you decide what still needs a human?

Adapt your resume

  • List these exact terms on your resume: Prompt engineering, RAG, and AI agents. An applicant tracking system matches the wording, not the idea.
  • Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
  • Show where AI is part of your daily process, not a one-off project. This role expects it to be a running habit.

Get your CV reviewed before you apply

Send your CV and the role you want next. Your review arrives by email within 3 days.

Get new software engineer jobs (Works on AI ●●●○ or higher) by email

One email a week, each job rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.

Free.

Similar roles

Software Engineering roles that work on AI, at other companies.

What kind of AI work fits you?

Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.

Find my next step

More jobs at Shepherd

More software engineer jobs

Related searches

Same AI level

Jobs by city