Level

Gusto

Staff Software Engineer, Gustie Assist

Gusto is hiring a Staff Software Engineer, Gustie Assist in Denver, New York and San Francisco, United States. Level rates it ; you can apply on Gusto.

Level's read on this job

  • Builds AI ●●●● is how Level rates this software engineer role: the job is building AI systems.
  • Tools and skills the posting cites include Ruby On Rails, GraphQL and LLM.
  • Level classifies it as a senior role.
  • Level lists 100 other open roles at Gusto.

AI in this role

Staff Software Engineer building Otto, an AI agent runtime and tool infrastructure that automates payroll and HR workflows at Gusto.

ruby-on-railsgraphqlllm
ai-agentssoftware-engineeringapplied-aillm-agentsevaluationsbackend

 

About Gusto

At Gusto, we're on a mission to grow the small business economy. We handle the hard stuff — payroll, health insurance, 401(k)s, and HR — so owners can focus on their craft and their customers. With teams in Denver, San Francisco, and New York, we support more than 500,000 small businesses nationwide and are building a workplace that reflects the people we serve.

All full-time employees receive competitive base pay, benefits, and equity (RSUs) — because everyone who helps build Gusto should share in its success. Offer amounts are determined by role, level, and location. Learn more about our Total Rewards philosophy.

AI is a fundamental part of how work gets done at Gusto. We expect all team members to actively engage with AI tools relevant to their role and grow their fluency as the technology evolves. AI experience requirements vary by role and will be assessed during the interview process.

Gustie Assist builds Otto, the AI agent that Gusto's support advocates rely on to solve customers' hardest payroll, benefits, and compliance problems. When a small business hits a wall and reaches out, the advocate turns to Otto: it reasons over the customer's full context, answers in the moment, and increasingly takes real actions across Gusto's systems on the advocate's behalf to make the customer whole. We're a small platform team building an agent that reasons, acts, and has to get it right when the stakes are someone's payroll.

This is unusually broad, hands-on applied-AI work: you'll own an LLM agent runtime and the full stack around it, including the tool layer that lets it act over Gusto's systems, the Rails/GraphQL backend, the advocate-facing frontend, and the eval system that keeps it trustworthy while it touches live customer accounts. We keep the path from idea to production short, and measure ourselves on customer outcomes, not model novelty.

Here's what you'll do day-to-day:

  • Design and build across the Otto platform, including the runtime and agent graph, the tool/action layer, the Rails/GraphQL backend, and the advocate-facing experience, owning a meaningful slice end-to-end
  • Expand what the agent can safely do: autonomous, tool-using actions with human-in-the-loop approval, built on a secure, auditable identity and permissions model
  • Build the eval and observability systems (LLM-as-judge + deterministic scorers, offline gates and online production monitoring) that let us change the agent in production weekly without regressing correctness or escalation behavior
  • Work directly with LLMs, including prompting, tool/function design, retrieval, and the feedback loops that turn real advocate interactions into a better Otto
  • Partner closely with Product, Data, Design, and our CX teams to turn advocate and customer pain into shipped capabilities
  • Mentor engineers and set the bar for how we build agentic systems responsibly and at scale

Here's what we're looking for:

  • Typically 8+ years of software engineering experience, owning systems end-to-end
  • You've built and shipped LLM-powered or agentic systems in production, including tool-calling/agents, retrieval, or evals, and you know where they break and how to make them reliable
  • Strong full-stack range. Must be comfortable moving between backend services, an LLM runtime, and customer-facing product, and picking up whatever the problem needs
  • Experience owning multi-quarter projects that make measurable user impact at scale
  • Sound judgment about safety and blast radius when software takes real actions on real accounts
  • Ability to mentor engineers and raise the bar around you

Also great to have:

  • Experience with agent frameworks, evals/LLM-as-judge, retrieval, or MCP-style tool architectures
  • Experience with Ruby on Rails and/or JavaScript/React (our stack), or the ability to ramp quickly
  • Familiarity with GraphQL and federated backends
  • Appreciation for a collaborative, test-driven, high-autonomy environment, and clear communication with engineering and business stakeholders

At Gusto, we don't use titles the traditional way, as a signal of rank or hierarchy. Instead, our titles describe two things at once — your craft (what you do, e.g. Engineering, Design) and your scope of ownership (what you're accountable for) — which is why you'll see something like "Head of X" instead of a rank word like "Director" that tells you neither. Because of this, the title on this posting may look different from what you'd expect based on the scope and seniority of the role, and from how similar roles are typically titled elsewhere. If you have questions about how this role compares to your current title or level, your recruiter can help translate.

Gusto has physical office spaces in Denver, San Francisco, and New York City. Employees who are based in those locations will be expected to work from the office on designated days approximately 2-3 days per week (or more depending on role). The same office expectations apply to all Symmetry roles, Gusto's subsidiary, whose physical office is in Scottsdale.

Note: The San Francisco office expectations encompass both the San Francisco and San Jose metro areas. 

When approved to work from a location other than a Gusto office, a secure, reliable, and consistent internet connection is required. This includes non-office days for hybrid employees.

Reliable, consistent presence: We expect regular and predictable attendance, whether you're working in-office, hybrid, or fully remote, so that you stay closely connected to your team, customers, and stakeholders in real time and ensure colleagues and customers receive the timely support and responsiveness they deserve.

Our customers come from all walks of life and so do we. We hire great people from a wide variety of backgrounds, not just because it's the right thing to do, but because it makes our company stronger. If you share our values and our enthusiasm for small businesses, you will find a home at Gusto. 

Gusto is proud to be an equal opportunity employer. We do not discriminate in hiring or any employment decision based on race, color, religion, national origin, age, sex (including pregnancy, childbirth, or related medical conditions), marital status, ancestry, physical or mental disability, genetic information, veteran status, gender identity or expression, sexual orientation, or other applicable legally protected characteristic. Gusto considers qualified applicants with criminal histories, consistent with applicable federal, state and local law. Gusto is also committed to providing reasonable accommodations for qualified individuals with disabilities and disabled veterans in our job application procedures. We want to see our candidates perform to the best of their ability. If you require a medical or religious accommodation at any time throughout your candidate journey, please fill out this form and a member of our team will get in touch with you.

Gusto takes security and protection of your personal information very seriously. Please review our Fraudulent Activity Disclaimer.

Personal information collected and processed as part of your Gusto application will be subject to Gusto's Applicant Privacy Notice.

How we rate this

Staff Software Engineer, Gustie Assist at Gusto rates 85 out of 100 for how much of the daily work is AI. That makes it Builds AI (AI Level 4 of 4). The level is about AI in the job, not seniority.

Classification

Builds AI. The job is building AI systems.

  1. ●●●● Builds AI80 to 100
  2. ●●●○ Works on AI60 to 79
  3. ●●○○ Uses AI40 to 59
  4. ●○○○ Little AI0 to 39

Levels come from how often the tools, models and workflows of the role are named in the posting itself. Read the description and count the AI tools, models and workflows it names.

Prepare for this job

Built from this posting and from similar jobs on Level.

Skills and AI tools this role asks for

AI agentsSoftware EngineeringApplied AILLM AgentsEvaluationsBackendRuby On RailsGraphQL

Also common in software engineer jobs at this level

Pay

Typical software engineer job
$168k

This posting doesn't list pay. Use the typical software engineer figure when pay comes up. See software engineer jobs

Questions you could be asked

  1. How do you decide when an AI agent can act on its own versus asking for approval first?
  2. Tell me about a project where software engineering was part of your work. What did you do?
  3. Tell me about a project where applied ai was part of your work. What did you do?
  4. Tell me about a project where llm agents was part of your work. What did you do?
  5. Tell me about a project where evaluations was part of your work. What did you do?

Adapt your resume

  • List these exact terms on your resume: AI agents, Software Engineering, Applied AI, LLM Agents, and Evaluations. An applicant tracking system matches the wording, not the idea.
  • Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
  • Lead with what you built, trained or shipped. This role is judged on the AI system itself, not the tools around it.

Want an expert to read your CV for this job?

Free. Send your CV and the role you want next. We reply by email within 2 to 4 business days.

Get new software engineer jobs (Builds AI ●●●●) by email

One email a week with the new software engineer jobs (Builds AI ●●●●), each rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.

Free. One email a week. Unsubscribe in one click.

Similar roles

Software Engineering roles that build AI, at other companies.

What kind of AI work fits you?

Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.

Find my next step

More jobs at Gusto

More software engineer jobs

Related searches

Same AI level

Jobs by city