Senior Software Engineer, Reliability
Temporal is hiring a Senior Software Engineer, Reliability for a remote role open to applicants in United States. It pays $141k-$231k a year and Level rates it ; you can apply on Temporal.
Level's read on this job
- On Level's scale, this software engineer role is Little AI ●○○○: aI is not part of the work.
- The posting lists this role as remote.
- Tools and skills the posting cites include RAG.
- Level lists 83 other open roles at Temporal.
- The role was posted in the last few days.
AI in this role
Join the Reliability team as a Senior Software Engineer, reporting to Tushar Roy, and help improve the reliability of operating Temporal Cloud end to end. You’ll build an AI-first reliability experience, including building a Reliability Agent from scratch that helps the SRE team triage common issues, surface useful context, and recommend next steps. You’ll also help make reliability knowledge and practices accessible across engineering so ownership is shared rather than concentrated with a small number of experts.
What You’ll DoOwn reliability outcomes for operating Temporal Cloud end to end, partnering across engineering, infrastructure, and product to drive measurable improvements.
Build and evolve the Reliability Agent, including workflows that gather context from telemetry, incidents, runbooks, deployments, and service history to support faster, more consistent triage.
Design safe, useful agent experiences for handling routine reliability questions and issues, with appropriate human oversight, escalation paths, auditability, and safeguards against incorrect actions.
Strengthen incident response for Temporal Cloud, from detection and triage through escalation, mitigation, and communication, and lead post-incident reviews that turn into durable corrective actions.
Define and evolve reliability practices, including service-level objectives, alerting thresholds, operational readiness criteria, and escalation paths.
Plan and run gamedays and safely expand chaos testing to validate failure response, evaluate agent-assisted operations, and reduce operational risk.
Build and maintain reliability scorecards that make service health, operational readiness, agent effectiveness, and improvement priorities visible.
Lead load, performance, and capacity testing, and improve observability standards across services.
Strong computer science fundamentals, especially in distributed systems, concurrency, performance, and fault-tolerant design.
Experience designing, building, or operating complex systems under high load and partial failure.
Experience building AI-powered tools, agents, or production automation, with an understanding of tool use, evaluation, state, failure modes, and human-in-the-loop design.
A track record of driving reliability improvements across multiple services, systems, or engineering teams.
Hands-on experience with incident response and post-incident reviews, including leading incidents and following corrective actions through to completion.
Hands-on experience with one or more of gamedays, chaos testing, load testing, capacity planning, reliability scorecards, or observability programs.
Sound judgment in ambiguous situations, with the ability to balance reliability, agent autonomy, safety, customer impact, and delivery speed.
Clear communication skills and the ability to align stakeholders, share operational knowledge, mentor others, and participate in an on-call rotation. This is a remote United States role with no regular travel expected.
Experience operating multi-tenant systems and designing protections against noisy-neighbor behavior.
Experience building internal platforms or tooling that enables teams to meet reliability standards.
Familiarity with LLM observability, agent evaluation, retrieval-augmented generation, or workflow orchestration systems.
Open source contributions in infrastructure, distributed systems, AI, or reliability engineering.
Temporal Technologies is an Equal Opportunity Employer. Temporal Technologies does not discriminate on the basis of race, religion, color, sex, gender identity, sexual orientation, age, non-disqualifying physical or mental disability, national origin, veteran status, or any other basis covered by appropriate law. All employment is decided on the basis of qualifications, merit, and business need. We embrace and celebrate differences and diversity.
Temporal is committed to providing access, equal opportunity, and reasonable accommodation for individuals with disabilities in employment, its services, programs, and activities. If you need to request a reasonable accommodation, please let your Recruiter know so we can assist.
How we rate this
Senior Software Engineer, Reliability at Temporal rates 30 out of 100 for how much of the daily work is AI. That makes it Little AI (AI Level 1 of 4). The level is about AI in the job, not seniority.
Little AI. AI is not part of the work.
- ●●●● Builds AI80 to 100
- ●●●○ Works on AI60 to 79
- ●●○○ Uses AI40 to 59
- ●○○○ Little AI0 to 39
Levels come from how often the tools, models and workflows of the role are named in the posting itself. Read the description and count the AI tools, models and workflows it names.
Prepare for this job
Built from this posting and from similar jobs on Level.
Also common in software engineer jobs at this level
Pay
- This job starts at
- $141k
- Typical software engineer job
- $167k
This posting starts 16% below the typical software engineer job. See software engineer jobs
Get your CV reviewed before you apply
Send your CV and the role you want next. Your review arrives by email within 3 days.
Get new remote software engineer jobs by email
One email a week, each job rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.
Free.
Similar roles
Software Engineering roles that involve little AI, at other companies.
What kind of AI work fits you?
Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.
Find my next step