Member of Technical Staff (Site Reliability Engineer, Crawler)
Perplexity is hiring a Member of Technical Staff (Site Reliability Engineer, Crawler) in London, United Kingdom. Level rates it ; you can apply on Perplexity.
Level's read on this job
- On Level's scale, this role is Little AI ●○○○: aI is not part of the work.
- Level classifies it as a lead role.
- Level lists 134 other open roles at Perplexity.
- The role was posted in the last few days.
AI in this role
Keeping a crawler running is not the same as keeping it productive. Queues can grow while servers look healthy, and a small change can become a fleet-wide bottleneck. On Perplexity's Crawler team, you'll improve throughput, plan capacity, and build operational reliability through safer deployments, better observability, and durable fixes.
Responsibilities
Operate and optimize Kubernetes workloads and supporting infrastructure for crawler services, including fetching and rendering fleets.
Build and maintain infrastructure as code and CI/CD pipelines, with safe rollouts, validation, and fast rollback.
Define SLOs and build monitoring, alerting, and observability for availability, latency, throughput, and resource saturation.
Own capacity planning and resource efficiency; diagnose queue backlogs, network failures, and resource bottlenecks with service owners.
Participate in the team's on-call rotation, lead incident response, and turn blameless postmortems into durable reliability improvements.
Write production software to automate diagnosis and routine remediation, with validation and approval gates for high-impact actions.
Qualifications
5+ years of experience in SRE, production engineering, or infrastructure-heavy backend roles, with strong programming skills in Python, C++, Rust, or Go.
Hands-on experience with cloud infrastructure, production Kubernetes, infrastructure as code such as Terraform, and automated deployment workflows.
Strong Linux and networking fundamentals, including TCP/IP, DNS, TLS, HTTP, and load balancing.
Experience building observability with tools such as Datadog, Prometheus, or Grafana, and using SLOs to guide reliability improvements.
Proven experience diagnosing distributed-system failures, leading production incidents, and improving system performance or resource efficiency.
Nice to have
Experience operating web crawlers, search infrastructure, or browser fleets at scale.
Experience with distributed queues, backpressure, workload isolation, or multi-region recovery.
How we rate this
Member of Technical Staff (Site Reliability Engineer, Crawler) at Perplexity rates 16 out of 100 for how much of the daily work is AI. That makes it Little AI (AI Level 1 of 4). The level is about AI in the job, not seniority.
Little AI. AI is not part of the work.
- ●●●● Builds AI80 to 100
- ●●●○ Works on AI60 to 79
- ●●○○ Uses AI40 to 59
- ●○○○ Little AI0 to 39
Levels come from how often the tools, models and workflows of the role are named in the posting itself. Read the description and count the AI tools, models and workflows it names.
Get new software engineering jobs by email
One email a week, each job rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.
Free.
Similar roles
Software Engineering roles that involve little AI, at other companies.
What kind of AI work fits you?
Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.
Find my next step