Member of Technical Staff (Applied AI Engineer, Agent Capabilities)
Perplexity is hiring a Member of Technical Staff (Applied AI Engineer, Agent Capabilities) in San Francisco, United States. It pays $220k-$405k a year and Level rates it ; you can apply on Perplexity.
Level's read on this job
- Level rates this AI engineer role Builds AI ●●●●: the job is building AI systems.
- The listed pay starts 20% above the typical AI engineer posting on Level.
- Tools and skills the posting cites include Python, Go and Rust.
- Level classifies it as a mid-level role.
- Level lists 131 other open roles at Perplexity.
AI in this role
Design and ship agentic AI capabilities by turning frontier model research into reliable product features.
Perplexity Computer is one of the defining products of the new era of agentic AI. Millions of people use Perplexity to transform knowledge into action, and the Agent Capabilities team sits at the intersection of frontier AI research and product innovation, building the foundations that shape how users and agents solve increasingly complex tasks.
As every major breakthrough in AI models creates new possibilities, the Agent Capabilities team is responsible for turning frontier AI breakthroughs into reusable product capabilities. We are often the first to evaluate emerging model capabilities, determine where they create real user value, and transform them into reliable, scalable, high quality experiences for both users and agents. This is a highly leveraged role with broad ownership at the intersection of frontier AI research, agent systems, platform engineering, and product innovation.
Tech Stack: Python | Go | Rust | PostgreSQL | DynamoDB | AWS | TypeScript
Why Perplexity is different
Craftsmanship. We build high quality, tasteful products targeting both the AI native and AI curious.
Ownership. You identify the problem, design the solution and ship it.
Entrepreneurship. We think like founders, act with urgency, and hustle to deliver for each other and our users.
Scholarship. Work among highly talented peers, pursuing knowledge and truth, upleveling ourselves, our teams, and our products.
Partnership. We amplify each others' strengths, break down silos, and give selflessly to help our colleagues deliver excellence.
What you'll do
Evaluate frontier models against real user tasks, identify useful behaviors and failure modes, and turn the most promising advances into production agent systems. Own the lifecycle from rapid prototyping and evaluation through launch, monitoring, and iteration.
Improve agents’ ability to plan, use tools, manage context, recover from errors, and complete long-running tasks reliably.
Apply state of the art ML and LLM techniques to design scalable agent capabilities such as skills, plugins, artifact generation, tools integrate and use, auto-research, and multi-agent collaboration. Shape the architecture, abstractions, and product experiences that enable both users and agents to compose increasingly sophisticated solutions for real-world tasks.
Own agent behavior and capabilities end-to-end, from user-facing products and interfaces to backend services. Define offline and online evaluations for task completion, correctness, safety, latency, cost, and user satisfaction. Iteratively improve across models, prompts, harnesses, and products for different problem spaces.
Build secure, observable, and reliable agent systems, including permissions and safeguards for sensitive actions. Develop tracing, replay, and monitoring infrastructure that makes agent failures reproducible and actionable.
Collaborate closely with PM, Data Science, Research, to identify high-impact opportunities in understanding and validating emerging model capabilities, and turn complex agent behaviors into simple, reliable product experiences.
Apply relevant advances in models, inference, evaluation, and agent architecture when they produce measurable improvements in production performance. Set technical direction on ambiguous problems and raise the bar through design reviews, mentorship, and technical leadership.
Qualifications
Typically 6+ years of professional software engineering experience, with a track record of building and owning robust AI-powered, large-scale, user-facing or data-intensive products. Exceptional candidates with less experience and an outstanding record of impact are encouraged to apply.
Strong software engineering fundamentals, with experience building and operating AI/ML products, backend services, or distributed systems at scale.
Experience owning the AI product lifecycle, including data analysis, rigorous evaluation, production monitoring, and iterative improvement. Able to define metrics and use production data and user feedback to guide decisions.
Practical experience in one or more relevant areas, such as agent harnesses, tool use, context engineering, model evaluation, browser automation, or long-running task execution.
Strong product judgment and execution: you can translate ambiguous user needs into applied AI or ML problems and ship durable solutions with measurable user impact.
Genuine interest in frontier AI capabilities, agent systems, and excitement for rapidly exploring, evaluating, and productizing new model behaviors.
Nice to have
Experience with LLM context engineering or harness engineering, experience with subagents, coding assistants, long-running or autonomous task execution.
Deep familiarity with the strengths and limitations of current model families across reasoning, tool use, context management, and long-horizon tasks.
Experience building agent permissions, safeguards, evaluation infrastructure, or production observability systems.
Experience with mid-training, post-training, or reinforcement learning for frontier or open-source models, along with a strong understanding of model strengths and limitations across reasoning, tool use, context management, and long-horizon tasks.
AI/ML research experience demonstrated through publications, open-source contributions, or other meaningful research impact.
Time spent at a fast-growing startup or on a high-ownership engineering team.
How we rate this
Member of Technical Staff (Applied AI Engineer, Agent Capabilities) at Perplexity rates 90 out of 100 for how much of the daily work is AI. That makes it Builds AI (AI Level 4 of 4). The level is about AI in the job, not seniority.
Builds AI. The job is building AI systems.
- ●●●● Builds AI80 to 100
- ●●●○ Works on AI60 to 79
- ●●○○ Uses AI40 to 59
- ●○○○ Little AI0 to 39
Levels come from how often the tools, models and workflows of the role are named in the posting itself. Read the description and count the AI tools, models and workflows it names.
Prepare for this job
Built from this posting and from similar jobs on Level.
Skills and AI tools this role asks for
Also common in AI engineer jobs at this level
Pay
- This job starts at
- $220k
- Typical AI engineer job
- $184k
This posting starts 20% above the typical AI engineer job. See AI engineer jobs
Questions you could be asked
- How do you decide that one model's output is better than another's for a given task?
- Tell me about a research question you investigated. What did you find?
- Tell me about a project where applied ai was part of your work. What did you do?
- Tell me about a project where llms was part of your work. What did you do?
- Tell me about a project where agent systems was part of your work. What did you do?
Adapt your resume
- List these exact terms on your resume: AI Evaluation, AI Research, Applied AI, LLMs, and Agent Systems. An applicant tracking system matches the wording, not the idea.
- Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
- Lead with what you built, trained or shipped. This role is judged on the AI system itself, not the tools around it.
Want an expert to read your CV for this job?
Free. Send your CV and the role you want next. We reply by email within 2 to 4 business days.
Get new AI engineer jobs (Builds AI ●●●●) by email
One email a week with the new AI engineer jobs (Builds AI ●●●●), each rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.
Free. One email a week. Unsubscribe in one click.
Similar roles
Software Engineering roles that build AI, at other companies.
What kind of AI work fits you?
Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.
Find my next step