Level

Gong io

Senior Backend Engineer - AI Framework (Python)

Gong io is hiring a Senior Backend Engineer - AI Framework (Python) in Tel Aviv, Israel. Level rates it ; you can apply on Gong io.

Level's read on this job

  • Level rates this software engineer role Builds AI ●●●●: the job is building AI systems.
  • The posting allows some remote work.
  • Tools and skills the posting cites include LangChain, LangGraph and Python.
  • Level classifies it as a senior role.
  • Level lists 87 other open roles at Gong io.

AI in this role

Senior Backend Engineer building foundational platforms, frameworks, and tools to orchestrate and evaluate AI agents at scale.

langchainlanggraphpythonlangsmith
ai-agentsai-evaluationai-safetybackend-engineeringai-frameworksagentic-workflowsdistributed-systems

Gong harnesses the power of AI to transform how revenue teams win. The Gong Revenue AI Operating System unifies data, insights, and workflows into a single, trusted system that observes, guides, and acts alongside the world’s most successful revenue teams. Powered by the Gong Revenue Graph, AI-powered intelligence, specialized agents, and trusted applications, Gong helps more than 5,000 companies around the world deeply understand their teams and customers, automate critical sales workflows, and close more deals with less effort. For more information, visit www.gong.io.

At Gong, you will join a company built on innovative products, ambitious goals, and passionate people. We are shaping the future of revenue intelligence and we want people who are excited to build what comes next. You will work with a team that dreams big, moves fast, and cares deeply about the craft and about each other. Here, transparency and trust are core to how we operate, and every person has the opportunity to make a visible impact. If you want to grow, stretch, and do work that truly matters, Gong is the place to do the best work of your career.

As a Senior Backend Engineer on Gong’s AI Framework team, you will build the foundational platform that enables the entire organization to design, evaluate, deploy, and operate AI agents at scale. This is a new, high-impact team responsible for creating the frameworks, tools, and guardrails that power Gong’s agentic ecosystem.

 

You’ll work deeply in the agentic space, designing systems for orchestration, evaluation, observability, and safety. The platforms you build will be used by multiple teams across Gong, making your impact immediate and company-wide.

You’ll Own:

  • Agentic Framework Architecture: Designing and building Gong’s internal agentic framework, leveraging and integrating industry-standard tools such as LangChain, LangSmith, ADK, and similar ecosystems.
  • Evaluation and Quality Systems: Building evaluation frameworks and workflows for AI agents, including offline and online evaluations, quality metrics, regression detection, and experimentation infrastructure.
  • Observability, Monitoring, and Guardrails: Providing the organization with robust observability capabilities for AI agents, including tracing, logging, monitoring, cost tracking, and safety guardrails to ensure reliable and responsible usage.
  • Developer Enablement Platforms: Creating APIs, SDKs, and abstractions that enable product teams to easily build, test, and operate agents while adhering to platform standards.
  • Cross-Language Integrations: Designing integrations and tooling across Python and Java to enable seamless adoption of the AI framework within Gong’s broader backend ecosystem.
  • Agent Runtime and Execution Engine: Building the runtime responsible for orchestrating agent execution, managing tool calls, maintaining state and memory, and ensuring reliable execution across distributed systems.
  •  

You’ll Solve:

  • Agent Lifecycle and Orchestration Complexity: Managing agent execution, tool usage, memory, workflows, and failure modes in production-grade systems.
  • AI System Reliability at Scale: Ensuring agents remain observable, debuggable, and safe as usage scales across teams and products.
  • Evaluation and Drift Challenges: Detecting quality regressions, model behavior changes, and unintended agent behaviors through robust evaluation and monitoring systems.
  • Platform Adoption Friction: Balancing flexibility with guardrails so teams can innovate quickly without compromising reliability, security, or cost controls.

You’ll Impact:

  • Company-Wide AI Enablement: Empowering every engineering team at Gong to build agent-based solutions faster, with higher quality and confidence.
  • Foundational AI Infrastructure: Establishing the core frameworks, evaluations, and observability standards that all AI agents at Gong will rely on.
  • AI Safety and Quality Bar: Raising the bar for how AI systems are evaluated, monitored, and governed across the company.

How You’ll Succeed Here

  • 7+ years of backend engineering experience, with strong system design and platform-building expertise.
  • Strong analytical and problem-solving skills, with the ability to debug and resolve complex technical issues efficiently.
  • Hands-on experience designing and building agentic systems or agent frameworks in production, including orchestration, tool usage, memory management, and multi-step workflows.
  • Experience extending or building frameworks on top of tools like LangChain, LangGraph, ADK, or similar agent orchestration frameworks.
  • Experience designing, implementing, and operating production-grade AI agents, including handling failure modes, retries, observability, and real user traffic.
  • Strong understanding of AI evaluation methodologies, including agent evaluations, prompt evaluation, regression testing, and quality monitoring.
  • High proficiency in Python for building production-grade AI frameworks and services.
  • Familiarity with Java and experience integrating backend platforms or tooling into Java-based systems.
  • Experience building observability, monitoring, or platform tooling for distributed systems.
  • Strong analytical skills and the ability to reason about complex, evolving AI-driven systems.
  • Experience with cloud platforms and scalable microservices architectures.
  • Excellent communication skills and a strong platform mindset, with experience enabling multiple teams.

 

*We operate in a flexible hybrid work model.

What Makes Engineering at Gong Unique?

At Gong, we trust and empower our employees with ownership to solve complex problems, make sound decisions, and build products that create meaningful impact. We call this “Own. Solve. Impact.”

 

For our engineers, this means it’s not just about writing code. You are involved in and able to influence the entire process to create the best possible product. If you’re curious to discover Gong’s dynamic and challenging environment, what are you waiting for? Don’t delay—submit your application today. Who knows, maybe there’s a Gongster in you!

We encourage our employees to express their personality and identity (whether gender, ethnic, religious, or sexual), and we ensure fairness and equal opportunities. We follow a hybrid working model that combines working from home, on the go, or at the office. This allows us: flexibility, autonomy, positive work relationships, and effective work habits.

If these considerations are important to you when choosing a workplace, we'd love to see you with us.

To review Gong's privacy policy, visit www.gong.io/privacy-policy/ for more details.     

#LI-MK3

 

How we rate this

Senior Backend Engineer - AI Framework (Python) at Gong io rates 90 out of 100 for how much of the daily work is AI. That makes it Builds AI (AI Level 4 of 4). The level is about AI in the job, not seniority.

Classification

Builds AI. The job is building AI systems.

  1. ●●●● Builds AI80 to 100
  2. ●●●○ Works on AI60 to 79
  3. ●●○○ Uses AI40 to 59
  4. ●○○○ Little AI0 to 39

Levels come from how often the tools, models and workflows of the role are named in the posting itself. Read the description and count the AI tools, models and workflows it names.

Prepare for this job

Built from this posting and from similar jobs on Level.

Skills and AI tools this role asks for

AI agentsAI EvaluationAI SafetyBackend EngineeringAI FrameworksAgentic WorkflowsDistributed SystemsLangChain

Also common in software engineer jobs at this level

Pay

Typical software engineer job
$168k

This posting doesn't list pay. Use the typical software engineer figure when pay comes up. See software engineer jobs

Questions you could be asked

  1. How do you decide when an AI agent can act on its own versus asking for approval first?
  2. How do you decide that one model's output is better than another's for a given task?
  3. How do you think about the risk of an AI system in this kind of role failing silently?
  4. Tell me about a project where backend engineering was part of your work. What did you do?
  5. Tell me about a project where ai frameworks was part of your work. What did you do?

Adapt your resume

  • List these exact terms on your resume: AI agents, AI Evaluation, AI Safety, Backend Engineering, and AI Frameworks. An applicant tracking system matches the wording, not the idea.
  • Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
  • Lead with what you built, trained or shipped. This role is judged on the AI system itself, not the tools around it.

Want an expert to read your CV for this job?

Free. Send your CV and the role you want next. We reply by email within 2 to 4 business days.

Get new remote software engineer jobs (Builds AI ●●●●) by email

One email a week with the new remote software engineer jobs (Builds AI ●●●●), each rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.

Free. One email a week. Unsubscribe in one click.

Similar roles

Software Engineering roles that build AI, at other companies.

What kind of AI work fits you?

Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.

Find my next step

More jobs at Gong io

More software engineer jobs

Related searches

Same AI level

Jobs by city