Level

Gong io

Junior Prompt Engineer - AI Research & Reliability

Gong io is hiring a Junior Prompt Engineer - AI Research & Reliability in Tel Aviv, Israel. Level rates it ; you can apply on Level.

AI in this role

langchainllamaindex
prompt-engineeringragnlpai-research

Gong harnesses the power of AI to transform how revenue teams win. The Gong Revenue AI Operating System unifies data, insights, and workflows into a single, trusted system that observes, guides, and acts alongside the world’s most successful revenue teams. Powered by the Gong Revenue Graph, AI-powered intelligence, specialized agents, and trusted applications, Gong helps more than 5,000 companies around the world deeply understand their teams and customers, automate critical sales workflows, and close more deals with less effort. For more information, visit www.gong.io.

At Gong, you will join a company built on innovative products, ambitious goals, and passionate people. We are shaping the future of revenue intelligence and we want people who are excited to build what comes next. You will work with a team that dreams big, moves fast, and cares deeply about the craft and about each other. Here, transparency and trust are core to how we operate, and every person has the opportunity to make a visible impact. If you want to grow, stretch, and do work that truly matters, Gong is the place to do the best work of your career.

As a Prompt Engineer, you will play an essential role in testing, refining, and optimizing the behavior and capabilities of Gong's AI. Working under the guidance of senior prompt engineers and researchers, you will collaborate closely with product teams, data scientists, and engineers to translate user needs into accurate, scalable, and reliable AI workflows.

You'll Own

  • Prompt Optimization & Refinement: Craft, test, and fine-tune prompts designed for key Gong applications, including the Gong Assistant.
  • Agentic System Support: Assist in building and maintaining multi-agent systems, helping configure tool-retrieval workflows, memory mechanisms, and execution paths for complex tasks.
  • Performance Analysis & Evaluation: Conduct regular evaluations of prompt performance using test datasets, benchmarking frameworks, and user feedback to identify areas for accuracy and consistency improvements.
  • Experiment Execution: Run systematic experiments to evaluate new prompting techniques and test updates stemming from the latest advancements in NLP and Generative AI.
  • Technical Documentation: Maintain clear, organized documentation of prompt structures, evaluation results, and system behavior to keep cross-functional teams aligned.

You'll Solve

  • Improving AI Accuracy: Helping address challenges around LLM reasoning and edge cases so Gong AI delivers consistently precise, context-aware answers.
  • Refining User-Facing Workflows: Assisting in bridging product requirements with AI execution to produce consistent and intuitive end-user experiences.
  • Testing for Reliability: Rigorously testing prompts to minimize hallucinations and ensure consistent performance across diverse customer interactions.
  • Learning & Adapting: Quickly acquiring new skills to stay aligned with the rapidly changing landscape of LLMs and generative AI tools.

You'll Impact

  • Global Sales Transformation: The prompts and workflows you refine will directly power tools used by thousands of sales teams every day.
  • The Future of Agentic AI: You will contribute directly to building dependable AI assistants that seamlessly navigate dynamic human interactions.
  • Product Excellence: Your thorough testing and data-driven prompt tweaks will form the foundation for reliable, high-performing AI features.

How You'll Succeed Here

  • Foundational AI/LLM Experience: Hands-on experience (through internships, academic projects, personal projects, or 1–2 years of professional experience) working with LLMs and prompt design techniques (e.g., few-shot prompting, chain-of-thought).
  • Familiarity with AI Frameworks: Basic working knowledge of modern AI development frameworks or agentic concepts (e.g., LangChain, LlamaIndex, or building with LLM APIs/RAG pipelines).
  • Analytical Mindset: A methodical approach to problem-solving with a track record of running experiments, measuring results, and iterating based on data.
  • Coding Proficiency: Proficiency in Python or a similar language to write scripts for automated prompt testing, evaluation, and data processing.
  • Strong Collaboration & Curiosity: Excellent communication skills, a quick-learning mindset, and an eagerness to collaborate across engineering, product, and data science teams.

What makes Research at Gong unique?

Here at Gong, we trust and empower our employees with ownership to solve complex problems, make the right decisions, and build the best products that create radical impact. We call this "Own. Solve. Impact." For our researchers and engineers, it means being involved and able to influence the process to create the best product from day one. If you are curious to discover Gong's wonderful and challenging world, what are you waiting for? Don't delay – fill in your application details. Who knows, maybe there's a Gongster in you!

About Us

We encourage our employees to express their personality and identity (whether gender, ethnic, religious, or sexual), and we ensure fairness and equal opportunities. We follow a hybrid working model that combines working from home, on the go, or at the office. This allows us flexibility, autonomy, positive work relationships, and effective work habits.

To review Gong's privacy policy, visit http://www.gong.io/privacy-policy/ for more details.

#LI-MW1

How we rate this

Junior Prompt Engineer - AI Research & Reliability at Gong io rates 90 out of 100 for how much of the daily work is AI. That makes it Builds AI (AI Level 4 of 4). The level is about AI in the job, not seniority.

Classification

Builds AI. The job is building AI systems.

  1. ●●●● Builds AI80 to 100
  2. ●●●○ Works on AI60 to 79
  3. ●●○○ Uses AI40 to 59
  4. ●○○○ Little AI0 to 39

Levels come from how often the tools, models and workflows of the role are named in the posting itself. Open the description and count.

Prepare for this job

A free preview built only from this posting: what it asks for, what you could be asked in an interview, and how to adjust your resume.

Skills and AI tools this role asks for

Prompt engineeringRAGNLPAI ResearchLangChainLlamaIndex

Questions you could be asked

  1. How do you structure and test a prompt to get consistent output from a language model?
  2. How would you design a retrieval step so the model answers from real data instead of guessing?
  3. What NLP problem have you worked on, and how did you measure whether it actually worked?
  4. Tell me about a research question you investigated. What did you find?
  5. Walk me through how you've used LangChain in your day-to-day work.

Adapt your resume

  • List these exact terms on your resume: Prompt engineering, RAG, NLP, AI Research, and LangChain. An applicant tracking system matches the wording, not the idea.
  • Attach one line of real, concrete experience to at least one of them — a tool named with nothing behind it rarely survives a human read.
  • Lead with what you built, trained or shipped — this role is judged on the AI system itself, not the tools around it.

Want an expert to read your CV for this job?

Free. Send your CV and the role you want next. We reply by email within 2 to 4 business days.

Get new data jobs (Builds AI ●●●●) by email

One email a week with the new data jobs (Builds AI ●●●●), each rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.

Free. One email a week. Unsubscribe in one click.

Similar roles

Data roles that build AI, at other companies.

What kind of AI work fits you?

Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.

Find my next step

More jobs at Gong io

Related searches

Same AI level

Jobs by city