Level

Lucidya

AI Tech Lead

Lucidya is hiring an AI Tech Lead for a remote role open to applicants in Saudi Arabia. Level rates it ; you can apply on Lucidya.

Level's read on this job

  • Builds AI ●●●● is how Level rates this role: the job is building AI systems.
  • This is listed as a remote role.
  • The posting mentions AI agents, fine tuning and AI evaluation among its tools and skills.
  • Lucidya has 25 other open roles on Level.
  • Posted in the last few days.

AI in this role

ai-agentsfine-tuningai-evaluationnlpspeech

About Lucidya

Lucidya builds an operating system for Agentic customer experience. Our flagship product line is an agentic platform (Agent Studio) where customers build and run AI agents that resolve real customer experience issues across text and voice channels, in Arabic and English.

Role summary

The AI Tech Lead is the senior hands-on engineer accountable for the quality, reliability and technical direction of the AI layer of our agentic platform. You will set the technical bar for a team of AI engineers who each own an area, and you will write production code yourself.  You will need to wear 2 hats, one is the AI hat and the other is leadership

Key responsibilities

Technical direction 

  • Own and be accountable for the AI  architecture and harness: model selection, prompting patterns, retrieval design, guardrails and voice pipeline.
  • Make and document technical decisions with clear rationale.

Quality, evaluation and reliability

  • Define the evaluation standard and move key work from experimentation to production
  • Introduce leading testing frameworks for Agentic development 
  • Ensure production monitoring and online evals catch quality drops, hallucinations and latency spikes before customers report them.

Team leadership and engineering practices

  • Lead the AI team in designing, developing, and delivering our Agentic Platform
  • Mentor AI engineers, raise the technical bar through pairing and feedback, and contribute to hiring.

Hands-on delivery

  • Lead debugging of critical production incidents involving AI behaviour.
  • Manage the building of prototypes/experiments  to validate new capabilities (new models, agent patterns, voice features) before the team commits to them.

Cross-functional partnership

  • Work with Product to turn customer use cases into technical requirements
  • Work with Engineering on shared platform work: tool calling, workflows, deployment and scaling.

Mindset and Behaviors

  • Ownership: takes outcomes end to end, including gaps between teams, and follows through without being asked.
  • Trade-off judgement: grounds decisions in business needs and can explain the trade-offs between quality, speed and cost.
  • Constructive challenge: comfortable questioning existing approaches and proposing better ones.
  • Team player: shares credit, helps teammates succeed, and puts team goals ahead of individual wins.
  • Creativity and innovation: solve complex challenges with 'out-of-box' thinking and be a champion for innovation 

Requirements

  • Experience: 7+ years in software or ML engineering, including 2+ years building LLM-based applications in production. Not just building AI point solutions, AI platform level experience is required.
  • Technical leadership: has led a team of 3+ AI engineers/scientist technically (design reviews, standards, mentoring)
  • LLM application engineering: deep hands-on experience with prompting, structured outputs, guardrails, agent patterns/harness development (planning, tool use, multi-step reasoning).
  • Ability to work in ambiguous settings: can bring clarity and structure to complex situations
  • Evaluation: has built LLM evaluation pipelines (golden datasets, LLM-as-judge, regression suites) and used them to gate releases.
  • Production engineering: strong Python; experience with APIs, cloud deployment, observability and debugging distributed systems.
  • Communication: fluent written and spoken English; able to write clear design docs and decision records.

Nice-to-have qualifications

  • Arabic NLP: experience with Arabic and its dialects, especially Gulf Arabic, in LLM or speech systems.
  • Voice AI: experience with ASR, TTS and real-time voice agents, including latency optimisation.
  • Production monitoring for LLMs: hands-on use of tracing and online eval tools (for example Langfuse, Arize or similar).
  • Model adaptation: fine-tuning or distilling open-weight models, and serving them cost-effectively.

How we rate this

AI Tech Lead at Lucidya rates 98 out of 100 for how much of the daily work is AI. That makes it Builds AI (AI Level 4 of 4). The level is about AI in the job, not seniority.

Classification

Builds AI. The job is building AI systems.

  1. ●●●● Builds AI80 to 100
  2. ●●●○ Works on AI60 to 79
  3. ●●○○ Uses AI40 to 59
  4. ●○○○ Little AI0 to 39

Levels come from how often the tools, models and workflows of the role are named in the posting itself. Read the description and count the AI tools, models and workflows it names.

Prepare for this job

Built from this posting and from similar jobs on Level.

Skills and AI tools this role asks for

AI agentsFine-tuningAI EvaluationNLPSpeech

Questions you could be asked

  1. How do you decide when an AI agent can act on its own versus asking for approval first?
  2. Walk me through fine-tuning a model: what data did you use, and how did you check the result?
  3. How do you decide that one model's output is better than another's for a given task?
  4. What NLP problem have you worked on, and how did you measure whether it actually worked?
  5. What have you built with speech recognition or text-to-speech, and where did it break?

Adapt your resume

  • List these exact terms on your resume: AI agents, Fine-tuning, AI Evaluation, NLP, and Speech. An applicant tracking system matches the wording, not the idea.
  • Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
  • Lead with what you built, trained or shipped. This role is judged on the AI system itself, not the tools around it.

Want an expert to read your CV for this job?

Free. Send your CV and the role you want next. We reply by email within 2 to 4 business days.

Get new remote AI jobs (Builds AI ●●●●) by email

One email a week with the new remote AI jobs (Builds AI ●●●●), each rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.

Free. One email a week. Unsubscribe in one click.

Similar roles

Other roles that build AI, at other companies.

What kind of AI work fits you?

Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.

Find my next step

More jobs at Lucidya

Related searches

Same AI level

Jobs by city