Level

DeepLight AI

Lead Data Engineer

AI in this role

databricks

DeepLight AI is a specialist AI and data consultancy dedicated to helping organisations turn complex data into secure, scalable, and actionable business capability. Based in the UAE, DeepLight partners with clients across a range of industries to design and deliver tailored data, analytics, and AI solutions.

DeepLight does not take a one-size-fits-all approach. We work with clients to understand their business context, existing technology landscape, and strategic goals, then design solutions that integrate effectively into their enterprise architecture. From building robust data foundations to enabling advanced analytics and AI platforms, we help clients create practical, high-impact intelligent systems that are secure, scalable, and aligned to business value.

We are looking for a Lead Data Engineer who thrives at the intersection of hands-on technical excellence, architectural vision, and team leadership. If you love solving complex data challenges, setting engineering benchmarks, and shaping real-world solutions directly with clients, this is your stage.

The Opportunity

As a Lead Data Engineer, you will be the primary technical authority driving data engineering for high-profile client engagements. This is a high-impact, hands-on leadership role where you will design production-grade platforms, elevate engineering quality, and mentor the next generation of talent.

You’ll be leading by example—balancing rapid delivery with long-term engineering rigor, making pragmatic architectural decisions, and serving as a trusted technical advisor to client stakeholders.

What You’ll Do

Drive End-to-End Delivery

  • Architect, build, and deploy production-grade data pipelines, lakehouses, and analytics-ready datasets.
  • Turn complex business problems into clear technical designs, delivery roadmaps, and actionable engineering tasks.
  • Stay hands-on: solve tough technical challenges, perform code reviews, and jump in on production issue resolution.

Raise the Engineering Bar

  • Establish and champion best-in-class standards for code quality, testing, CI/CD, documentation, and data governance.
  • Build resilient, monitored, and secure data pipelines designed for scale and enterprise compliance.
  • Drive operational excellence across version control, automated testing, runbooks, and platform monitoring.

Inspire & Influence

  • Coach and Mentor mid and senior level engineers, fostering a high-performance culture grounded in technical discipline and continuous growth.
  • Partner directly with client architects, data scientists, and business leaders, translating complex technical choices into clear business value.

As an AI consultancy, our greatest asset is the expertise of our people.
While technical mastery is the foundation of what we do, the ability to bridge the gap between complex data science and actionable business value is what defines your success with Deeplight.
We're looking for individuals who are not only world-class in their fields of specialism, but also compelling communicators and persuasive advocates for their own skills.
You will be the face of our firm, tasked with building trust, articulating the "why" behind your technical decisions, and effectively "selling" your vision to high-level stakeholders.
If you thrive on the challenge of presenting cutting-edge solutions as much as you do on building them, you will fit right in.

Requirements

What We’re Looking For

  • Advanced proficiency in Python and SQL with a proven track record of delivering end-to-end ETL/ELT pipelines and scalable data architectures.
  • Hands-on expertise with at least one major cloud provider (AWS, Azure, GCP) and deep proficiency in platforms like Databricks, Snowflake, Microsoft Fabric, Synapse, BigQuery, or Redshift.
  • Deep understanding of data lakes, lakehouses, warehouses, streaming vs. batch processing, orchestration, and production monitoring.
  • Solid grasp of data privacy, access control, encryption, schema management, and enterprise data quality frameworks.
  • Excellent communication skills with the ability to navigate client environments, guide stakeholders, and balance delivery pace with technical quality.
  • Strong understanding of how robust data engineering enables advanced analytics, machine learning, and Generative AI applications.


Why Join DeepLight AI?

  • Lead critical, high-visibility engineering initiatives across top-tier client environments.
  • Work with cutting-edge cloud and AI technologies in a collaborative, fast-evolving consultancy environment.
  • Join a team that values technical mastery, pragmatic leadership, and continuous innovation.

Benefits

The benefits you'll enjoy as part of this role include:

  • Competitive salary.
  • Comprehensive personal health insurance.
  • Full Individual Visa Sponsorship.
  • Professional development and certification support.
  • Subscription reimbursement relating to your role.
  • Opportunity to work on cutting-edge AI projects.
  • Monthly Employee Incentive program.
  • Career advancement opportunities in a rapidly growing AI company.

This position offers a unique opportunity to shape the future of AI implementation while working with a talented team of professionals at the forefront of technological innovation. The successful candidate will play a crucial role in driving our company's success in delivering transformative AI solutions to our clients.

At DeepLight AI, we recognise that diversity drives innovation. We are committed to fostering an inclusive environment where individuals with different thinking styles can thrive and contribute their unique strengths to our specialised AI and data solutions.

Our goal is to ensure our application and interview process is accessible, predictable, and fair for all candidates.

If you require any specific adjustments to the application process, or if you require any reasonable adjustments should you be successful in being processed to the interview stage, please do let us know. This information will be kept strictly confidential and will not impact hiring decisions.

How we rate this

Lead Data Engineer at DeepLight AI rates 65 out of 100 for how much of the daily work is AI. That makes it Works on AI (AI Level 3 of 4). The level is about AI in the job, not seniority.

Classification

Works on AI. The daily work is on AI products, without building the model.

  1. ●●●● Builds AI80 to 100
  2. ●●●○ Works on AI60 to 79
  3. ●●○○ Uses AI40 to 59
  4. ●○○○ Little AI0 to 39

Levels come from how often the tools, models and workflows of the role are named in the posting itself. Open the description and count.

Prepare for this job

A free preview built only from this posting: what it asks for, what you could be asked in an interview, and how to adjust your resume.

Skills and AI tools this role asks for

Databricks

Questions you could be asked

  1. What's a project where you used Databricks hands-on?
  2. Describe a typical day in a role like this one: which parts run through AI directly?
  3. If you removed AI from this role, what would be left, and how do you decide what still needs a human?

Adapt your resume

  • List these exact terms on your resume: Databricks. An applicant tracking system matches the wording, not the idea.
  • Attach one line of real, concrete experience to at least one of them — a tool named with nothing behind it rarely survives a human read.
  • Show where AI is part of your daily process, not a one-off project — this role expects it to be a running habit.

Want an expert to read your CV for this job?

Free. Send your CV and the role you want next. We reply by email within 2 to 4 business days.

Get a free CV review

Get new data engineer jobs (Works on AI ●●●○ or higher) by email

One email a week with the new data engineer jobs (Works on AI ●●●○ or higher), each rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.

Free. One email a week. Unsubscribe in one click.

Similar roles

Data roles that work on AI, at other companies.

What kind of AI work fits you?

Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.

Find my next step

More jobs at DeepLight AI

More data engineer jobs

Related searches

Same AI level