Big Data Engineer- Scala

Capco is hiring a Big Data Engineer- Scala in Pune, India. Level rates it ; you can apply on Capco.

Level's read on this job

On Level's scale, this data engineer role is Works on AI ●●●○: the daily work is on AI products, without building the model.
The posting mentions Databricks among its tools and skills.
Capco has 687 other open roles on Level.
Posted in the last few days.

AI in this role

databricks

Job Title: Big Data Engineer - SCala

About Us

“Capco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the British Bank Award and has been ranked Top 100 Best Companies for Women in India 2022 by Avtar & Seramount. With our presence across 32 cities across globe, we support 100+ clients across banking, financial and Energy sectors. We are recognized for our deep transformation execution and delivery.

WHY JOIN CAPCO?

You will work on engaging projects with the largest international and local banks, insurance companies, payment service providers and other key players in the industry. The projects that will transform the financial services industry.

MAKE AN IMPACT

Innovative thinking, delivery excellence and thought leadership to help our clients transform their business. Together with our clients and industry partners, we deliver disruptive work that is changing energy and financial services.

#BEYOURSELFATWORK

Capco has a tolerant, open culture that values diversity, inclusivity, and creativity.

CAREER ADVANCEMENT

With no forced hierarchy at Capco, everyone has the opportunity to grow as we grow, taking their career into their own hands.

DIVERSITY & INCLUSION

We believe that diversity of people and perspective gives us a competitive advantage.

MAKE AN IMPACT

Job Description: Big Data Engineer – Scala

We are looking for an experienced Big Data Engineer with strong expertise in Scala and Apache Spark to design, develop, and optimize scalable data-processing solutions. The ideal candidate should have hands-on experience with distributed data platforms, large-scale ETL/data pipelines, and big data technologies.

Key Responsibilities

Design, develop, and maintain scalable Big Data applications and data pipelines.
Develop high-performance data-processing solutions using Scala and Apache Spark.
Build and optimize ETL/ELT pipelines for large volumes of structured and unstructured data.
Work with technologies such as Hadoop, HDFS, Hive, Kafka, and Spark SQL.
Perform Spark job performance tuning and optimization.
Develop reusable and maintainable data-processing frameworks.
Troubleshoot production issues related to data pipelines and distributed applications.
Implement data-quality checks, monitoring, and error-handling mechanisms.
Collaborate with data architects, analysts, business teams, and other engineering teams.
Follow software engineering best practices, including Git, code reviews, testing, and CI/CD.

Required Skills

Strong hands-on programming experience in Scala.
Strong experience with Apache Spark / Spark SQL.
Good understanding of Big Data and distributed computing concepts.
Experience with Hadoop ecosystem technologies, including Hadoop/HDFS and Hive.
Experience building large-scale ETL/data engineering pipelines.
Strong SQL skills.
Experience working with Kafka or similar messaging/streaming technologies.
Understanding of data formats such as Parquet, Avro, and JSON.
Experience with performance optimization and troubleshooting of Spark applications.
Good understanding of software development lifecycle and version-control systems.

Good to Have

Experience with AWS, Azure, or GCP.
Knowledge of Databricks.
Experience with Airflow or similar orchestration tools.
Exposure to Delta Lake or other modern lakehouse technologies.
Knowledge of Docker, Kubernetes, and CI/CD pipelines.
Experience working in Agile/Scrum environments.

Core Skills

How we rate this

Big Data Engineer- Scala at Capco rates 64 out of 100 for how much of the daily work is AI. That makes it Works on AI (AI Level 3 of 4). The level is about AI in the job, not seniority.

Classification

Works on AI. The daily work is on AI products, without building the model.

●●●● Builds AI80 to 100
●●●○ Works on AI60 to 79
●●○○ Uses AI40 to 59
●○○○ Little AI0 to 39

Levels come from how often the tools, models and workflows of the role are named in the posting itself. Read the description and count the AI tools, models and workflows it names.

Key facts

Big Data Engineer- Scala is an open job at Capco.
Level rates this role AI Level 3 of 4: Works on AI.
The role is based in India - Pune.
The job was posted on November 3, 2026.
Applications are handled by Capco. Apply on Capco

Prepare for this job

Built from this posting and from similar jobs on Level.

Skills and AI tools this role asks for

Databricks

Also common in data engineer jobs at this level

Python Machine learning Snowflake Generative AI Java LLM

Pay

Typical data engineer job: $148k

This posting doesn't list pay. Use the typical data engineer figure when pay comes up. See data engineer jobs

Questions you could be asked

What's a project where you used Databricks hands-on?
Describe a typical day in a role like this one: which parts run through AI directly?
If you removed AI from this role, what would be left, and how do you decide what still needs a human?

Adapt your resume

List these exact terms on your resume: Databricks. An applicant tracking system matches the wording, not the idea.
Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
Show where AI is part of your daily process, not a one-off project. This role expects it to be a running habit.

Want an expert to read your CV for this job?

Free. Send your CV and the role you want next. You get your review by email within 24 hours.

Get a free CV review Get your CV rewritten Check your resume with the ATS resume checker

Get new data engineer jobs (Works on AI ●●●○ or higher) by email

One email a week with the new data engineer jobs (Works on AI ●●●○ or higher), each rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.

Free. One email a week. Unsubscribe in one click.