Senior Data Engineer

Job Family Group:

Worker Type:

Posting Start Date:

Business Unit:

Experience Level:

Job Description:

What’s the role?

This role is responsible for leveraging business intelligence, data analytics, data modeling, and big data technologies to transform complex data into actionable insights that support strategic decision-making. The individual will help improve business performance, optimize operations, identify market opportunities, and deliver data-driven solutions that create competitive advantage.

Additionally, the role ensures effective information management across the organization by supporting the creation, storage, governance, and maintenance of data throughout its lifecycle, enabling secure and efficient access, sharing, and use of information across teams, systems, and business functions.

What you’ll be doing?

• Design and implement Lakehouse-based data architectures, including Medallion Architecture (Bronze, Silver, Gold layers), using configuration-driven and reusable frameworks to support multiple product teams.
• Build, optimize, and maintain high-volume, high-velocity, and high-variety data pipelines for both batch and streaming workloads using Azure Databricks, Databricks, PySpark, and SQL.
• Lead the design and development of data ingestion pipelines, data lake storage solutions, transformation notebooks, physical data models, tabular models, APIs/endpoints, and data visualization solutions.
• Partner with business and product stakeholders to gather functional requirements, user stories, and product backlog items (PBIs), translating them into scalable technical solutions.
• Define technical architecture, establish engineering standards, and provide technical direction across data engineering initiatives.
• Develop and maintain reusable data engineering frameworks to improve scalability, consistency, and maintainability across projects.
• Implement and support enterprise-grade data governance, quality, security, and performance optimization practices.
• Collaborate with cross-functional teams, including Data Science, Analytics, and AI teams, to enable advanced analytics and AI-driven solutions.
• Utilize Databricks Mosaic AI, LangGraph, or similar GenAI frameworks within enterprise guardrails to enhance data engineering workflows and accelerate solution delivery.
• Mentor and guide junior engineers, conduct design reviews, and promote best practices in data engineering and software development.

What we need from you?

• Bachelor's Degree in Information Technology, Computer Science, Computer Engineering, Software Engineering, Data Science, Information Systems, or a related field.
• With at least 8–12 years of experience in Data Engineering, Data Platform Development, Data Warehousing, or related data and analytics roles.
• Strong hands-on experience with:
  • Databricks
  • Azure Databricks
  • Databricks Mosaic AI
  • PySpark
  • SQL
  • Transformation Notebooks
  • Lakehouse Architecture
  • Medallion Architecture
• Proven experience designing and implementing scalable enterprise data platforms and large-scale data pipelines.
• Experience with both batch and real-time/streaming data processing frameworks.
• Strong knowledge of data modeling, ETL/ELT design patterns, and cloud-based data storage solutions.
• Experience working with GenAI frameworks and platforms within enterprise environments and governance standards.
• Excellent stakeholder management, requirements gathering, and technical leadership skills.
• Strong analytical, problem-solving, and communication skills.
• Experience in the Energy, Oil & Gas, Utilities, or related industry is highly preferred.
• Required Certifications: Databricks Certified Data Engineer Professional (Mandatory)

What we offer

You bring your skills and experience to Shell and in return you work with talented, committed people on one of the most important challenges facing our planet. You’ll have the opportunity to develop the skills you need to grow in an environment where we value honesty, integrity, and respect for one another. You’ll be able to balance your priorities as you become the best version of yourself.

• Progress as a person as we work on the energy transition together.
• Continuously grow the transferable skills you need to get ahead.
• Work at the forefront of technology, trends, and practices.
• Collaborate with experienced colleagues with unique expertise.
• Achieve your balance in a values-led culture that encourages you to be the best version of yourself.
• Benefit from flexible working hours, and the possibility of remote/mobile working.
• Perform at your best with a competitive starting salary and annual performance related salary increase – our pay and benefits packages are considered to be among the best in the world.
• Take advantage of paid parental leave, including for non-birthing parents.
• Join an organisation working to become one of the most diverse and inclusive in the world. We strongly encourage applicants of all genders, ages, ethnicities, cultures, abilities, sexual orientation, and life experiences to apply.
• Grow as you progress through diverse career opportunities in national and
• international teams.
• Gain access to a wide range of training and development programmes.

We'd like you to know that Shell has a bold goal: to become one of the world’s most diverse and inclusive companies. You can get to know more about how we're working towards that goal, click here.

IMPORTANT NOTE: After you submit your application, you will receive an email providing a link to an online assessment that is a mandatory part of the process. The email will come from HireVue - please check your spam/junk mailbox if you do not see the email. Once completed, your application will be reviewed to determine next steps. Thank you for your interest in Shell.

-

Shell in India

Shell is a diversified energy company in India with 13,000 employees, and presence in Integrated Gas, Downstream, Power, Renewable and Upstream. Additionally, we have deep capabilities in R&D, digitalization, and business operations.

Our global strategy, Powering Progress, is designed to generate value for our shareholders, customers, and the wider society, and focuses on creating more value with less emissions. The strategy supports our purpose of providing more and cleaner energy solutions, with the aim of profitably transforming Shell into a net-zero emissions energy business by 2050. As India moves towards its target of net-zero emissions by 2070, Shell India aims to play a leading role in securing vital energy for today, while investing in, and helping to build, the energy system of the future through strategic investments in the country.

Our Lubricants business serves over 50,000 consumers through a strong network of over 200 distributors, and operates an end-to-end value chain that spans conceptualization, development, and production at a world-class blending plant at Taloja. Through our 350-plus retail stations, we offer an integrated mobility experience including fuels, cafes, and convenience stores, with a prominent network of EV recharging facilities.

Shell owns and operates an LNG re-gasification terminal at Hazira, Surat, with a capacity of 5 MTPA and an LNG truck-loading unit that plays a crucial role in helping meet India’s growing demand for gas across sectors. In 2022, Shell acquired Spring Energy in a $1.55 billion deal to build an integrated energy transition business in the country. Spring is a leading renewable energy company in India which develops and manages solar, wind, and hybrid power generation facilities and infrastructure.

Our three capability centers across Bangalore and Chennai serve as a technology and innovation powerhouse for Shell globally, working as a delivery engine for core technical, digital, and finance processes: pioneering digital innovation and cutting-edge technologies across the energy sector. We also have strong academic partnerships and collaborations with leading universities and technology institutes to accelerate decarbonization efforts within the energy sector.

We are committed to positively contributing to the communities in which we operate through programs on STEM Education, Skilling, and Livelihood across India. We nurture and invest in startups developing initiatives focused on accelerating energy innovation through programs such as Shell E4 and Shell Eco-marathon. We also have strategic investments in new energy companies such as Husk Power, d.light, Orb Energy, and Cleantech Solar.

DISCLAIMER: