Senior System Software Engineer

NVIDIA has been transforming computer graphics, PC gaming, and accelerated computing for more than 25 years. It’s a unique legacy of innovation that’s fueled by great technology—and amazing people. Today, we’re tapping into the unlimited potential of AI to define the next era of computing. An era in which our GPU acts as the brains of computers, robots, and self-driving cars that can understand the world. Doing what’s never been done before takes vision, innovation, and the world’s best talent. As an NVIDIAN, you’ll be immersed in a diverse, supportive environment where everyone is inspired to do their best work. Come join the team and see how you can make a lasting impact on the world.

NVIDIA is seeking a Sr. Systems Software Engineer for the Apache Spark Acceleration group. Over the past five years GPU accelerated data processing has moved from proof of concept to production deployments. Many enterprises recognize accelerated computing is vital to handle their large data processing needs. Multi-node GPU deployments will reduce cloud computing costs and lower latency in batch ETL workloads. Apache Spark is the most popular data processing engine in data centers.  At NVIDIA, we are developing  an open source plugin to accelerate Spark applications on GPUs without any code changes.

What you'll be doing:

• Enable C++ native execution of Spark operations on CUDA

• Develop CUDA/C++ libraries to accelerate DataFrames and I/O operations on common file formats such as Parquet, ORC and JSON

• Collaborate with distributed systems teams to craft solutions to distributed processing problems challenges at large scale

• Work with open source communities to enhance libraries like RAPIDS, CCCL and UCX through technical discussion and code contributions

• Provide recommendations and feedback to teams regarding decisions surrounding topics such as infrastructure, continuous integration and testing strategy

• Build, test and optimize across different platforms

What we need to see:

• 9+ years of experience in software development

• 5+ years hands on experience with data platform development

• BS/MS/PhD in computer science or a related field (or equivalent experience)

• Proficiency in C++, Java, Scala

• Experience supporting enterprise customers

• Familiarity with the open source data platform ecosystem is a plus (Apache Spark, Velox, Presto, Apache Arrow, Apache DataFusion, etc.)

• Experience using AI tools in software development 

You will also be eligible for equity and benefits.

This posting is for an existing vacancy. 

NVIDIA uses AI tools in its recruiting processes.