Principal Product Manager
Hewlett Packard Enterprise is hiring a Principal Product Manager. Level rates it ; you can apply on Hewlett Packard Enterprise.
Level's read on this job
- On Level's scale, this AI product manager role is Builds AI ●●●●: the job is building AI systems.
- The posting mentions LangChain, vLLM and MLflow among its tools and skills.
- Level classes it as a lead role.
- Hewlett Packard Enterprise has 1,700+ other open roles on Level.
- Posted in the last few days.
AI in this role
This role has been designed as 'Hybrid' with a requirement that you will work on average 2 days per week from an HPE office.
Who We Are:
Hewlett Packard Enterprise is the global edge-to-cloud company advancing the way people live and work. We help companies connect, protect, analyze, and act on their data and applications wherever they live, from edge to cloud, so they can turn insights into outcomes at the speed required to thrive in today’s complex world. Our culture thrives on finding new and better ways to accelerate what’s next. We know varied backgrounds are valued and succeed here. We have the flexibility to manage our work and personal needs. We make bold moves, together, and are a force for good. If you are looking to stretch and grow your career our culture will embrace you. Open up opportunities with HPE.
Job Description:
About the role
HPE Private Cloud AI is the turnkey, NVIDIA co-engineered private AI cloud that lets enterprises run inference, RAG, fine-tuning, and agentic AI on their own infrastructure, delivered as a cloud experience through HPE GreenLake. We are hiring a Principal Product Manager to own a major slice of the platform end to end, from GPU compute and AI fabric to the AI software stack developers use every day. You will set strategy, win the hard trade-offs, and ship the capabilities that make Private Cloud AI the obvious choice over public cloud and neocloud alternatives.
What you'll do
- Own strategy and roadmap for your Private Cloud AI area across GPU compute, AI networking, and the AI software stack, tied to clear revenue, adoption, and utilization goals.
- Define the platform across layers: GPU and accelerator configurations, Spectrum-X and InfiniBand fabrics, storage, Kubernetes orchestration, scheduling, and the curated AI tools customers deploy on day one.
- Make GPUs pay off: drive the features that raise utilization and time-to-value, such as GPU sharing, fair-share quotas, gang scheduling, and multi-tenant isolation.
- Lead the agentic AI roadmap: bring secure agent runtimes, model serving, and developer frameworks into the platform as supported, enterprise-ready experiences.
- Partner deeply with NVIDIA and the open-source ecosystem to co-define integrations, validated designs, and release timing.
- Be the voice of the customer: work directly with enterprise, sovereign, and service-provider buyers to turn their workloads into crisp requirements and PRDs.
- Drive launches end to end with engineering, solutions, marketing, and sales, and track results with data after GA.
Required qualifications
- 10+ years of product management, engineering, or architecture experience, including 5+ years owning AI/ML, HPC, or cloud infrastructure products.
- Hands-on depth in AI compute infrastructure: NVIDIA GPU platforms (e.g., H100/H200, Blackwell), server and rack architecture, power and cooling trade-offs, and sizing for training, fine-tuning, and inference.
- Hands-on depth in AI networking: RDMA, RoCE and InfiniBand, Ethernet AI fabrics (e.g., NVIDIA Spectrum-X), DPUs/SuperNICs, and how fabric design affects job performance.
- Working knowledge of Kubernetes and cloud-native operations, and of how GPU workloads are scheduled and isolated in multi-tenant clusters.
- Track record of shipping complex hardware-plus-software solutions to enterprise customers, from requirements through launch and adoption.
- Strong written and verbal communication; credible with engineers, executives, and customers alike.
- Bachelor's degree in Computer Science, Engineering, or related field, or equivalent experience.
Preferred qualifications
- AI frameworks and MLOps: LangChain, LangFlow, MLflow, Ray, and SGLang, plus related serving engines such as vLLM.
- GPU scheduling: NVIDIA KAI Scheduler or similar Kubernetes-native schedulers (Run:ai, Kueue, Volcano, Slurm).
- Agent runtimes and harnesses: NVIDIA OpenShell and NemoClaw, OpenClaw, and Hermes, including sandboxing, policy, and inference routing for always-on agents.
- NVIDIA AI Enterprise: NIM microservices, NeMo, Triton/Dynamo, the GPU and Network Operators, and NVIDIA AI Blueprints.
- Experience with private, sovereign, or regulated-industry AI deployments, or with hybrid cloud platforms such as HPE GreenLake.
- Prior engineering, solutions architecture, or forward-deployed experience; MBA or advanced technical degree a plus.
Accessibility
HPE is committed to creating an inclusive and accessible workplace and encourages applications from all qualified individuals, including those with disabilities. If you believe you require accommodation during any stage of the application or interview process, please submit your request by completing our secure form linked here.
Note: This option is reserved for applicants needing assistance/reasonable accommodation related to a disability.
What We Can Offer You:
Health & Wellbeing
We strive to provide our team members and their loved ones with a comprehensive suite of benefits that supports their physical, financial and emotional wellbeing.
Personal & Professional Development
We also invest in your career because the better you are, the better we all are. We have specific programs catered to helping you reach any career goals you have — whether you want to become a knowledge expert in your field or apply your skills to another division.
Unconditional Inclusion
We are unconditionally inclusive in the way we work and celebrate individual uniqueness. We know varied backgrounds are valued and succeed here. We have the flexibility to manage our work and personal needs. We make bold moves, together, and are a force for good.
Let's Stay Connected:
Follow @HPECareers on Instagram to see the latest on people, culture and tech at HPE.
#unitedstatesJob:
EngineeringJob Level:
TCP_05"The expected salary/wage range for this position is provided below. Actual offer may vary from this range based upon geographic location, work experience, education/training, and/or skill level.
– United States of America: Annual Salary USD 165,500 - 313,500 in Colorado // 178,000 - 339,000 in Massachusetts // 157,000 - 361,000 in Texas
The listed salary range reflects base salary. Variable incentives may also be offered."
Information about employee benefits offered in the US can be found at https://myhperewards.com/main/new-hire-enrollment.html
The estimated job application period closure is March 31 2027; this timeline is provided for transparency and internal planning purposes.HPE is an Equal Employment Opportunity/ Veterans/Disabled/LGBT employer. We do not discriminate on the basis of race, gender, or any other protected category, and all decisions we make are made on the basis of qualifications, merit, and business need. Our goal is to be one global team that is representative of our customers, in an inclusive environment where we can continue to innovate and grow together. Please click here: Equal Employment Opportunity.
Hewlett Packard Enterprise is EEO Protected Veteran/ Individual with Disabilities.
HPE will comply with all applicable laws related to employer use of arrest and conviction records, including laws requiring employers to consider for employment qualified applicants with criminal histories.
Recruitment Fraud Alert
We have become aware of an increase in fraudulent recruitment activities in which individuals impersonate our company or authorized recruitment agencies to offer fake employment opportunities. These scams may occur through false websites, emails, social media, or chat-based applications and often aim to obtain personal information or money. Please note that Hewlett Packard Enterprise (HPE), its direct and indirect subsidiaries and affiliated companies, and its authorized recruitment agencies/vendors will never charge a candidate a registration fee, hiring fee, or any other fee in connection with its recruitment and hiring process. We also never request personal information such as back account details, Social Security numbers, or national IDs via social media or chat applications.
All legitimate job opportunities will come through official company channels, and candidates are responsible for verifying the credentials of any third party claiming to represent the company. Any reliance on fraudulent communication is at the individual’s own risk, and HPE disclaims legal liability for any resulting damages. If you suspect recruitment fraud, do not share personal information or make any payments and report the incident to your local authorities immediately.
How we rate this
Principal Product Manager at Hewlett Packard Enterprise rates 84 out of 100 for how much of the daily work is AI. That makes it Builds AI (AI Level 4 of 4). The level is about AI in the job, not seniority.
Builds AI. The job is building AI systems.
- ●●●● Builds AI80 to 100
- ●●●○ Works on AI60 to 79
- ●●○○ Uses AI40 to 59
- ●○○○ Little AI0 to 39
Levels come from how often the tools, models and workflows of the role are named in the posting itself. Read the description and count the AI tools, models and workflows it names.
Prepare for this job
Built from this posting and from similar jobs on Level.
Skills and AI tools this role asks for
Also common in AI product manager jobs at this level
Pay
- Typical AI product manager job
- $179k
This posting doesn't list pay. Use the typical AI product manager figure when pay comes up. See AI product manager jobs
Questions you could be asked
- How would you design a retrieval step so the model answers from real data instead of guessing?
- Walk me through fine-tuning a model: what data did you use, and how did you check the result?
- How do you monitor a model once it's live, and how do you know it needs retraining?
- What's a project where you used LangChain hands-on?
- Walk me through how you've used vLLM in your day-to-day work.
Adapt your resume
- List these exact terms on your resume: RAG, Fine-tuning, ML Ops, LangChain, and vLLM. An applicant tracking system matches the wording, not the idea.
- Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
- Lead with what you built, trained or shipped. This role is judged on the AI system itself, not the tools around it.
Get your CV reviewed before you apply
Send your CV and the role you want next. Your review arrives by email within 3 days.
Get new AI product manager jobs (Builds AI ●●●●) by email
One email a week, each job rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.
Free.
Similar roles
Product roles that build AI, at other companies.
What kind of AI work fits you?
Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.
Find my next step