Software Engineering - Distributed Agentic AI Systems
AI in this role
Description -
This role is responsible for driving the technical design, development, and implementation of a comprehensive software stack into a closed clustering of PCs, enabling the offloading of workloads and AI inferencing along the private network. The role plays a crucial part in building technical solutions to execute hardware proof-of-concepts (POCs) for workflow tests, bridging advanced Agentic AI frameworks with underlying operating systems, edge devices, and distributed network layers. The role is responsible for technical need analysis and supporting cross-functional engineering execution while ensuring enterprise-grade application security, policy management, and container or process isolation controls.
Responsibilities
- Builds standards, designs, and automates the deployment of software.
- Leads the building, installation, and end-to-end integration of a complete software stack to run hardware proof-of-concepts (POCs) and workflow tests across a closed clustering of PCs.
- Architects and executes distributed computing strategies for workload orchestration, seamlessly managing tasks from client nodes to private servers and cloud environments.
- Installs, configures, and runs autonomous agents across both Windows and Linux environments, integrating agentic workflows with local and edge hardware architectures.
- Designs and develops solutions that protect and manage software products, application/network layers, network protocols, and data movement across private network boundaries.
- Implements rigorous application security and policy management frameworks, including configuring and maintaining AppArmor and SELinux security controls on Linux environments.
- Contributes to technology strategy and engineering roadmaps around distributed AI inference, offloading workloads, and edge device communication.
- Collaborates with cross-functional teams to analyze system telemetry, resource utilization, and computing bottlenecks during persistent agent simulations.
- Assists supervisors with project development, including documentation of features, recording of progress, and creation of testing plans for hardware-software co-design.
- Consults with the business to determine logical design for new business solutions according to existing distributed computing architecture and edge requirements.
- Identifies, recommends, and implements changes to enhance the effectiveness of engineering implementation, cluster deployment, and service strategies.
Education & Experience Recommended
- Four-year or Graduate Degree in Computer Science, Information Technology, Software Engineering, or any other related discipline or commensurate work experience or demonstrated competence.
- Typically has 7-10 years of work experience, preferably in software design and development, distributed systems architecture, systems programming, or a related field.
Preferred Certifications
- Programming Language/s Certification (Java, C++, Python, JavaScript, or similar)
- Cloud, Linux Administrator, or Network Security Certifications
Knowledge & Skills
- Advanced English proficiency
- Agile Methodology
- Application Programming Interface (API)
- C++ (Experience)
- Computer Science
- DevOps
- HW and Driver communication in Windows (Deep knowledge)
- Software Engineering
- Machine Learning & AI Inferencing (Deep understanding of how AI inferencing works, including practical knowledge of Llama.cpp and vLLM)
- Agentic AI Frameworks & Tools (Experience with LangChain, LangGraph, and deploying autonomous agents)
- Distributed Computing & Workload Orchestration (Client-to-private server-to-cloud architectures, clustering, and network offloading)
- Software Engineering & Python Programming (Advanced proficiency)
- Operating Systems & Edge Computing (Deep operational experience in Linux and Windows environments, plus edge device integration)
- Application & Network Security (Network protocols, application layers, policy management, AppArmor, and SELinux controls)
- Core AI/Data Paradigms (Retrieval-Augmented Generation [RAG], Model Context Protocol [MCP], and prompt engineering)
- Systems Programming & LLM Fine-tuning (Nice to have)
Cross-Org Skills
- Effective Communication and Cross-Organizational Collaboration
- Results Orientation and Learning Agility
- Digital Fluency and Customer Centricity
- Agile Methodology & DevOps Alignment
Impact & Scope
Impacts function and leads and/or provides expertise to functional project teams, driving architectural decisions for closed PC clustering, edge deployment, and private network AI offloading initiatives.
Complexity
Works on complex problems where analysis of distributed systems, multi-node clustering, AI runtimes, and low-level security controls requires an in-depth evaluation of multiple hardware and software factors.
Disclaimer
This job description describes the general nature and level of work performed in this role. It is not intended to be an exhaustive list of all duties, skills, responsibilities, knowledge, etc. These may be subject to change and additional functions may be assigned as needed by management.
Job -
SoftwareSchedule -
Full timeShift -
No shift premium (Brazil)Travel -
NoRelocation -
Equal Opportunity Employer (EEO) -
HP, Inc. provides equal employment opportunity to all employees and prospective employees, without regard to race, color, religion, sex, national origin, ancestry, citizenship, sexual orientation, age, disability, or status as a protected veteran, marital status, familial status, physical or mental disability, medical condition, pregnancy, genetic predisposition or carrier status, uniformed service status, political affiliation or any other characteristic protected by applicable national, federal, state, and local law(s).
Please be assured that you will not be subject to any adverse treatment if you choose to disclose the information requested. This information is provided voluntarily. The information obtained will be kept in strict confidence.
For more information, review HP’s EEO Policy or read about your rights as an applicant under the law here: “Know Your Rights: Workplace Discrimination is Illegal"
How we rate this
Software Engineering - Distributed Agentic AI Systems at HP rates 13 out of 100 for how much of the daily work is AI. That makes it Little AI (AI Level 1 of 4). The level is about AI in the job, not seniority.
Little AI. AI is not part of the work.
- ●●●● Builds AI80 to 100
- ●●●○ Works on AI60 to 79
- ●●○○ Uses AI40 to 59
- ●○○○ Little AI0 to 39
Levels come from how often the tools, models and workflows of the role are named in the posting itself. Open the description and count.
Prepare for this job
A free preview built only from this posting: what it asks for, what you could be asked in an interview, and how to adjust your resume.
Skills and AI tools this role asks for
Questions you could be asked
- How do you structure and test a prompt to get consistent output from a language model?
- How would you design a retrieval step so the model answers from real data instead of guessing?
- How do you decide when an AI agent can act on its own versus asking for approval first?
- Walk me through fine-tuning a model: what data did you use, and how did you check the result?
- Walk me through how you've used Llama in your day-to-day work.
Adapt your resume
- List these exact terms on your resume: Prompt Engineering, RAG, AI Agents, Fine Tuning, and Llama. An applicant tracking system matches the wording, not the idea.
- Attach one line of real, concrete experience to at least one of them — a tool named with nothing behind it rarely survives a human read.
Want an expert to read your CV for this job?
Free. Send your CV and the role you want next. We reply by email within 2 to 4 business days.
Get a free CV reviewGet new AI jobs by email
One email a week with the new AI jobs, each rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.
Free. One email a week. Unsubscribe in one click.
Similar roles
Software Engineering roles that involve little AI, at other companies.
What kind of AI work fits you?
Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.
Find my next step