Lead AI Software Engineer

HP Development Company, L.P. • $190K — $270K *
San Francisco, CA 94112In-Person
Enterprise Technology
8 - 10 years of experience
Today
Be an Early Applicant
Job Overview by Ladders

Qualifications

  • 10+ years of backend software development experience with Java, C++, or Python.
  • Proficient in integrating large language models into multi-agent systems with a focus on orchestration and memory management.
  • Hands-on experience in manipulating LLMs through prompting and managing task decomposition.
  • Experience with distributed systems, microservices, and cloud-native architectures.
  • Expertise in creating secure interfaces between AI models, devices, and services.
  • Familiarity with both SQL and NoSQL database systems and data streaming technologies.
  • Strong analytical skills and ability to thrive in a dynamic, agile environment.

Responsibilities

  • Design, build, and maintain scalable services for AI applications.
  • Develop APIs and microservices to connect cloud AI models with edge devices.
  • Optimize data pipelines for real-time AI processing and inference.
  • Implement best practices for security and privacy in distributed AI systems.
  • Collaborate with AI researchers and engineers to create end-to-end AI solutions.
  • Build an optimized agent orchestration runtime for complex reasoning and tool use.
  • Establish robust logging, monitoring, and alerting systems for operational reliability.

Benefits

  • Health, dental, and vision insurance.
  • Long term and short term disability insurance.
  • Employee assistance program for personal support.
  • Flexible spending account options.
  • Life insurance coverage.
  • Generous paid time off policy including parental leave, paid holidays, and additional flexible vacation.
Full Job Description
About The Role

The AI team is building cutting-edge solutions that bring the power of AI directly to edge devices while seamlessly integrating with cloud infrastructure. We are looking for a Lead Software Engineer to design and develop high-performance, scalable services to support AI workloads across edge and cloud environments.
What You Might Do
  • Design, build, and maintain services that power AI-driven applications, ensuring scalability and performance.
  • Develop APIs and microservices that facilitate seamless integration between cloud-based AI models and edge devices.
  • Optimize data pipelines and storage solutions for real-time AI inference and processing.
  • Implement security and privacy best practices for distributed AI systems.
  • Work closely with AI researchers, infrastructure engineers, and frontend developers to deliver end-to-end AI-driven solutions.
  • Build and optimize an agent orchestration runtime that enables tool use, memory management, and multi-step reasoning across LLMs, APIs, and edge-connected systems.
  • Develop robust logging, monitoring, and alerting systems to ensure system reliability.
Essential Qualifications
  • 10+ years of experience in backend software development, with strong proficiency in Java, C++, or Python.
  • Proficient in LLM integration into multi-agent systems with strong understanding of agent orchestration, tool use, and memory/context management.
  • Comfortable tinkering with LLMs via prompting and experienced with tools use, task decomposition, and structured outputs.
  • Experience building distributed systems, microservices, and cloud-native applications.
  • Strong knowledge with building secure, privacy-aware interfaces between models, devices, and external services.
  • Familiarity with database management systems (SQL and NoSQL) and data streaming technologies.
  • Strong problem-solving skills and ability to work in a fast-paced, agile environment.
Preferred Skills
  • Experience with AI model deployment and integration into backend services.
  • Knowledge of edge computing, networking, and security best practices.
  • Exposure to cloud-edge hybrid architectures and distributed AI workloads.
  • Familiarity with on-device AI frameworks such as TensorFlow Lite, ONNX Runtime, or CoreML.

Salary range: $190,000 - $270,000

Compensation & Benefits (Full-Time Employees)

The salary range for this role is listed above. Final salary offered is based upon multiple factors including individual job-related qualifications, education, experience, knowledge and skills.

At HP IQ, we offer a competitive and comprehensive benefits package, including:
  • Health insurance
  • Dental insurance
  • Vision insurance
  • Long term/short term disability insurance
  • Employee assistance program
  • Flexible spending account
  • Life insurance
  • Generous time off policies, including;
    • 4-12 weeks fully paid parental leave based on tenure
    • 11 paid holidays
    • Additional flexible paid vacation and sick leave (US benefits overview)

About HP Development Company, L.P.

HP Development Company, L.P. Careers

Joining HP Development Company, L.P. presents an unparalleled opportunity to advance a career at the forefront of technology and innovation. As a leader in the global technology sector, HP Development Company, L.P. offers a variety of job opportunities that encourage professional growth and development.

Explore Career Opportunities

HP Development Company, L.P. is continuously seeking talented individuals who are eager to drive innovation and lead in the technology industry. With a diverse range of positions available, from engineering to marketing, the company is committed to fostering a culture of diversity and inclusion. Each team member at HP Development Company, L.P. plays a crucial role in shaping the future of technology.

Internship Programs and Employment Prospects

For those starting their career journey, HP Development Company, L.P. provides robust internship programs that offer invaluable industry experience, mentoring, and networking opportunities. Interns gain hands-on experience, working alongside seasoned professionals on real-world projects that matter.

Professional Growth and Development

HP Development Company, L.P. is dedicated to the professional growth of its employees. The company offers comprehensive benefits and resources to support career advancement and personal development. Leadership and diversity training programs are available to all employees, ensuring that everyone has the tools to succeed and lead.

Innovation and Leadership

At the heart of HP Development Company, L.P. is a commitment to innovation and leadership. Employees are encouraged to think creatively and push the boundaries of what is possible. This culture of innovation drives the company forward and is a fundamental part of the work environment.

Join the HP Development Company, L.P. Team

HP Development Company, L.P. is hiring! Explore job opportunities that match your skills and interests. The company values curious, creative, and solution-driven team players. Start your journey by applying through the HP Development Company, L.P. careers page, where you can submit your resume and potentially schedule an interview.

Stay Connected with HP Development Company, L.P. Careers

Stay informed about new career opportunities and company updates by subscribing to job alert emails. Tailor your subscription to receive the latest news and insider tips that are most relevant to your career interests.

Networking and Career Advancement

Networking within HP Development Company, L.P. opens doors to numerous career advancement opportunities. Employees are encouraged to connect with colleagues and leaders within the company to learn, share, and grow together.

Conclusion

HP Development Company, L.P. is not just a place to work—it's a place where careers are nurtured, innovation thrives, and leadership is cultivated. Whether you're seeking an internship, employment, or a leadership position, HP Development Company, L.P. offers a path to professional success and personal growth. Join the team that is redefining the future of technology.
Learn more about HP Development Company, L.P.
Industry
Information Technology
* Ladders Estimates

Similar Jobs

Ad banner background

Get Ready For Your
Next Interview

More Jobs at HP Development Company, L.P.

More Enterprise Technology Jobs

Find similar Lead AI Software Engineer jobs:

NationwideSan Francisco, CA