Position SummaryAI is moving from experimentation to production faster than any technology shift in recent memory, and the teams shipping it are discovering that traditional software testing breaks down for LLM-powered systems. Evaluation is the missing layer, and it's becoming the bottleneck for enterprise AI adoption. Harness is uniquely positioned to solve this: we already sit at the center of how engineering teams ship software, with deep integration into CI/CD pipelines and trusted relationships with platform and developer teams at enterprises worldwide. The AI Evals module is our bet that evaluation belongs in the same pipeline as the rest of software delivery, not as a bolted-on tool. This role will define what that looks like.
We are hiring a Director of Product Management to lead Harness's AI Evaluation module defining how engineering teams measure, validate, and continuously improve AI and LLM-powered applications in production. This role has end-to-end business ownership of our AI Evals module, including vision, strategy, and P&L
About the role- Design AI-assisted experiences for eval authoring, failure analysis, and remediation recommendations.
- Own the vision, strategy, roadmap, and P&L for Harness's AI Evals module.
- Partner with engineering to deliver scalable, differentiated solutions that developers love.
- Work closely with GTM teams (sales, marketing, customer success) on positioning, adoption, and revenue growth.
- Engage directly with customers to shape the roadmap, improve adoption, and ensure measurable business impact.
- Drive competitive positioning and track product metrics
About you- 8+ years of product management experience, including AI/ML technologies, developer tooling, or platform products.
- Experience owning business outcomes including strategy, positioning, and revenue impact.
- Strong communication and stakeholder management skills across product, engineering, and GTM teams.
- Obsessed with customer success and outcome-driven.
- Strong understanding of:
- LLM evaluation methodologies
- CI/CD pipelines and developer workflows
- AI observability, monitoring, and quality assurance
- Agentic AI systems and the unique evaluation challenges they present
Preferred Qualifications- Experience building AI/ML evaluation or observability platforms at scale.
- Experience in building products from the ground up.
- Familiarity with prompt engineering, fine-tuning pipelines, and dataset versioning.
- Exposure to AI governance, responsible AI frameworks, or automated remediation.
- Cloud-native and enterprise SaaS experience.
Work Location- Hybrid from Mountain View CA.
What you will have at Harness- Competitive salary
- Comprehensive healthcare benefits
- Flexible Spending Account (FSA)
- Flexible work schedule
- Employee Assistance Program (EAP)
- Flexible Time Off and Parental Leave
- Monthly, quarterly, and annual social and team building events
- Monthly internet reimbursement
The anticipated base salary range for this position is between $265,000 and $280,000 annually. Salary is determined by a combination of factors including location, level, relevant experience, and skills. The range displayed on each job posting reflects the minimum and maximum target for new hire salaries for the position across all US locations. The compensation package for this position may also include equity, and benefits. More details about our company benefits can be found at the following link: https://www.harness.io/company/careers.
Pay transparency
$265,000-$280,000 USD
Harness in the news:- Accelerating Our Mission to Bring AI to Everything After Code
- Goldman Sachs leads investment in software delivery startup Harness at $5.5 billion valuation
- How Harness runs 16 "startups within a startup" at scale | Jyoti Bansal
- Harness Research Shows AI Visibility Crisis Fueling Security Nightmare
- Harness has been named to the Inc. Power Partner list for software delivery success
