ANGI Homeservices Inc.

Staff AI Product Analyst

ANGI Homeservices Inc. • $165K — $225K *
US-AnywhereRemote in United States
Consumer Technology
8 - 10 years of experience
1 month ago
Job Overview by Ladders

Qualifications

  • 10+ years in product analytics, data science, or technical product management in complex environments.
  • 1+ year of hands-on experience with AI/LLM systems focusing on responsible evaluation.
  • Deep technical proficiency in Python, ML frameworks, and data visualization tools.
  • Experience designing AI evaluation frameworks and production monitoring.
  • Exceptional communication skills to convey technical AI insights to non-technical stakeholders.

Responsibilities

  • Partner with AI product and engineering teams to set metrics for flagship AI journeys.
  • Align with data science on experiment design and causal framing for new AI products.
  • Map agent interactions with metrics, ensuring clear requirements for data engineering.
  • Design evaluation frameworks and maintain 'golden datasets' for agent outputs.
  • Categorize tool misuse and data edge cases to improve AI performance.
  • Monitor AI analytics workflows to track success and maintain an engineering backlog.
  • Create internal documentation on agent usage and participate in leadership storytelling.

Benefits

  • Competitive year-end performance bonus and equity package.
  • Comprehensive medical, dental, and vision plans.
  • Flexible vacation policy allowing for work-life balance.
  • Pet discount plans and a retirement plan with company match.
  • Opportunity to collaborate with motivated teammates on unique challenges.
Full Job Description
About the team

The Staff AI Product Analyst will define AI-native product analytics for Angi, turning visionary technology into prioritized use cases, robust evaluation disciplines, and a trusted data ecosystem. This role is central to building Angi's agentic product analytics capability-defining where AI-native analytics creates real leverage, designing the evaluation frameworks that earn organizational trust, and establishing repeatable system standards. As a senior individual contributor, you will have broad influence across the product analytics function and beyond, ensuring that both human teams and AI agents remain aligned on truth, quality, and usefulness.

The ideal candidate is a systems-thinking data expert who bridges the gap between deep AI capabilities and practical business outcomes.

What you'll do

AI Product Strategy & Metrics Design
  • Flagship Journey Measurement: Partner with AI product, engineering, and domain experts to define north-star and guardrail metrics for flagship AI journeys, focusing on adoption, task completion, quality, and downstream business outcomes.
  • Causal Framing & Experimentation: Align closely with data science partners on test design, interpretation, and causal framing when new AI products ship.
  • Data Layer Systems Thinking: Map how agents interact with metrics, raw tables, documentation, and APIs to ensure requirements for data and analytics engineering are explicit, structured, and testable.


Evaluation, Governance & Backlog Management
  • Eval Framework Architecture: Design and maintain formal evaluation sets, "golden datasets," rubrics, and regression checks for agent outputs to guarantee accuracy, completeness, policy safety, and usefulness.
  • Taxonomy & Failure Mode Analysis: Systematically categorize wrong answers, tool misuse, context gaps, and data edge cases, feeding those insights back into prompts, retrieval (RAG), tools, and data modeling pipelines.
  • Performance Monitoring: Monitor live usage of Agentic AI analytics workflows-tracking success, abandonment, fallback patterns, and human override rates to maintain a prioritized engineering improvement backlog.


Cross-Functional Leadership & Enablement
  • Playbooks & Narrative: Own internal documentation defining when to use agents, required human checkpoints, and how to communicate uncertainty. Support enablement and leadership storytelling around agentic AI analytics.
  • Strategic Collaboration: Partner with business leaders, the Principal Analytics Engineer, and data engineering teams to translate complex AI capabilities into measurable business outcomes.
  • Defining Success: Deliver recurring measurement artifacts (dashboards, reviews, or written readouts) that leadership uses to prioritize roadmaps, while continuously reducing high-severity incidents where agents produce incorrect metrics.


Who you are

Minimum Qualifications
  • 10+ years of experience across product analytics, data science, or technical product management within a complex, high-scale operating environment.
  • 1+ years of direct, hands-on experience working with AI/LLM systems in an applied context, with a specific focus on evaluating, trusting, and deploying them responsibly.
  • Deep technical proficiency with Python, ML frameworks, data visualization/analytics platforms, and standard data management/governance practices.
  • Proven track record designing AI evaluation frameworks, including formal evals, golden datasets, production monitoring, or equivalent rigor in a related data discipline.
  • Exceptional communication skills with a demonstrated ability to translate highly technical AI insights and tradeoffs into clear narratives for non-technical business stakeholders.


Preferred Qualifications
  • Experience building or evaluating agentic analytics workflows, orchestration frameworks, and familiarity with multi-agent systems.
  • Demonstrated ability to operate fluidly in ambiguity, run structured experiments or pilots, and default to fast action and iteration.
  • A systems-oriented mindset with a healthy skepticism of AI hype, focusing strictly on organizational outcomes and driving technical investments that yield true business value.


Compensation & Benefits
  • The salary band for this position rangesfrom$165,000 - $225,000commensurate with experience and performance. Compensation may vary based on factors such as cost of living.
  • This position will be eligible for a competitive year end performance bonus & equity package.
  • Full medical, dental, vision package to fit your needs
  • Flexible vacation policy; work hard and take time when you need it
  • Pet discount plans & retirement plan with company match (401K)
  • The rare opportunity to work with sharp, motivated teammates solving some of the most unique challenges and changing the world

#LI-Remote

About ANGI Homeservices Inc.

Angi Homeservices Inc. revolutionizes the way homeowners find and connect with service professionals. Since its inception in 1998 and headquartered in Denver, Colorado, Angi has grown into a leading digital marketplace for home services across North America and Europe, through platforms like HomeAdvisor, Handy, and MyHammer.

The Mission of Angi

At its core, Angi is dedicated to simplifying home improvement and repair projects, making it easier for homeowners to find trusted professionals for their needs.

Career Opportunities at Angi

Angi offers a wealth of employment opportunities for professionals seeking to contribute to a dynamic and growing digital marketplace.

A Wide Range of Professional Paths

From tech and product development to marketing and customer service, Angi careers span various fields and expertise levels.

Job Categories and Specializations

Angi's diverse range of services necessitates a variety of specializations and job categories.

Technology and Development

Positions in software engineering, UX/UI design, and product management drive the innovation and usability of Angi's platforms.

Sales and Customer Support

These roles focus on connecting homeowners with service professionals and ensuring satisfaction with Angi’s services.

Employee Benefits and Perks

Angi recognizes the importance of comprehensive benefits and perks in maintaining job satisfaction and work-life balance for its staff.

Health and Wellness

Angi offers competitive health insurance plans, wellness programs, and flexible spending accounts to support the health and well-being of its employees.

Job Application Process

Navigating the job application process at Angi is your first step towards a rewarding career path in the home services industry.

How to Apply

Candidates interested in Angi careers can explore current job openings on Angi’s career portal, where they can submit applications and resumes for positions that match their qualifications and career goals.

Training and Development Programs

Continuous growth and learning are pillars of the Angi employment experience, with various programs designed to enhance skills and advance careers.

Advancing Professional Skills

Angi provides access to training sessions, workshops, and online courses to encourage professional development and skill enhancement.

Company Culture and Values

At Angi, the company culture is rooted in innovation, collaboration, and a commitment to excellence, fostering a supportive and dynamic work environment.

Collaboration and Innovation

Angi’s culture encourages teamwork and creative problem-solving, allowing employees to contribute to the company's mission meaningfully.

Success Stories of Angi Employees

Hearing from Angi employees about their journeys within the company can provide valuable insights into the opportunities and rewards of building a career at Angi.

From Entry-Level to Leadership

Many Angi employees have experienced significant career growth and advancement, illustrating the company's investment in its team’s development. Visit their investor relations page for more information.

Career Growth and Advancement Opportunities

Angi is committed to the career advancement of its employees, offering clear paths for professional development and progression within the company.

Pathways for Promotion

Angi's meritocratic approach ensures that hard work, innovation, and contributions to company success are recognized and rewarded.
Learn more about ANGI Homeservices Inc.
Size
4,000 employees
Market Cap
$7.8 billion
Industry
Real Estate & Construction
Net Income
-$6.2 million
Founded
1995
5 Year Trend
+33.7%
Revenue
$1.4 billion
* Ladders Estimates

Similar Jobs

Ad banner background

Get Ready For Your
Next Interview

More Jobs at ANGI Homeservices Inc.

More Consumer Technology Jobs

Find similar Staff AI Product Analyst jobs:

NationwideRemote