Technical Product Owner (AI & Agentic Systems)

TripArc

$110K — $130K *
Consumer Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • Bachelor's degree in Business, Information Science, Computer Science, or a related field (equivalent experience may be considered)
  • 3-5 years of experience in Product Owner, Technical Business Analyst, or related product roles
  • Strong skills in backlog management and prioritization with Scrum facilitation experience
  • Understanding of large language model fundamentals and generative AI systems
  • Experience evaluating AI output quality and defining evaluation metrics
  • Familiarity with patterns used in agentic systems and orchestration frameworks
  • Ability to communicate technical concepts to non-technical stakeholders

Responsibilities

  • Conduct needs assessments to gather requirements from end-users and stakeholders
  • Develop a working understanding of the underlying LLM architecture and related technologies
  • Define AI output quality standards and evaluation criteria
  • Collaborate with engineers on technical decisions surrounding model selection and system design
  • Translate travel industry concepts into actionable requirements for development
  • Manage the Product Backlog and ensure it is prioritized and transparent
  • Evaluate new AI tools and frameworks against internal requirements

Benefits

  • Hybrid work model with two days a week onsite
  • Opportunities to participate in incentive programs
  • Pay-for-performance rewards approach
  • Supportive of a fast-paced, entrepreneurial work environment
  • Focus on continuous personal and professional development
Full Job Description
This is a hybrid position with currently 2 days a week onsite from our office located at 2 Queen St. E in Toronto, ON.

THE ROLE

A Technical Product Owner for AI & Agentic Systems at TripArc maximizes product value by owning the delivery and continuous evolution of the company's internal LLM-powered and agentic platforms. They serve as the primary point of contact between travel advisor end-users, internal business stakeholders, and the development pod responsible for these systems, translating the capabilities and constraints of large language models, retrieval-augmented generation pipelines, and agentic frameworks into clearly defined backlog items.

The Technical Product Owner is solely responsible for maintaining the Product Backlog at a pod level, using input from the Senior Product team, the development team, and direct end-user feedback to prioritize and communicate backlog items ahead of all Scrum ceremonies. They ensure the Product Backlog is visible, transparent, and understood at all times. Even where responsibilities such as technical ticket writing are delegated to a developer lead or architect, the Product Owner remains accountable for the outcome.

Working within the Trifecta (Product, UX, Development) model, the Technical Product Owner maintains a deep understanding of AI system behaviour, output quality, and the advisor workflows these systems support. They anticipate the needs of stakeholders across the organization, including those not directly involved in day-to-day delivery, and ensure that all requests for backlog changes are evaluated and approved through them.

KEY RESPONSIBILITIES
  • Conduct needs assessments with end-users and internal stakeholders - including the Senior Product Manager, and business leadership - to identify requirements and translate them into features or user stories
  • Develop and maintain a working understanding of the LLM architecture underpinning the platform, including retrieval-augmented generation (RAG) pipelines, prompt engineering patterns, tool/function calling, and agentic orchestration frameworks
  • Define and maintain AI output quality standards; design and document evaluation criteria (e.g., response accuracy, latency, hallucination rates, retrieval relevance) to guide development and QA
  • Collaborate with engineers and architects on decisions relating to model selection, context window management, embedding strategies, knowledge base curation, and agentic tool design
  • Translate advisor workflows and domain-specific terminology - including travel industry concepts, supplier data structures, and booking logic - into structured system requirements that the development team can implement
  • Create and manage the Product Backlog, including prioritization, grooming, and communication to the pod ahead of all Scrum ceremonies
  • Identify gaps between the system's current capabilities and advisor needs; propose and scope solutions that leverage agentic patterns (multi-step reasoning, tool use, memory, search) appropriately
  • Write acceptance criteria and user stories with sufficient precision to eliminate ambiguity for the development team, including edge cases related to AI response quality and failure modes
  • Manage and coordinate beta programs for AI feature releases, including feedback collection, issue triage, and iteration planning
  • Evaluate new AI tools, frameworks, and model releases independently; produce structured assessments against internal capability requirements
  • Coordinate with the Solutions & Support team and other internal stakeholders to ensure AI system changes are understood, testable, and supportable
  • Investigate and analyze problems, AI system behaviour, and user requirements in order to recommend appropriate solutions
  • Prepare detailed flow charts and diagrams outlining system capabilities, agentic tool flows, and retrieval architectures
  • Document system behaviour, design decisions, and known limitations for future reference
  • Support the Senior Product Manager in the product roadmap process and long-term capability planning for AI-driven systems
  • Prepare and facilitate planning and refinement ceremonies within the Scrum team

KEY SKILLS / EXPERIENCE
  • Bachelor's degree in Business, Information Science, Computer Science, or a related field; a combination of education and suitable work experience will be considered
  • 3-5 years of experience in a Product Owner, Technical Business Analyst, or product role
  • Comfortable reading REST API documentation, OpenAPI/Swagger specs, and data models
  • Strong backlog management and prioritisation skills with experience facilitating Scrum ceremonies
  • Demonstrated understanding of large language model fundamentals, including prompting strategies, context management, retrieval-augmented generation (RAG), and the behavioral characteristics and failure modes of generative AI systems
  • Practical experience evaluating AI output quality, including defining evaluation metrics, designing test cases, and interpreting model responses for accuracy and relevance
  • Familiarity with agentic system patterns, including tool/function calling, multi-step reasoning chains, and orchestration frameworks (e.g., n8n, LangChain, LlamaIndex, or equivalent)
  • Experience producing structured requirements and specifications that engineering teams building AI systems can act on directly
  • Ability to work fluently across both technical and non-technical stakeholders, translating AI system behaviour into plain language and business impact
  • Skilled in structured business analysis on medium to large projects involving AI, data, or platform work

NICE TO HAVE:
  • Prior experience working on AI, ML, or LLM-powered products strongly preferred
  • Familiarity with travel advisor workflows, travel industry terminology, or hospitality data models is an asset
  • Experience with AI governance or shared AI configuration management is a meaningful differentiator

CULTURAL FIT
  • Thrives working in a technology and KPI-driven organization
  • Able to thrive in an entrepreneurial environment
  • Highly functional in a fast-paced, constantly changing workplace - building plans through iterations based on what is and is not working
  • Ability to build trust and work through conflict both upwards and downward

COMPENSATION

We provide a competitive compensation package with a strong pay-for-performance rewards approach. Employees have the opportunity to participate in incentive programs and compensation tied to business and individual performance. The expected compensation range for this position is: $110,000 to $130,000.

The actual compensation may vary depending on local market conditions, geography and relevant job-related factors such as knowledge, skills, qualifications, experience, and education/training.

#LI-Hybrid

Similar Jobs

More Jobs at TripArc

More Consumer Technology Jobs

Find similar Technical Product Owner (AI & Agentic Systems) jobs: