Product Manager, AI Products

Caseware

$120K — $130K *
Enterprise Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • 4+ years of product management experience in tech, including 1-2 years with AI or machine learning products.
  • Experience building and running evaluation frameworks for AI products, including golden datasets and rubrics.
  • Technical fluency in LLMs, RAG, prompt engineering, and embedding strategies.
  • High agency with ownership of product outcomes and decision-making.
  • Genuine curiosity about advancements in AI and continued research.
  • Experience partnering with domain experts in regulated and professional settings.
  • Able to thrive in ambiguity and navigate complex problems without predefined solutions.

Responsibilities

  • Drive AI initiatives within Caseware by shaping work priorities based on user research and technical feasibility.
  • Design and implement evaluation frameworks to assess AI outputs using practitioner-level standards.
  • Collaborate with engineering to translate complex problem statements into clear product requirements.
  • Engage with domain experts and accounting firms to validate AI outputs against professional standards.
  • Conduct continuous user discovery by observing workflows and testing prototypes in practical contexts.
  • Stay updated on the AI landscape to determine relevant technological trends for Caseware's products.
  • Define and manage product health metrics for AI features to guide product decisions.

Benefits

  • Work with cutting-edge technology in accounting and financial reporting.
  • Collaborative culture that values your ideas and encourages knowledge sharing.
  • Flexible work options, including hybrid and remote opportunities, for better work-life balance.
  • Competitive salary complemented by comprehensive health insurance and retirement plans.
  • Opportunity to directly influence client success through impactful work.
  • Recognition programs, performance bonuses, and career growth opportunities.
  • Possibility to work on international projects with a diverse team.
Full Job Description
We are looking for a Product Manager to own the development of AI capabilities within the Caseware platform. You will work closely with engineering, domain experts, and external partner firms to define what we build, set a rigorous bar for quality, and ship AI that practitioners trust with real work.

This role requires high agency. You will operate with significant autonomy, drive decisions without waiting for permission, and take full ownership of outcomes. The right candidate is intellectually curious, stays genuinely close to developments in AI, and brings the judgment to know which new capabilities matter for our domain and which don't.

This is a full time position.

This is a New role.

Location:

This is a hybrid role requiring the successful candidate to work 3 days a week in our Toronto office, located at 351 King St E , Toronto, ON.

What you will be doing:

  • Drive high-impact AI initiatives within the Caseware platform transformation - shape priorities and sequencing for your workstream, grounded in user research, domain expertise, and a clear view of technical feasibility.
  • >


  • Design and run rigorous eval frameworks: build golden datasets, define task taxonomies, write rubrics that score AI outputs the way a senior practitioner would, and run structured eval cycles before and after every major release.
  • >


  • Work daily with engineering to translate precise problem statements into well-scoped product requirements - including clear acceptance criteria and eval bars before development begins.
  • >


  • Embed with domain experts and partner accounting and audit firms to validate AI outputs against professional standards - not just user preferences, but what a qualified practitioner would actually sign off on.
  • >


  • Drive continuous discovery with practitioners: shadow workflows, test prototypes in context, and turn 'this doesn't feel right' into specific, actionable failure modes.
  • >


  • Stay ahead of the AI landscape - monitor model developments, new architectures, emerging agent patterns, and competitor moves, and bring a clear point of view on what matters for Caseware.
  • >


  • Define and own product health metrics for AI features: task completion, correction rates, override frequency, trust signals, and time-to-completion - and use them to drive product decisions.
  • >


  • Synthesize signals across engineering, partners, domain experts, customer success, and leadership into a coherent product direction - and communicate it with clarity at every level of the organization.
  • >


What you will bring:

  • 4+ years of experience in technology-focused product management or product development, including 1-2 years working deeply with AI or machine learning-driven products.
  • >


  • Direct experience building and running eval frameworks for AI products - golden datasets, rubrics, human-in-the-loop validation, and regression tracking across releases.
  • >


  • Technical fluency in LLMs, RAG, prompt engineering, embeddings, and agentic patterns - enough to have substantive conversations with engineers and know when a product problem is a model problem.
  • >


  • High agency: you identify what needs to happen, move without waiting to be told, and take ownership of outcomes rather than just activities.
  • >


  • Genuine curiosity about AI - you follow model releases, read research, understand what frontier labs are shipping, and form your own views on what matters.
  • >


  • Experience working with domain experts or subject matter specialists to define quality bars in high-stakes, regulated, or professional-grade contexts.
  • >


  • Comfortable with ambiguity. Many of the problems this role works on do not have clear playbooks - you are energized by that, not slowed down by it.
  • >


Salary Range:

The annual base salary for this position is between $120,000 CAD and $130,000 CAD per year.

This role is also eligible for discretionary bonus and/or commission, as well as other benefits. Actual pay within the listed range will be determined based on factors such as transferable skills, relevant experience, market conditions, and primary work location. The posted range is subject to change and may be updated periodically.

What's in it for you:

• Innovation is at our core. We work with cutting-edge technology in accounting and financial reporting, constantly pushing the boundaries to create impactful software solutions.

• We are committed to a collaborative culture, where your ideas are valued, and knowledge sharing is encouraged within a supportive, inclusive team.

• Work-life balance is important to us. We offer flexible work options, remote opportunities, and generous time-off policies to ensure a healthy work-life balance.

• We offer competitive compensation, including a competitive salary and comprehensive benefits such as health insurance and retirement plans.

• We are driven by impactful work. Your contributions directly affect how our clients manage financial processes and drive their success.

• Recognition and rewards matter to us. We celebrate hard work through recognition programs, performance bonuses, and opportunities for career growth.

• We embrace global opportunities. Work on international projects and collaborate with a diverse, global team.

Similar Jobs

More Jobs at Caseware

More Enterprise Technology Jobs

Find similar Product Manager, AI Products jobs: