Senior AI Engineer

As an AI Engineer at Jeeves, you will own whole workflows from end to end, not individual features. You'll decide how to build it, ship it, measure it, and keep improving it. You'll work closely with Product, Backend Engineering, and our customers, but you won't wait for someone to hand you a spec. This is a senior, hands-on role for people who are AI-native in how they work. You use coding agents and AI tools every day to move faster, and you know where they fall short. It isn't a research role, and it isn't a role for someone who wants a narrow, well-defined ticket queue. Location: This role is remote based out of Canada. #LI-REMOTE What You'll Do: Own AI Workflows End to End - Design agentic and LLM-based systems that combine extraction, retrieval, reasoning, and tool use to complete multi-step work, with clear human-in-the-loop points - Write the design docs, make the build-vs-buy and model choices, and set the success metrics for each workflow you own Build Reliable AI in Production - Build production-grade LLM pipelines: prompt and context design, structured outputs, validation, fallbacks, and confidence scoring - Integrate AI services cleanly with Jeeves's backend: clear API contracts, retries, graceful degradation, and per-customer data isolation - Manage cost and latency across models, choosing the right model for each step Measure, Monitor, and Improve - Build evaluation sets and automated evals for every workflow you own, and use them to catch regressions when prompts, models, or data change - Instrument AI components with logging, tracing, dashboards, and alerts so you know when quality drops before a customer does - Keep an audit trail of AI decisions that meets the standards of a regulated financial product Raise the Bar for AI Engineering at Jeeves - Set patterns, shared tooling, and practices that other engineers can build on - Show the wider team how to use coding agents and AI tools well in day-to-day engineering - Review peers' AI system designs and share what you learn openly Minimum Requirements: - 7+ years of professional software engineering experience, including at least 2 years building and operating LLM or AI-powered systems in production - A track record of owning a large system or workflow end to end, from scoping and design through launch and iteration, with limited direction - Hands-on experience shipping LLM-powered applications with APIs such as Anthropic, OpenAI, or similar, including structured outputs, error handling, and evaluation - Experience designing agentic or multi-step AI workflows (tool use, orchestration, human review steps) - Strong proficiency in Python, plus solid backend fundamentals: REST APIs, PostgreSQL or similar relational databases, async patterns, and a major cloud provider (AWS, GCP, or Azure) - Experience with observability for AI systems: logging, tracing, dashboards, and quality monitoring - Professional fluency in English, written and spoken