Applied AI Engineer

Zello Inc

$110K — $130K *
Information Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • 2-5 years of experience in software or AI engineering roles
  • Proficiency in writing production Python code, with tangible examples of work
  • Practical understanding of LLM APIs, including prompt construction and tool use
  • Ability to decompose complex problems into manageable components
  • Experience with system integration via APIs, including authentication and error handling
  • Instinct for quality assurance and monitoring post-deployment
  • Operational ownership mindset for ongoing maintenance of developed systems

Responsibilities

  • Build AI agents and automations from scoping to ongoing maintenance
  • Write production-quality Python code for integrating LLM APIs
  • Connect AI tools with Zello's systems through API integrations
  • Monitor performance of deployed agents and implement improvements
  • Manage human reinforcement operations to enhance AI outputs
  • Develop evaluation harnesses for measuring agent quality and regression detection
  • Create reusable components and documentation for future development

Benefits

  • Competitive pay and equity with substantial upside potential
  • Flexible schedules and generous time off policies
  • Sabbatical offered every five years of service
  • Access to a collaborative workspace with recreational amenities
  • Supportive company culture prioritizing employee well-being
Full Job Description
The AI & Data team has more high-value AI use cases than capacity to build them. Today, the team leads agent development directly alongside many other responsibilities, and this work needs a dedicated builder. This hire will be one of the first few Applied AI Engineers at Zello, responsible for taking AI agents from prototype to production and then owning their ongoing health: monitoring quality, managing human reinforcement workflows, and driving continuous improvement. After a successful first year, you will • Shipped at least 3 production-grade AI agents within your first 90 days that internal teams actively use (Slack-integrated agents, workflow automations, data-driven assistants) • Built evaluation harnesses for deployed agents with automated quality scoring and regression detection • Integrated AI tools with Zello's existing systems (Slack, Jira, HubSpot, Snowflake) via APIs, with proper logging and monitoring in place • Established reusable code patterns and component libraries that make future agent development faster • Taken ownership of deployed agent operations: monitoring performance, overseeing human reinforcement workflows, triaging failures, and driving measurable improvement in agent quality over time • Independently scoped and shipped AI tools for new use cases, whether identified by stakeholders or discovered on your own What you'll do • Build AI agents and automations end-to-end: from scoping the use case through deployment and ongoing maintenance • Write production Python code that integrates LLM APIs (prompt construction, response handling, context management, tool use) into real workflows • Connect AI tools with Zello's systems (Slack, Jira, HubSpot, Snowflake) through APIs, handling authentication, rate limits, error cases, and logging • Monitor deployed agents in production: track quality metrics, triage failures, and ship improvements based on real usage data • Manage human reinforcement operations: review agent outputs, maintain feedback loops, and tune agent behavior based on reinforcement signals • Build and maintain evaluation harnesses that catch regressions and measure agent quality programmatically • Create reusable components, patterns, and documentation that raise the bar for future development on the team • Communicate clearly with technical and non-technical stakeholders about what you've built, what's working, and where things need attention Who you are • You have 2-5 years of professional experience in software engineering, AI engineering, or a related technical role. You're past the point of needing to learn basic professional work habits, but you haven't calcified into a single way of doing things. • You've written production Python and can point to real things you've built with it: tools, integrations, automations, shipped products. Not just notebooks or coursework. • You understand LLM APIs at a practical level. You can construct prompts, manage context windows, reason about token economics, and work with tool-use patterns. • You decompose messy problems into clean components with well-defined interfaces. When you describe a system you've built, people can follow the logic because you think in terms of abstractions, dependencies, and failure modes. • You've integrated systems via APIs before. You can read API docs, handle auth, manage rate limits, and deal with the inevitable edge cases of real-world integrations without getting stuck. • You have a quality instinct. You naturally ask "how do I know this is working?" and "how will I know when it breaks?" You write tests and build monitoring because you care about what happens after you ship, not because someone told you to. • You're comfortable with operational ownership. You don't treat deployment as the finish line. You monitor what you build, notice when things drift, review agent outputs, and do the sometimes unglamorous work of keeping AI systems healthy in production. • You pick up new frameworks, APIs, and domains quickly. You can point to examples of going from zero to productive in an unfamiliar area. • Your code is clean and documented. Other people can read it, understand it, and extend it without needing a walkthrough from you. This role is not • A research role. We're building on top of foundation model APIs, not training models or publishing papers. • A data engineering role. The existing team covers data infrastructure. You'll consume data, not build pipelines. • A DevOps or infrastructure role. You'll deploy your own agents, but you won't be managing servers or building CI/CD from scratch. • A solo project. You'll work closely with the Data & AI team and cross-functional stakeholders who use what you build. We hire for potential, passion for our mission, and a knack for solving difficult problems over checking every qualification box. We have competitive pay, equity with significant upside, and intentionally design our benefits to encourage healthy and well-balanced employees, flexible schedules and time off. We even offer a sabbatical after every five years of service so you're able to pursue and enjoy what matters most to you. And of course, we wouldn't be a technology company without a ping-pong table and free snacks in our break room. Join us!

Similar Jobs

More Jobs at Zello Inc

More Information Technology Jobs

Find similar Applied AI Engineer jobs: