Software Engineer, Agentic AI Infrastructure

Anrok, Inc

$120K — $160K *
Information Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • 3+ yearsBuilding and operating production-grade distributed systems
  • Experience designing scalable, resilient, and fault-tolerant services
  • Hands-on experience with AI agents or LLM-powered systems in production
  • Familiarity with modern AI stack including prompt engineering and agent orchestration
  • Experience leading technical decisions with architectural trade-offs
  • Knowledge of the full software development lifecycle
  • Ability to navigate ambiguity and deliver tangible solutions
  • Curiosity and motivation for experimenting with AI tools

Responsibilities

  • Design and build distributed, fault-tolerant infrastructure for AI agents
  • Own end-to-end technical architecture decisions for infrastructure services
  • Build evaluation, observability, and reliability tools for agent deployment
  • Collaborate with product engineers to align workflows with agent capabilities
  • Drive engineering best practices in code quality and system design
  • Identify and resolve performance and scaling issues
  • Mentor team members and contribute to technical culture

Benefits

  • Equity options in an early-stage startup
  • Daily lunch and snacks for onsite teams
  • 100% coverage for medical, dental, and vision insurance
  • Flexible sick benefits and One Medical membership
  • Annual stipend for learning and development opportunities
  • Team offsites and in-person events around company hubs
  • Home office setup stipend for remote employees
Full Job Description
We\'re building the agentic infrastructure layer at Anrok-the systems that let AI agents reason about tax data, take action across jurisdictions, and operate reliably at scale. This is early and foundational work: you\'ll be designing and shipping the primitives that the rest of the product builds on. We\'re looking for an engineer who pairs a strong distributed-systems background with real, hands-on experience building AI agent systems-someone who understands both how to make a service fault-tolerant and what it takes to make an LLM-powered agent reliable in production. If you want to work on distributed systems that sit at the intersection of AI and fintech, this role is for you.

In this role, you will
  • Design and build the distributed, fault-tolerant infrastructure that powers Anrok\'s AI agent capabilities-covering memory, state management, and execution for autonomous systems.
  • Own technical architecture decisions for new agent infrastructure services end-to-end, from initial design through production deployment and iteration.
  • Build the evaluation, observability, and reliability tooling that lets the rest of the team ship agents confidently on top of your infrastructure.
  • Collaborate closely with product engineers and our tax data team to translate real compliance workflows into reliable, scalable agent primitives.
  • Drive engineering best practices across the team: code quality, testing discipline, system design, and operational health.
  • Identify and fix performance, reliability, and scalability bottlenecks as our agent systems grow.
  • Help grow the team-mentoring engineers, contributing to technical culture, and raising the bar on how we build.


What excites us
  • You have a strong systems engineering background, with 3+ years of experience building and operating distributed, production-grade systems.
  • You\'ve designed services that are scalable, resilient, and fault-tolerant-and you\'ve done it more than once.
  • You\'ve built and deployed AI agents or LLM-powered systems in production, and you understand firsthand what makes them reliable and maintainable at scale.
  • You\'re familiar with the modern AI stack-prompt engineering, eval frameworks, RAG pipelines, tool calling, and agent orchestration-and you have a point of view on what the infrastructure beneath it should look like.
  • You think carefully about architecture and tradeoffs, and you\'re comfortable leading technical decisions without a complete playbook.
  • You have experience with the full software development lifecycle: design, code review, testing, deployment, and on-call ownership.
  • You\'re energized by ambiguity-you can take a fuzzy problem, break it down, and ship something real.
  • You\'re curious and motivated to learn new tools-you\'ve experimented with AI in your work or on your own, you\'re excited about what\'s possible, and you\'ve built something with it (an application, a workflow, a creative solution to a real problem) that you can walk us through.
What we offer
  • The equity upside of an early-stage startup with the product-market fit of a later-stage company.
  • Daily lunch and snacks for those working out of our San Francisco office.
  • Medical, dental, and vision insurance covered 100%.
  • One Medical membership covered, flexible sick benefits and more.
  • Annual learning and development stipend for books, online courses, and conferences, as well as a curious team to share your learnings with.
  • Annual team offsites and in-person opportunities around our growing Anrok hubs.
  • Home office setup stipend to ensure you have the equipment you need to thrive at work.


At Anrok, we embrace a dynamic and flexible hybrid work environment based out of our growing office hubs - San Francisco, New York City, and Salt Lake City where we collaborate in-person 3 days per week.

For employees located outside of these hub cities, we offer a fully remote setup U.S only.

Please be aware that Anrok does not recruit via WhatsApp or any third-party messaging platforms. All official communication from our team comes exclusively from [redacted].com email addresses. If you receive a suspicious message claiming to be from Anrok, please do not engage. All open roles are listed on this page.

Similar Jobs

More Jobs at Anrok, Inc

More Information Technology Jobs

Find similar Software Engineer, Agentic AI Infrastructure jobs: