Mercury

Senior Software Engineer - AI Enablement

Mercury$166K — $218K *
Information Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • 5+ years of backend development experience in complex systems
  • Fluent in multiple programming languages and platform engineering
  • Hands-on experience with LLM-powered systems including RAG pipelines
  • Understanding of cost modeling, observability, latency, and safety in AI
  • High-agency, self-directed, and effective without tightly-defined scope
  • Ability to communicate clearly with both technical and non-technical audiences

Responsibilities

  • Extend the existing AI platform by building and evolving MCP servers
  • Expand and operate LLM gateway infrastructure for multimodal interaction
  • Establish durable defaults through shared prompt libraries and policy-as-code
  • Develop clean and reliable context artifacts for agent consumption
  • Enhance internal knowledge discoverability for quick access to accurate information
  • Standardize key sources of truth in collaboration with domain teams
  • Create sandbox environments for safe and rapid AI experimentation

Benefits

  • Equity participation
  • Comprehensive health benefits
  • Flexible work arrangements
  • Professional development opportunities
  • Collaborative and innovative work culture
Full Job Description
In 1600, William Gilbert published De Magnete-the first systematic study of magnetism. He didn't just theorize; he built instruments, ran experiments, and shared what he learned so that others could go further. Three centuries later, those foundations helped power the modern world.

What you'll do

You'll join a team that has already started building Mercury's internal AI platform and enablement layer. Your work will be to extend, harden, and scale what's in motion, and to help partner teams adopt it.
Extend the AI platform foundation
  • Build and evolve MCP servers that connect internal systems and data sources into a coherent interface for agents and engineers.
  • Expand and operate our LLM gateway infrastructure: routing, rate limiting, cost attribution, and observability across teams.
  • Turn early patterns into durable defaults: shared prompt libraries, guardrails, and policy-as-code so teams can move fast safely.
Strengthen the shared company knowledge layer
  • Shape and maintain structured context artifacts-clean, reliable, agent-consumable-so LLMs working in Mercury's systems can reason accurately about our domain.
  • Improve internal knowledge discoverability and retrieval so both humans and agents can quickly find accurate answers.
  • Partner with domain teams to standardize key sources of truth, and keep them fresh.
Enable faster prototyping and iteration across the company
  • Build and refine sandbox environments and tooling that let engineers experiment with AI safely and at speed.
  • Create self-service scaffolding so non-engineers-PMs, ops, finance-can prototype and deploy AI-powered workflows with minimal hand-holding.
  • Build playgrounds and evaluation harnesses so internal AI agents can be tested and iterated in controlled environments before hitting production.

This list is illustrative. Priorities will shift as we learn; the right person will help choose the next highest-leverage work.
The ideal candidate
  • Has 5+ years of backend development experience in complex, production systems-you've built things that other engineers depended on.
  • Is fluent across programming languages and can navigate platform engineering, infrastructure, and developer tooling without needing a map.
  • Has hands-on experience building LLM-powered systems-RAG pipelines, agents, eval frameworks-and has shipped at least one of these to production.
  • Understands the real tradeoffs in AI deployments: cost modeling, observability, latency, and safety-not just the exciting parts.
  • Is high-agency and self-directed. You can operate effectively without tightly-defined scope, find the highest-leverage work, and get it done.
  • Communicates clearly across technical and non-technical audiences-you can explain what you built and why it matters.

The total rewards package at Mercury includes base salary, equity, and benefits. Our salary and equity ranges are highly competitive within the SaaS and fintech industry and are updated regularly using the most reliable compensation survey data for our industry. New hire offers are made based on a candidate's experience, expertise, geographic location, and internal pay equity relative to peers.

Our target new hire base salary ranges for this role are the following:
  • US employees (any location): $166,600 - $218,700
  • Canadian employees (any location): CAD 157,400 - 206,650

#LI-ES1

About Mercury

Mercury is a banking and financial services company that provides a range of products and services to individuals and businesses. Their offerings include checking and savings accounts, loans, credit cards, and investment services. The company was founded in 2000 and has since grown to become a leading player in the financial industry. Mercury's mission is to help people and businesses achieve their financial goals, and they are committed to providing excellent customer service and innovative solutions.
Learn more about Mercury
Size
5,000 employees
Industry

Similar Jobs

More Jobs at Mercury

More Information Technology Jobs

Find similar Senior Software Engineer - AI Enablement jobs: