Brown Brothers Harriman

Senior AI Engineer

Brown Brothers Harriman$175K — $215K *
Finance & Insurance
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • 5+ years of software engineering experience, including 1+ years on GenAI/LLM applications in production.
  • Proven track record of shipping AI features to real end users.
  • Proficient in using LLM APIs in a production environment, particularly Anthropic Claude or OpenAI.
  • Experience building and implementing RAG systems in live settings.
  • Familiar with agentic frameworks like Agno, LangChain, or LlamaIndex.
  • Strong coding skills in Python and cloud experience with Azure or AWS.
  • Knowledge of vector databases such as Pinecone or Weaviate.

Responsibilities

  • Build and enhance AI-driven features that allow natural language data transformations.
  • Implement production-ready LLM pipelines that are robust and observable.
  • Continuously evaluate and improve AI output quality using automated scoring methods.
  • Optimize AI systems for accuracy, latency, and cost based on user patterns.
  • Develop multi-step agentic workflows with proper error handling and escalation features.
  • Collaborate with Backend Engineers to integrate AI functionality into the platform's API.
  • Maintain high coding standards through participation in code reviews.

Benefits

  • Opportunities for professional development and training.
  • Comprehensive healthcare coverage and income protection plans.
  • Long-term savings and retirement plans with profit-sharing options.
  • Generous time off policies to support work-life balance.
  • Inclusive workplace that values diverse experiences and skillsets.
Full Job Description
About the Role

As an AI Engineer, you'll build the intelligence layer of the platform - the AI-powered features that allow financial services users to generate data transformations from natural language, get intelligent integration suggestions, detect data quality issues, and refine outputs based on feedback. This is where the product stops feeling like a tool and starts feeling genuinely new.

This is a hands-on production role. You'll build and iterate on LLM pipelines, RAG systems, and agentic workflows using Agno; optimize AI systems for accuracy, latency, and cost in a context where correctness matters; and collaborate closely with Backend Engineers to ensure AI capabilities are reliably surfaced through the platform. You'll work under the direction of the Head of AI Engineering and have real ownership over the features you build.

Responsibilities

AI Feature Development
  • Build and iterate on AI-powered product features - transformation generation from natural language, integration configuration suggestions, data quality detection, and automated validation
  • Implement LLM pipelines that are robust, observable, and production-ready - not proof-of-concepts

LLM Pipeline Engineering
  • Build and optimize LLM pipelines including prompt engineering, context management, and RAG systems tailored to financial services data schemas
  • Evaluate and improve AI output quality continuously - build evaluation datasets and automated scoring frameworks
  • Optimize for accuracy, latency, and cost across different usage patterns

Agentic Workflows
  • Implement multi-step agentic workflows using Agno,
  • Build workflows that handle complex, multi-turn AI interactions cleanly - with proper error handling, retry logic, and human escalation paths

Platform Collaboration
  • Work closely with Backend Engineers to integrate AI capabilities into the platform's API and workflow layer
  • Build the service interfaces that connect AI outputs to platform execution cleanly
  • Participate in code reviews and maintain high standards for code quality and testability


Requirements

Experience
  • 5+ years software engineering; 1+ years focused on GenAI/LLM applications in production
  • Has shipped AI features to real users - not just prototypes or internal demos

Technical Skills
  • Hands-on with LLM APIs in production - Anthropic Claude and/or OpenAI
  • Built and shipped RAG systems to production (not just experimented with them)
  • Experience with agentic frameworks - Agno, LangChain, LlamaIndex, or comparable
  • Strong Python proficiency
  • Azure or AWS cloud experience
  • Vector databases - Pinecone, Weaviate, pgvector, or comparable
  • Active user of AI coding assistants in daily workflow


Nice to Have
  • Financial services or data domain background - understanding of financial data schemas, transformation logic, or data quality requirements adds significant context to the role
  • Experience with Temporal or workflow orchestration systems
  • Experience fine-tuning models or working with open-source LLMs for domain-specific tasks
  • Open-source AI contributions or technical writing
  • Data engineering familiarity - understanding ETL/ELT patterns helps in building more effective transformation generation features


Salary Range

MA: $175,000 - $215,000 base salary + annual target bonus

NY/ NJ: $175,000 - $215,000 base salary + annual target bonus

BBH and its affiliates' compensation program includes base salary, discretionary bonuses, and profit-sharing. The anticipated base salary range(s) shown above are only for the indicated location(s) and may differ in other locations due to cost of living and labor considerations. Base salaries may vary based on factors such as skill, experience and qualification for the role. BBH's total rewards package recognizes your contributions with more than just a paycheck-providing you with benefits that enhance your experience at BBH from long-term savings, healthcare, and income protection to professional development opportunities and time off, our programs support your overall well-being.

We value diverse experiences. We value diverse experiences and transferrable skillsets. If your career hasn't followed a traditional path, includes alternative experiences, or doesn't meet every qualification or skill listed in the job description, please do go ahead and apply.

About Brown Brothers Harriman

Brown Brothers Harriman & Co. (BBH) is the oldest and largest private bank in the United States. Founded in 1818, BBH has been a leader in the financial industry for over 200 years. The company provides a wide range of financial services to individuals, families, and institutions, including wealth management, investment management, and private banking. BBH has offices in the United States, Europe, and Asia, and manages over $1.6 trillion in assets.
Learn more about Brown Brothers Harriman
Size
7,000 employees
Industry

Similar Jobs

More Jobs at Brown Brothers Harriman

  • Brown Brothers Harriman
    Senior AI Engineer
    $175K — $215K *
    Jersey City, NJ 07305 (Hudson County)
    Finance & Insurance
    In-Person
  • Brown Brothers Harriman
    Equity Trading Analyst
    $85K — $105K *
    New York, NY 10025 (New York County)
    Finance & Insurance
    In-Person
  • Brown Brothers Harriman
    Senior Tax Officer
    $150K — $190K *
    New York, NY 10025 (New York County)
    Legal & Accounting
    In-Person
  • Brown Brothers Harriman
    Systems Architect Senior
    $140K — $190K *
    Boston, MA 02115 (Suffolk County)
    Information Technology
    In-Person
  • Brown Brothers Harriman
    Vendor Contract Negotiator
    $80K — $110K *
    Jersey City, NJ 07305 (Hudson County)
    Finance & Insurance
    In-Person

More Finance & Insurance Jobs

Find similar Senior AI Engineer jobs: