AlphaSense

Senior Engineering Manager, AI

AlphaSense$361K — $496K *
Information Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • 7+ years of experience in engineering leadership roles.
  • Expertise in high-throughput, low-latency distributed systems.
  • Proven ability to guide high-level architectural discussions.
  • Exceptional communication skills for cross-functional collaboration.
  • Experience with modern AI tools integrated in development workflows.
  • Familiarity with orchestration technologies like Temporal or Envoy.
  • Proficient in programming languages such as Python and Java.

Responsibilities

  • Lead and mentor a team of up to 10 senior and staff engineers.
  • Cultivate a culture of technical excellence and predictable delivery.
  • Oversee the architecture of the enterprise AI Gateway, ensuring scalability and high availability.
  • Manage the integration of multiple LLM vendors and optimize for performance metrics.
  • Collaborate with product and engineering teams to ensure alignment with company goals.
  • Establish engineering best practices and standards across the organization.

Benefits

  • Engagement in equity offering as part of compensation.
  • Access to a generous benefits program.
Full Job Description

About the Role:

To support our growth, we are searching for a Senior Engineering Manager to lead the AI Platform team. This group builds and operates our core AI Gateway, serving as the critical high-throughput highway for all Large Language Model (LLM) traffic across the entire AlphaSense ecosystem. The right leader will bring deep experience running high-performance teams, a strong background in distributed system architecture, and hands-on familiarity with multi-vendor integrations. Superior communication and strategic collaboration skills are critical for managing expectations and aligning stakeholders across the entire R&D organization.
Who You Are:
  • Proven Engineering Leadership: Strong track record of managing and growing high-performing teams of senior and staff engineers, with a passion for developing technical leaders and aligning engineering objectives with business strategy.
  • Enterprise Scale Experience: Seasoned background in designing, building, and operating high-throughput, low-latency distributed systems (specifically handling complex routing, caching, queueing, or rate limiting).
  • Technical Thought Leadership: Ability to deeply engage in high-level architectural discussions, provide constructive technical direction, and deliver high-impact feedback during architectural reviews.
  • Strategic Communication: Exceptional communication and partnership skills to align diverse engineering, product, and executive partners across the R&D organization.
  • Modern Tooling & AI-First Mindset: Active embrace of AI tools in developer workflows, with an expectation for the team to leverage AI in their toolchains to maximize engineering velocity.
  • Relevant Tech Stack Experience (Nice to Have): Experience in the applied AI space or working with frameworks and tools such as LangChain, LangGraph, LiteLLM, or OpenRouter.
  • Experience with orchestrators and proxies like Temporal, Envoy, or similar enterprise-grade gateway technologies.
  • Experience with Python, Java, and highly distributed caching/queueing systems.

What You'll Do:
  • Strategic Team Leadership: Manage, mentor, and grow a highly talented team of up to 10 senior and staff software engineers (mostly distributed across North America).
  • Foster a high-performance culture of technical excellence, predictable delivery, and career growth.
  • High-Scale Operations & Scaling: Own the strategy and architecture of our enterprise AI Gateway - currently processing up to 1 Trillion LLM tokens per week with a projected 10x growth surge driven by agentic workflows (such as SuperAnalyst) - while ensuring high availability, sub-millisecond routing, caching, queueing, and robust fallback mechanisms.
  • Multi-Vendor Orchestration: Strategically guide the integration, evaluation, and management of 6+ major LLM vendors and 50+ distinct models, optimizing for latency, cost, and reliability across different providers.
  • Cross-Functional Alignment: Partner closely with product management, AI research teams, and executive engineering leads to align the gateway's roadmap with core product features and organizational goals.
  • Technical Governance: Define and champion software engineering best practices, architectural standards, and token-based cost-tracking telemetry across the AI Platform organization.


For base compensation, we set standard ranges for all roles based on function and level benchmarked against similar stage growth companies and internal comparables. In order to be compliant with local legislation, as well as to provide greater transparency to candidates, we share salary ranges on all job postings regardless of desired hiring location. Final offer amounts are determined by multiple factors including candidate experience/expertise and may vary from the amounts listed below.

You may also be offered equity, and a generous benefits program.

Compensation Range

$361,200-$496,800 USD

About AlphaSense

AlphaSense is a software company that provides an AI-powered search engine for business professionals. The company was founded in 2011 and is headquartered in New York City. AlphaSense's search engine allows users to search across a wide range of sources, including company filings, news articles, and research reports. The company's platform is used by a variety of industries, including finance, consulting, and legal. AlphaSense has received numerous awards for its innovative technology and has been recognized as one of the fastest-growing companies in the United States.
Learn more about AlphaSense
Size
200 employees
Industry
Founded
2011

Similar Jobs

More Jobs at AlphaSense

More Information Technology Jobs

Find similar Senior Engineering Manager, AI jobs: