Senior AI Engineer

Raylu, Inc

$165K — $230K *
Enterprise Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • 5-7 years experience in AI engineering, focusing on agent systems and LLMs.
  • Proven ability in building and debugging large-scale services and systems.
  • Deep understanding of LLM comparison, prompt strategies, and control mechanisms.
  • Experience in product-focused environments with a track record of improving task success rates.
  • Strong opinions based on comprehensive knowledge of technology trends and system design.

Responsibilities

  • Design and implement complete agent workflows, including APIs and monitoring tools.
  • Establish safety and performance metrics; develop monitoring dashboards for system reliability.
  • Collaborate with product and design teams to create and swiftly deploy innovative interaction designs.
  • Mentor other engineers by documenting best practices for LLM-based functionalities.

Benefits

  • Comprehensive health, dental, and vision insurance coverage.
  • 401k plan with an automatic 3% contribution without vesting requirements.
  • Paid lunches to support employee well-being.
  • Health and wellness benefits, including Citi Bike access.
  • Unlimited PTO to encourage work-life balance.
Full Job Description
Position Summary

We're hiring a product-oriented Senior AI Engineer who loves tinkering with LLMs and shipping real agent systems. We spend less time on fine-tuning and more on orchestration, evaluation, and reliability-so agents do real work safely, quickly, and repeatedly.

What we're looking for
  • Agentic systems: Function/tool calling, multi-step planning, routing, memory, and retrieval.
  • Engineering first: You can wire up services, craft eval harnesses, and debug latency/cost at scale.
  • LLM breadth: Comfortable comparing models/hosts, prompt strategies, and guardrail techniques.
  • Product focus: You instrument outcomes, run A/Bs, and iterate to improve task success rates.
  • Opinionated: Deep level of understanding of the technological landscape, making both high level system and granular code design decisions based on understanding rather than preference - diving deep on unknown patterns in order to build the best product.


Responsibilities
  • Design, build, and productionize agent workflows end-to-end (APIs, tools, evals, monitoring).
  • Create safety, cost, and latency controls; build dashboards and alerts for reliability.
  • Partner with product/design to invent new interaction patterns and ship them fast.
  • Document patterns and mentor engineers on best practices for LLM-powered features.


Nice to have
  • Experience with workflow engines (e.g., Temporal), comfort in full stack engineering


Logistics:
  • Compensation: $165K - $230K salary, competitive equity (4 year vest)
  • Location: New York City. We are a fully in-office team working out of Midtown Manhattan Monday through Friday. We allow for WFH days when anyone is traveling, but we do not allow for permanent remote work.
  • Benefits:
    • Generous health, dental, and vision insurance
    • 401k with 3% automatic contribution (no vesting)
    • Paid Lunches
    • Wellness and Citi Bike benefit
    • Unlimited PTO

Similar Jobs

More Jobs at Raylu, Inc

  • Senior AI Engineer
    $165K — $230K *
    New York, NY 10025 (New York County)
    Enterprise Technology
    In-Person
  • Senior Frontend Engineer
    $165K — $230K *
    New York, NY 10025 (New York County)
    Consumer Technology
    In-Person

More Enterprise Technology Jobs

Find similar Senior AI Engineer jobs: