Applied AI Engineer

MaintainX

$120K — $145K *
Information Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • Strong applied GenAI craft in prompt engineering and structured output.
  • Proven experience in building evaluation datasets and rubrics for model quality assessment.
  • Hands-on experience shipping LLM features into production services.
  • Ability to handle multimodal inputs like video, PDF, audio, and images.
  • Familiarity with LLM observability and cost management.

Responsibilities

  • Design and refine recipe prompts for generation processes.
  • Define schemas and validators for generated output quality.
  • Build and maintain evaluation datasets and rubrics for quality assessment.
  • Assemble context windows from multimodal inputs to optimize model calls.
  • Determine model choices and token budget based on trade-offs.

Benefits

  • Competitive salary and equity opportunities.
  • Comprehensive healthcare, dental, and vision coverage.
  • 401(k) and RRSP enrollment program.
  • Flexible PTO policy.
  • Collaborative and meritocratic work culture.
Full Job Description
The Role

You'll own the Generation half of Document Intelligence: turning multimodal primitives (keyframes, transcripts, OCR) into schema-valid entities like SOPs, and holding the line on quality so "fast" never becomes "fast and wrong."
  • Design and iterate recipe prompts - system, few-shot, and context assembly - for each generation recipe
  • Define per-entity target schemas and domain validators (procedure step-type rules, field caps) that generated output has to pass
  • Build generation-quality eval datasets and rubrics, offline and online, running on LLMX's eval pipeline, and close the loop when quality regresses
  • Assemble multimodal context windows from keyframes, transcript, and OCR so each model call has exactly what it needs
  • Choose the model and token budget per recipe based on quality, cost, and latency tradeoffs

You'll ride on LLMX for model access and on Attachments for ingestion, and hand off validated entities to the domains that own them. You'll report to our Engineering Lead and work closely with the Processing side of Document Intelligence.

Minimum Requirements:
  • Strong applied GenAI craft - prompt engineering, structured output / tool-use, RAG and retrieval-context patterns
  • Real eval discipline: you've built datasets and rubrics, measured factuality/relevance/quality, and closed the loop on regressions yourself
  • Shipped LLM features into production services, not notebooks, and can connect model performance to product impact
  • Comfort working with multimodal inputs - video, PDF, audio, image - converted to text or structured output

Nice to have:
  • LLM observability / cost awareness, or experience with an eval platform
  • Document, PDF, or video understanding; OCR; retrieval systems
  • Light fine-tuning experience, or familiarity with the industrial/maintenance domain

What's In It For You
  • Competitive salary and meaningful equity opportunities.
  • Healthcare, dental, and vision coverage.
  • 401(k) / RRSP enrollment program.
  • Take what you need PTO.
  • A Work Culture where:
    • You'll work alongside folks across the globe that reflect the MaintainX values: Smart Humble Optimists.
    • We believe in meritocracy, where ideas and effort are publicly celebrated.

Similar Jobs

More Jobs at MaintainX

More Information Technology Jobs

Find similar Applied AI Engineer jobs: