Applied AI Engineer

MaintainX

$120K — $145K *
Enterprise Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • 5-7 years of experience in applied Generative AI, including prompt engineering and structured outputs.
  • Experience building datasets and rubrics to evaluate AI outputs for quality and factual accuracy.
  • Demonstrated success deploying LLM-based features into production environments, linking model performance to business outcomes.
  • Proficient with multimodal inputs such as video, PDFs, and audio in relation to text or structured output.
  • Familiarity with the industrial and maintenance sectors is advantageous.

Responsibilities

  • Design and iterate recipe prompts for diverse generation recipes.
  • Define target schemas and validation rules for entity generation quality.
  • Build evaluation datasets and rubrics and manage quality feedback loops.
  • Assemble multimodal context windows from various data inputs for effective model calls.
  • Select appropriate models and token budgets, considering quality and performance trade-offs.

Benefits

  • Comprehensive health coverage that varies by country.
  • Retirement plans and leave policies tailored for different regions.
  • Equity options in addition to competitive base salary and potential annual bonuses.
Full Job Description
The Role

You'll own the Generation half of Document Intelligence: turning multimodal primitives (keyframes, transcripts, OCR) into schema-valid entities like SOPs, and holding the line on quality so "fast" never becomes "fast and wrong."
  • Design and iterate recipe prompts - system, few-shot, and context assembly - for each generation recipe
  • Define per-entity target schemas and domain validators (procedure step-type rules, field caps) that generated output has to pass
  • Build generation-quality eval datasets and rubrics, offline and online, running on LLMX's eval pipeline, and close the loop when quality regresses
  • Assemble multimodal context windows from keyframes, transcript, and OCR so each model call has exactly what it needs
  • Choose the model and token budget per recipe based on quality, cost, and latency tradeoffs

You'll ride on LLMX for model access and on Attachments for ingestion, and hand off validated entities to the domains that own them. You'll report to our Engineering Lead and work closely with the Processing side of Document Intelligence.

Minimum Requirements:
  • Strong applied GenAI craft - prompt engineering, structured output / tool-use, RAG and retrieval-context patterns
  • Real eval discipline: you've built datasets and rubrics, measured factuality/relevance/quality, and closed the loop on regressions yourself
  • Shipped LLM features into production services, not notebooks, and can connect model performance to product impact
  • Comfort working with multimodal inputs - video, PDF, audio, image - converted to text or structured output

Nice to have:
  • LLM observability / cost awareness, or experience with an eval platform
  • Document, PDF, or video understanding; OCR; retrieval systems
  • Light fine-tuning experience, or familiarity with the industrial/maintenance domain

Our mission is to keep the physical world running. Factories, fleets, hospitals and campuses stay up because the people who maintain them have tools worth using. That is what we build.

Compensation and benefits. Base pay is one part of the package. Depending on the role, compensation may also include commission, an annual bonus and equity. Benefits differ by country. For roles in the United States, Autodesk's benefits are described at benefits.autodesk.com. For roles in Canada and other countries, the plan differs on health coverage, retirement and leave, and your recruiter will walk you through it.

Belonging. We take pride in a culture where everyone can thrive. More at autodesk.com/company/global-belonging. More on where this is going: Autodesk CEO Andrew Anagnost on building the future of connected operations, and AOS SVP Stephen Hooper on welcoming MaintainX to Autodesk.

Similar Jobs

More Jobs at MaintainX

More Enterprise Technology Jobs

Find similar Applied AI Engineer jobs: