Senior AI Engineer

Rockstar

$130K — $180K *
US-AnywhereRemote in United States
Enterprise Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • 5+ years of experience in machine learning or related technical role.
  • 2+ years of experience in production-grade AI or LLM systems.
  • Advanced proficiency in Python programming with a focus on maintainability.
  • Hands-on experience with key ML frameworks like PyTorch and TensorFlow.
  • Expertise in LLM applications, retrieval-augmented generation systems, and model evaluation techniques.
  • Experience with deployment technologies including Docker and Kubernetes.
  • Strong understanding of machine learning, NLP, and information retrieval concepts.

Responsibilities

  • Design and deploy advanced production GenAI systems including LLM applications and AI-powered workflows.
  • Architect scalable AI services using modern ML frameworks and container orchestration tools.
  • Optimize retrieval systems employing embeddings and semantic search techniques.
  • Fine-tune and evaluate Large Language Models for specific domain applications.
  • Build automated evaluation frameworks to assess model quality and performance.
  • Implement observability measures for AI systems to monitor and detect issues.
  • Translate prototypes into robust, production-ready features.

Benefits

  • Opportunity to lead innovative projects in advanced AI technologies.
  • Mentorship and professional development in a collaborative engineering environment.
  • Access to cutting-edge tools and frameworks for AI development.
  • Engagement with cross-functional teams to influence AI strategy and capabilities.
  • A role that emphasizes both technical execution and leadership in AI engineering.
Full Job Description
Position Summary

The client is seeking a Sr. AI Engineer/Sr. Machine Learning Engineer to design, build, deploy, and maintain production-grade AI systems across their data intelligence platform. This role will lead the development of LLM-powered applications, agentic workflows, retrieval-augmented generation systems, model evaluation pipelines, and scalable AI services.

The ideal candidate combines strong machine learning expertise with practical production engineering experience. This person will own complex technical work from concept through deployment, mentor other engineers, and help define best practices for building reliable, observable, and secure AI systems.

Essential Responsibilities
  • Design, build, and deploy production GenAI systems, including LLM applications, agentic workflows, RAG pipelines, and AI-powered search capabilities.
  • Architect scalable AI services using modern ML frameworks, model-serving tools, APIs, Docker, Kubernetes, and CI/CD pipelines.
  • Develop and optimize retrieval systems using embeddings, vector databases, semantic search, reranking, and structured data sources.
  • Fine-tune, adapt, and evaluate LLMs for domain-specific use cases using prompt engineering, supervised fine-tuning, LoRA / QLoRA, or related methods.
  • Build automated evaluation frameworks to measure model quality, prompt performance, retrieval accuracy, reasoning reliability, latency, and cost.
  • Implement observability for AI systems, including tracing, logging, performance monitoring, drift detection, and output-quality review.
  • Translate prototypes and research concepts into reliable product features that can scale in production.
  • Partner with product managers, data engineers, backend engineers, analysts, and business stakeholders to define AI capabilities and technical tradeoffs.
  • Review architecture, provide technical guidance, mentor junior team members, and promote strong engineering practices.
  • Create clear technical documentation, implementation plans, runbooks, and model lifecycle documentation.


Required Qualifications
  • 5+ years of experience in machine learning engineering, AI engineering, data science engineering, or a related technical role.
  • 2+ years of experience building or shipping production GenAI, LLM, or AI-powered systems.
  • Advanced Python programming skills and experience building maintainable production software.
  • Hands-on experience with PyTorch, TensorFlow, Hugging Face Transformers, scikit-learn, or similar ML frameworks.
  • Experience with LLM applications, RAG systems, embeddings, vector databases, prompt engineering, and model evaluation.
  • Experience deploying AI / ML services using Docker, Kubernetes, CI/CD workflows, APIs, and cloud-native infrastructure.
  • Strong understanding of classical machine learning, deep learning, NLP, information retrieval, and model validation.
  • Ability to communicate complex AI concepts clearly to technical and non-technical stakeholders.
  • Experience mentoring engineers, reviewing technical designs, or leading complex AI engineering initiatives.


Preferred Qualifications
  • Advanced degree in Computer Science, Machine Learning, Artificial Intelligence, Data Science, or a related field.
  • Experience with agent frameworks such as LangGraph, AutoGen, CrewAI, or similar tools.
  • Experience with model-serving platforms such as vLLM, BentoML, Triton, Ray Serve, or similar systems.
  • Familiarity with ML observability, experiment tracking, model monitoring, and prompt/version management tools.
  • Experience with graph-based retrieval, knowledge graphs, multimodal models, large-scale data processing, or security-focused data products.
  • Experience with infrastructure-as-code, workflow orchestration, model routing, caching, batching, or quantization.


Special Skills or Experience Required
  • Proven experience building and deploying production GenAI systems, including LLM applications, agentic workflows, and RAG pipelines.
  • Advanced Python and ML framework experience, including PyTorch, TensorFlow, Hugging Face Transformers, or similar tools.
  • Experience with LLM fine-tuning, prompt engineering, embeddings, vector databases, semantic search, and model evaluation.
  • Strong production engineering skills, including Docker, Kubernetes, CI/CD, model serving, observability, latency optimization, and technical leadership.


Success Measures

Success in this role will be measured by the delivery of reliable AI capabilities, improved model quality, reduced latency and cost, stronger evaluation coverage, improved observability, and the successful mentorship of other engineers. The role should help increase the speed and confidence with which the company can move AI features from prototype to production.

Similar Jobs

More Jobs at Rockstar

  • Head of Integrations
    $120K — $180K *
    San Francisco, CA 94112 (San Francisco County)
    Real Estate & Construction
    In-Person
  • AI Deployment Strategist
    $100K — $150K *
    San Francisco, CA 94112 (San Francisco County)
    Technical Services
    In-Person
  • Rockstar Games
    Vice President, Value Based Care
    $150K — $175K *
    New York, NY 10025 (New York County)
    Healthcare
    In-Person
  • Senior AI Engineer
    $130K — $180K *
    Remote
    Enterprise Technology
    Remote in United States
  • Recruiter
    $90K — $130K *
    San Francisco, CA 94112 (San Francisco County)
    Staffing
    In-Person

More Enterprise Technology Jobs

Find similar Senior AI Engineer jobs: