Engineer II, AI/ML

CarMax, Inc.

$88K — $133K *
Information Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • Bachelor's degree in Computer Science, Computer Engineering, or a related field, or equivalent experience
  • 2+ years of experience in software engineering, machine learning engineering, or AI engineering in an enterprise setting
  • Proficiency in programming languages like Python, Java, or C# with ML frameworks experience such as PyTorch or TensorFlow
  • Familiarity with distributed databases and systems, focusing on high-throughput and low-latency applications
  • Strong communication skills suited for both technical and non-technical interactions

Responsibilities

  • Build and maintain production ML capabilities ensuring performance metrics like latency and cost are met
  • Design and implement agentic AI systems with effective monitoring and orchestration
  • Monitor operational health of ML and agentic systems, including incident response and preventive measures
  • Collaborate with Data Scientists to turn experiments into production-grade code
  • Partner with engineering and product teams to enhance CarMax's customer experience using ML models
  • Drive innovation and improvement initiatives within data science and machine learning

Benefits

  • Eligibility for paid sick time, vacation time, and paid holidays after a waiting period
  • Full-time salaried Associates enjoy unlimited paid time away for personal needs
  • Access to benefits like bereavement and jury duty time with manager approval
  • Additional flexibility in work location arrangements depending on the office being chosen (Richmond, VA or Plano, TX)
Full Job Description
8116 - Midtown Office - 2220 W. Broad Street, Richmond, Virginia, 23220

The Engineer II, ML & AI Engineering role at CarMax is responsible for building and operating scalable machine learning and AI capabilities across the organization. You will partner closely with Data Scientists to productionize models and develop reliable inference services, with a focus on testing, monitoring, scalability, and operational excellence. This role plays a key part in delivering resilient, high-performing AI and ML solutions that power critical business and customer experiences.

We are looking for an engineer with a strong foundation in software and cloud engineering who is passionate about transforming machine learning and AI innovations into mission-critical, high-visibility capabilities that support CarMax's iconic customer experience.

Essential Responsibilities:

  • Build and maintain production machine learning capabilities spanning feature engineering, training, evaluation, deployment, and model inference supporting initiatives across the organization, with attention to latency, throughput, and cost


  • Design and build agentic AI systems, including tool use, orchestration, memory, and the evaluation harnesses and observability needed to run them reliably in production.


  • Own the operational health of production ML and agentic systems: monitoring and alerting for model performance, data drift, and prediction quality, plus on-call incident response end to end and the follow-through that prevents repeat failures


  • Collaborate with Data Scientists to translate experimental work into tested, maintainable, production-grade code.


  • Partner with engineering and product teams to turn machine learning models into mission-critical, high-visibility capabilities that support CarMax's iconic customer experience


  • Demonstrates a passion for Data Science and Machine Learning, continuously driving innovation and improvement in these domains.


Minimum Qualifications:

  • Bachelor's degree in Computer Science, Computer Engineering, a related technical field, or equivalent practical experience


  • 2+ years of professional experience in software engineering, systems engineering, machine learning engineering, or AI engineering, including experience building, deploying, and supporting production applications in an enterprise environment.


  • Proficiency in a programming language such as Python, Java, or C#, and hands-on experience with ML frameworks such as PyTorch or TensorFlow


  • Working knowledge of distributed databases (e.g., DynamoDB, Cosmos DB), caching systems, and vector databases, with experience applying them to high-throughput, low-latency production workloads


  • Excellent communication skills, with the ability to adapt messaging to technical and non-technical audiences


  • Experience on a fast-paced, highly collaborative agile team within a product-oriented organization


Preferred Qualifications:

  • Agentic development workflows: Comfortable using AI coding agents to plan, implement, test, and review software, along with sound judgment about where agent-generated work requires human verification


  • MLOps practices: experiment tracking, model registries, reproducible training, and CI/CD or automated retraining for ML (MLflow, Azure ML, SageMaker, Kubeflow, or equivalent)


  • Experience with model serving platforms and real-time inference (Azure ML endpoints, Databricks, SageMaker, or equivalent)


  • Experience designing or operating microservices and distributed architectures (containers, Kubernetes, service-to-service APIs)


Work Location and Arrangement: This role can be based out of the CarMax Home Office in Richmond, VA and Associates will work onsite 4 days per week or this role can be based out of our Dallas Technology hub, Plano, TX and Associates will work onsite 2 days per week.

Work Authorization: Applicants must be currently authorized to work in the United States on a full-time basis. Sponsorship will not be considered for this specific role.

The annual salary for this position is:
$88,800.00 - $133,200.00
May be eligible for bonus and equity.

Benefits:

Except as otherwise required by state law, CarMax Associates are entitled to the following paid sick, vacation, and holiday time.

Associates that are considered full-time hourly or commission/incentive eligible:
  • To earn up to 48 hours of sick time per year accrued on a per pay period basis and between 80 hours and 200 hours per year of vacation time after a 90 day waiting period depending on years of continuous service with the Company.
  • For 8 hours of pay for each of a total of 6 paid scheduled holidays per year plus 1 floating holiday. If such an Associate does work on a scheduled holiday due to business need, they are eligible for Holiday Premium Pay.


Associates considered full-time salaried are entitled to paid time away with no specified limit as needed for sick, vacation, bereavement, jury duty, holidays, floating holiday, etc. subject to manager approval.

For more details about benefits, please visit our CarMax Benefits website.

Upon an applicant's request, CarMax will consider reasonable accommodation to complete the CarMax Job Application.

Similar Jobs

More Jobs at CarMax, Inc.

More Information Technology Jobs

Find similar Engineer II, AI/ML jobs: