Plus.ai

Senior/Staff Research Engineer - Vision-Language-Action Models (Autonomous Driving)

Plus.ai$170K — $260K *
Transportation
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • M.S. minimum; Ph.D. preferred in CS, EE, Mathematics, Statistics, or related field.
  • 3+ years of experience in deep learning frameworks like PyTorch, TensorFlow, or JAX.
  • Hands-on experience with vision-language/action model training.
  • Experience in model training, evaluation, and deployment in production settings.
  • Strong knowledge of cutting-edge VLA models and related technologies.
  • Experience in large-scale/distributed model training.

Responsibilities

  • Design, train, and evaluate VLA models for high-level driving decisions.
  • Own VLA workstream from data collection to on-vehicle validation.
  • Build pipelines for training and evaluating VLA performance metrics.
  • Develop techniques for model distillation and compression.
  • Enhance reasoning and robustness using SFT and RL post-training.
  • Collaborate with cross-functional teams to transition models to production.

Benefits

  • Work in a cutting-edge, innovative field with future-oriented projects.
  • Opportunities for personal and professional growth.
  • Free catered lunch and unlimited snacks and beverages.
  • Comprehensive salary and benefits package with 401(k) plan.
Full Job Description
You will join our core AI team at the frontier of autonomous decision-making, building the Vision-Language-Action (VLA) models that form SuperDrive's reasoning layer. You'll train VLA models that generate high-level driving decisions and trajectory guidance for on-board strategic decision-making, and design the knowledge distillation and compression techniques that transition large models onto on-board compute. Responsibilities • Design, train, and evaluate Vision-Language-Action models that generate high-level driving decisions and trajectory guidance in support of Plus's reasoning layer. • Own a VLA workstream end to end - data, architecture, large-scale training, and on-vehicle validation. • Build training and evaluation pipelines and rigorous metrics for VLA performance in driving contexts. • Develop distillation and compression recipes to deploy large reasoning models on on-board compute. • Apply SFT and RL post-training to improve reasoning, robustness, and long-tail behavior. • Collaborate with perception, planning, and platform teams to bring models from research to production Required qualifications • M.S. minimum, Ph.D. preferred in CS, EE, Mathematics, Statistics, or a related field. • 3+ years implementing and training models in a deep learning framework (PyTorch, TensorFlow, or JAX). • Direct, hands-on experience training vision-language / vision-language-action models. • Hands-on experience with model training, evaluation, and deployment in production. • Thorough understanding of state-of-the-art vision-language / VLA models, diffusion, flow matching, and transformers. • Experience with large-scale / distributed model training. Preferred Qualifications • Model distillation, quantization, and inference optimization (ONNX/TensorRT, mixed precision, custom kernels). • SFT and RL post-training of large multimodal models. • Hands-on experience with multi-modal sensor data (camera, LiDAR, radar). • Publications at top venues (CVPR, NeurIPS, ICML, ICLR, CoRL, RSS, ICRA). • Autonomous driving / ADAS experience. Salary range: $170,000-$260,00k Exact compensation may vary based on skills and experience. Your opportunities joining PlusAI Work, learn and grow in a highly future-oriented, innovative and dynamic field. Wide range of opportunities for personal and professional development. Catered free lunch, unlimited snacks and beverages. Highly competitive salary and benefits package, including 401(k) plan.

About Plus.ai

Land O'Lakes, Inc. is an American member-owned agricultural cooperative based in the Minneapolis-St. Paul suburb of Arden Hills, Minnesota, United States, focusing on the dairy industry. The cooperative has 1,959 direct producer-members, 751 member-cooperatives, and about 9,000 employees who process and distribute products for about 300,000 agricultural producers, handling 12 billion pounds of milk annually. It is ranked third on the National Cooperative Bank Co-op 100 list of mutuals and cooperatives. The co-op is one of the largest producers of butter and cheese in the United States through its dairy foods business; serves producers, animal owners and their families through more than 4,700 local cooperatives, independent dealers and other large retailers through its Purina Animal Nutrition business; and delivers seed, crop protection products, agricultural services and agronomic insights to 1,300 locally owned and operated cooperative and independent agricultural retailers and their grower customers through its WinField United business.
Learn more about Plus.ai

Similar Jobs

More Jobs at Plus.ai

More Transportation Jobs

Find similar Senior/Staff Research Engineer - Vision-Language-Action Models (Autonomous Driving) jobs: