Research Scientist - World Model

Luma AI

$250K — $450K *
Consumer Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • PhD or equivalent research record in ML, computer vision, robotics, or related fields.
  • Deep expertise in large-scale generative modeling (video/3D/world), self-supervised representation learning, or model-based reinforcement learning.
  • Strong experience with PyTorch and large-scale training on multi-node clusters.
  • A known research record with top-venue publications or widely-used open-source releases.

Responsibilities

  • Invent next-generation world model architectures focusing on controllability and physical consistency.
  • Develop mechanisms for agent interaction within the world, including action and view conditioning.
  • Define and own metrics covering physical fidelity, coherence, and usefulness for policy training.
  • Run studies to evaluate the effectiveness of compute, data, and architecture scaling.
  • Publish research at leading conferences and contribute to open-source releases.

Benefits

  • Work on cutting-edge technologies in generative modeling and world representation.
  • Opportunity to publish research and contribute to the scientific community.
  • Collaborative environment focused on innovation and open-source principles.
Full Job Description
THE ROLE

This is the role at the center of the thesis. Luma already trains the strongest generative video models in the industry; the next step is turning those models into world models - interactive, controllable, physically faithful, and useful as a substrate for embodied reasoning. As a Research Scientist on the World Models team, you'll work on the next generation of generative models that can be rolled out as worlds.

WHAT YOU'LL DO

- Invent next-generation world model architectures - diffusion, transformer, autoregressive, or hybrid - with a particular focus on controllability and physical consistency.

- Develop controllability mechanisms that let an agent step into the world: action conditioning, view conditioning, long-horizon rollouts.

- Define and own the metrics: physical fidelity, long-horizon coherence, action-following, and downstream usefulness for policy training.

- Run scaling studies that tell us where compute, data, and architecture pay off.

- Publish at the frontier; contribute to the open-source release that is the long-term deliverable.

MINIMUM QUALIFICATIONS

- PhD or equivalent research record in ML, computer vision, robotics, or related fields.

- Deep expertise in at least one of: large-scale generative modeling (video/3D/world), self-supervised representation learning, model-based RL.

- Strong PyTorch and large-scale training experience - you've trained models that hit the limits of a multi-node cluster.

- A research record the field knows (top-venue publications and/or widely-used open releases).

PREFERRED

- Prior work on world models, model-based RL, generative video, neural simulation, or 4D scene representations.

- Experience using generative models for downstream embodied tasks (planning, control, evaluation).

- Excitement about open-sourcing frontier models.

Compensation

The base pay range for this role is $250,000 - $450,000 per year.

Similar Jobs

More Jobs at Luma AI

More Consumer Technology Jobs

Find similar Research Scientist - World Model jobs: