AI Researcher: Multimodal Understanding

Mirror Physics Corporation

$120K — $180K *
Consumer Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • Ph.D. or equivalent in Computer Science, Materials Science, Chemistry, or a related field emphasizing machine learning.
  • 3+ years of research experience with at least two modalities (language, vision, 3-D molecules/point clouds, graphs).
  • Fluency in Python and modern ML stacks like PyTorch/JAX; familiar with distributed training tooling (CUDA, NCCL, Slurm/K8s/Ray).
  • Proven experience in deploying large-scale generative or contrastive models (e.g., LLMs, diffusion, VAE, CLIP, NeRF, equivariant GNNs).
  • Strong track record of publications or open-source contributions in ML for physical sciences.
  • Excellent collaboration, communication, and teamwork abilities.
  • Deep commitment and passion for advancing science.

Responsibilities

  • Design and build multimodal architectures that integrate text, vision, and chemical structure.
  • Curate and align diverse datasets from scientific literature, experiments, and high-fidelity simulations.
  • Develop training pipelines for pre-training and instruction tuning on multi-GPU/TPU clusters.
  • Create new evaluation methods for cross-modal reasoning and physical consistency.
  • Collaborate with various teams to integrate multimodal embeddings into search, reasoning agents, and generative design processes.
  • Engage with the AI-for-science community through publications and contributions to major conferences.

Benefits

  • Full health, dental, and vision benefits for you and your family.
  • Personal fitness budget.
  • Unlimited PTO and all national holidays.
  • Competitive salary plus meaningful equity.
Full Job Description
The Opportunity

Designing materials and chemicals to address society's most pressing challenges will require joint reasoning across the domains of language, vision, and chemical structure. As Mirror's lead of multimodal AI, you will architect and train multimodal generative models to understand, navigate, and design within the scope of physics, chemistry, and materials science, using high-quality observational data to fuel concept discovery at scale.

Key Responsibilities
  • Design & build multimodal architectures fusing text, vision, and chemical structure.
  • Curate & align heterogeneous datasets from scientific literature, experimental data, and high-fidelity physical simulations.
  • Develop training pipelines for large-scale pre-training and instruction tuning on multi-GPU/TPU clusters
  • Create novel evaluations for cross-modal reasoning (text→structure, image→reaction pathway, etc.) and physical consistency.
  • Collaborate with AI, applied science, and engineering teams to build a product pipeline by integrating multimodal embeddings into search, reasoning agents, and generative design loops.
  • Engage with the AI-for-science community through publication and contributions at NeurIPS, ICML, ICLR, or other domain venues.

Who you are
  • Ph.D. or M.S./B.S. with equivalent research record in Computer Science, Materials Science, Chemistry, or related field with emphasis on machine learning
  • 3+ years research experience with at least two modalities (language, vision, 3-D molecules/point clouds, graphs).
  • Fluency in Python plus modern ML stacks (PyTorch/JAX) and familiarity with distributed training tooling (CUDA, NCCL, Slurm/K8s/Ray).
  • Proven track record shipping large-scale generative or contrastive models (e.g., LLMs, diffusion, VAE, CLIP, NeRF, equivariant GNNs).
  • Strong publication or open-source track record in ML for physical sciences.
  • Excellent collaboration, communication, and team-working skills.
  • Deep commitment and passion for advancing science.

Preferred Extras
  • Familiarity with quantum chemistry, atomistic simulation, or chemistry/materials science
  • Familiarity with active learning, retrieval-augmented generation, or agentic workflows for scientific automation.
  • Prior work aligning multimodal models with scientific knowledge bases or ontologies.

What We Offer
  • Competitive salary + meaningful equity
  • Full health, dental, and vision benefits for you and your family
  • Personal fitness budget
  • Unlimited PTO and all national holidays

Location & Work Model

Hybrid work available; in-office preferred. Visa sponsorship available.

Similar Jobs

More Jobs at Mirror Physics Corporation

More Consumer Technology Jobs

Find similar AI Researcher: Multimodal Understanding jobs: