Research Scientist, Multi-Modal

Meta

$90K — $130K *
Information Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • Bachelor's degree in Computer Science or related field, or equivalent experience required
  • PhD in Computer Science, Machine Learning or relevant technical field, must be completed prior to joining
  • Experience with multi-modal learning integrating vision, audio, and language
  • Proficiency in PyTorch or TensorFlow
  • Familiarity with transformer architectures and large-scale model training
  • Strong knowledge of machine learning, deep learning, and statistical modeling
  • Required work authorization for the country of employment during the hiring process

Responsibilities

  • Develop and enhance multi-modal models integrating vision, language, and audio
  • Research innovative architectures for cross-modal reasoning and understanding
  • Design and prototype interactive AI experiences
  • Collaborate with teams to advance the research pipeline including hardware and software development
  • Publish findings at top-tier conferences and contribute to the research community

Benefits

  • Opportunities to collaborate with top-tier research scientists and engineers
  • Access to a fast-paced multidisciplinary work environment
  • Potential for significant contributions to the broader AI research community
  • Exposure to cutting-edge technology and innovative projects
  • Possibilities for publication and dissemination of research findings
Full Job Description
You will work on developing models that reason across vision, language, and other modalities to enable richer AI experiences across Meta's family of apps and products. You will collaborate with research scientists, software engineers, and data scientists to design technical solutions in a fast-paced multidisciplinary environment.

Responsibilities

Develop and advance multi-modal models that integrate vision, language, audio, and other modalities
• Research novel architectures and training methods for cross-modal reasoning and understanding
• Design and prototype interactive experiences that leverage multi-modal AI capabilities
• Collaborate across teams to develop concepts that advance the entire research pipeline (hardware, software, data collection, machine learning, etc.)
• Publish research findings at top-tier conferences and contribute to the broader research community

Minimum Qualifications
• Currently has, or is in the process of obtaining a Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience. Degree must be completed prior to joining Meta
• Currently has, or is in the process of obtaining, a PhD degree in Computer Science, Machine Learning, or relevant technical field. Degree must be completed prior to joining Meta
• Experience in multi-modal learning, combining vision, audio, language, or related areas
• Experience working with PyTorch or TensorFlow
• Experience with transformer architectures and large-scale model training
• Technical knowledge across machine learning, deep learning, and statistical modeling
• Must obtain work authorization in country of employment at the time of hire, and maintain ongoing work authorization during employment

Preferred Qualifications
• First-authored publications at leading conferences such as NeurIPS, ICML, and CVPR, or similar
• Experience with large language models (LLMs) and their integration with other modalities
• Experience transferring multi-modal research into shipping products
• Experience working and communicating cross-functionally in a team environment
• Research experience in vision-language models, multi-modal transformers, or cross-modal representation learning

Similar Jobs

More Jobs at Meta

More Information Technology Jobs

Find similar Research Scientist, Multi-Modal jobs: