OpenAI

Machine Learning Engineer, Multimodal Perception and Authentication

OpenAI$150K — $180K *
Consumer Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • Strong background in computer vision, audio/speech machine learning, or multimodal learning.
  • Experience developing specialized and larger multimodal machine learning models.
  • Proven ability to translate research ideas into practical prototypes or products.
  • Skilled in designing experiments and evaluating model performance.
  • Familiarity with sensing hardware and real-time system constraints.
  • Proficient in Python and PyTorch; knowledge of C++ or systems integration is a plus.
  • Experience with authentication, biometrics, or privacy-sensitive applications.

Responsibilities

  • Research and develop multimodal perception and authentication methods using various sensing signals.
  • Explore collaboration between specialized perception models and larger multimodal models.
  • Design experiments, training, and evaluation strategies to enhance real-world performance.
  • Study model behavior, robustness, and failure modes across different environments.
  • Integrate and validate new capabilities in real-time, resource-constrained systems.
  • Collaborate with cross-functional teams, including hardware and software, to implement research into applications.

Benefits

  • Relocation assistance provided for candidates moving to San Francisco.
  • In-office work environment three days per week.
Full Job Description
About the Role

We're looking for a machine learning engineer to help shape how future AI systems understand the physical world and the people in it. The role focuses on multimodal perception and authentication, bringing together signals from cameras, microphones, and other sensors.

You'll work with specialized perception models and larger multimodal models, and partner with hardware, firmware, software, and product teams to bring new research into real-world systems.

This role is based in San Francisco. We work in the office three days per week and offer relocation assistance.

In this role, you will:
  • Research and develop multimodal perception and authentication methods across visual, audio, and other sensing signals.
  • Explore how specialized perception models and larger multimodal models can work together.
  • Design data, training, and evaluation approaches that improve performance in real-world conditions.
  • Study model behavior, robustness, and failure modes across sensing, data, and deployment environments.
  • Integrate and validate new capabilities in real-time or resource-constrained systems.
  • Work with hardware, firmware, software, and product teams to turn research into working systems.


You might thrive in this role if you:
  • Have a strong background in computer vision, audio or speech machine learning, multimodal learning, or sensing.
  • Have experience developing specialized machine learning models, larger multimodal models, or both.
  • Have brought research ideas into practical systems, prototypes, or products.
  • Know how to design experiments, build evaluations, and investigate model behavior.
  • Have worked with sensing hardware, real-time systems, or other deployment constraints.
  • Are proficient in Python and PyTorch and comfortable with C++ or systems integration.
  • Have experience with authentication, biometrics, or other privacy-sensitive applications.
  • Enjoy working across disciplines on research problems that are still taking shape.


About OpenAI

OpenAI is an artificial intelligence research laboratory consisting of the for-profit corporation OpenAI LP and its parent company, the non-profit OpenAI Inc. The company was founded in 2015 by a group of technology leaders, including Elon Musk, Sam Altman, Greg Brockman, Ilya Sutskever, and John Schulman. OpenAI's mission is to develop and promote friendly AI for the betterment of humanity. The company has developed a number of cutting-edge AI technologies, including GPT-3, a language processing system that can generate human-like text. OpenAI has received funding from a number of high-profile investors, including LinkedIn co-founder Reid Hoffman and venture capitalist Peter Thiel.
Learn more about OpenAI
Size
100 employees
Industry
Founded
2015

Similar Jobs

More Jobs at OpenAI

More Consumer Technology Jobs

Find similar Machine Learning Engineer, Multimodal Perception and Authentication jobs: