5+ years of experience in software engineering with a focus on AI and multimodal applications
Proficiency in Python, PyTorch, JAX, Rust, or C++ for production-quality code
Experience with image/video understanding and generation techniques
Familiarity with audio processing as it relates to video content
Strong analytical skills for data-driven experiment design and model debugging
Responsibilities
Drive engineering agendas to enhance multimodal capabilities in image and video generation
Improve data quality through various enhancement techniques for visual and audio data
Design evaluation frameworks and metrics for assessing image/video/audio quality
Implement algorithms for real-time inference and scalable serving of visual content
Develop data collection and processing pipelines for multimodal datasets
Collaborate with product teams to integrate AI solutions and iterate based on user feedback
Benefits
Equity options as part of the compensation package
Comprehensive medical, vision, and dental coverage
Access to a 401(k) retirement plan
Short & long-term disability insurance
Life insurance and various discounts and perks
Full Job Description
SR. MODEL ENGINEER, IMAGINE
As a multimodal engineer on the Imagine Model Team, you will develop cutting-edge AI experiences beyond text, with a strong focus on enabling high-fidelity understanding and generation across image and video modalities, while also incorporating audio where it enhances visual content (e.g., synchronized audio for video). Responsibilities span data curation, modeling, training, inference serving, and product integration, covering both pre-training and post-training phases. You will collaborate closely with product teams to push model frontiers and deliver exceptional end-to-end user experiences. RESPONSIBILITIES:
Create and drive engineering agendas to advance multimodal capabilities, with emphasis on image and video generation, editing, understanding, controllable/long-horizon synthesis, agentic planning, RL training, and world simulation (including audio integration for richer video experiences)
Improve data quality through annotation, filtering, augmentation, synthetic generation, captioning, and in-depth data studies, particularly for visual and audio data
Design evaluation frameworks, metrics, benchmarks, evals, and reward models tailored to image/video/audio quality and coherence
Implement efficient algorithms for state-of-the-art model performance, including real-time inference, distillation, and scalable serving for visual content
Develop scalable data collection and processing pipelines for multimodal (primarily image/video-focused) datasets
Collaborate cross-functionally to integrate AI solutions into production and rapidly iterate based on user feedback
BASIC QUALIFICATIONS:
Experience writing production-quality code in Python, PyTorch, JAX, Rust, or C++
Experience in multimodal applications such as graphics engines, rendering techniques, image/video understanding and generation, world models, real-time simulation, or controllable/long-horizon visual content creation
PREFERRED SKILLS AND EXPERIENCE:
Experience in audio/speech processing or music/audio generation experience is a plus where it supports video
Experience in data-driven experiment designs, systematic analysis, and iterative model debugging
Experience developing or working with large-scale distributed machine learning systems
Experience with leading studies that significantly improve neural network capabilities and performance through better data or modeling
Ability to deliver optimal end-to-end user experiences
Hands-on contributor with initiative, excellence, strong work ethic, prioritization skills, and excellent communication
Experience in SFT, RL, evals, human/synthetic data collection, or agentic systems
Proficiency in Python, JAX/XLA, PyTorch, Rust/C++, Spark, Ray, and related large-scale frameworks
Experience with agentic RL training, controllable/long-horizon generation, or multimodal agents that reason and act across modalities (especially in visual domains)
COMPENSATION AND BENEFITS:
$220,000 - $357,000 USD
Base salary is just one part of our total rewards package at SpaceXSI, which also includes equity, comprehensive medical, vision, and dental coverage, access to a 401(k) retirement plan, short & long-term disability insurance, life insurance, and various other discounts and perks.
