Experience writing production-quality code in Python, PyTorch, JAX, Rust, or C++
Experience training large models with 1B+ parameters
Familiarity with scaling laws
Strong ability to design ML experiments
Experience with large-scale data processing frameworks like Spark and Ray
Responsibilities
Scale synthetic coding data to trillions of tokens using large-scale docker verification
Distill flagship model intelligence into flash models through synthetic data generation
Optimize mid-training data mixtures to enhance reinforcement learning performance
Engineer long-context data recipes for improved model training
Develop robust evaluations for mid-training checkpoints
Benefits
Equity in the company
Comprehensive medical, vision, and dental coverage
Access to a 401(k) retirement plan
Short & long-term disability insurance
Life insurance
Various discounts and perks
Full Job Description
RESPONSIBILITIES:
Scale synthetic coding data to trillions of tokens with large-scale docker verification
Distill the intelligence of flagship models into flash models through synthetic data generation
Optimize mid-training data mixtures to boost the ceiling for RL
Engineer long-context data recipes
Develop robust and diverse evaluation for mid-training checkpoints
BASIC QUALIFICATIONS:
Experience writing production-quality code in Python, PyTorch, JAX, Rust, or C++
Experience training large models (e.g., pre-training, post-training, fine-tuning, or RL training of neural networks with 1B+ parameters)
PREFERRED SKILLS AND EXPERIENCE:
Familiarity across all kinds of scaling laws
Strong ability to design ML experiments
Familiarity with state-of-the-art techniques for curating AI training data for text, image, audio, and video modalities
Strong engineering abilities in large-scale data processing frameworks
Experience with ML and large model scaling
Experience with Spark, Ray, and other large-scale data processing frameworks
COMPENSATION AND BENEFITS:
$180,000 - $440,000 USD
Base salary is just one part of our total rewards package at SpaceXSI, which also includes equity, comprehensive medical, vision, and dental coverage, access to a 401(k) retirement plan, short & long-term disability insurance, life insurance, and various other discounts and perks.
