PhD or equivalent experience with a strong research track record in LLMs, evidenced by publications or open-source contributions.
Depth in reinforcement learning, quantization, or attention/architecture, particularly long-context methods.
Experience in ML-hardware co-design and optimization for inference/training is a plus.
Excellent software engineering skills, particularly in distributed training/inference codebases.
Proven ability to collaborate across teams for validation and experimentation.
Responsibilities
Train and optimize large language models (LLMs) for hardware.
Conduct quality evaluations to ensure model performance.
Build and set up distributed infrastructure for training and inference.
Advise on hardware architecture from a machine learning perspective.
Co-design hardware through ML experimentation and RTL prototypes.
Collaborate with other teams to validate numerical outputs.
Benefits
Cash/equity mix with options for early exercise.
Company-subsidized health, dental, vision, and life insurance.
4 weeks paid time off, 12 company holidays, and 3 weeks of remote work per year.
Up to 12 weeks of paid parental leave, regardless of path to parenthood.
$1,500 yearly budget for professional development.
Team lunches and quarterly off-sites for team bonding.
401K with a 5% company contribution, even if you don't contribute.
Pre-tax spending accounts for various expenses.
Commute reimbursement for rideshare or public transport.
$50 monthly allowance for personal perks.
Remote work support including home-tech setup and wifi reimbursement.
Full Job Description
What You'll Do Here
Train and optimize LLMs for our hardware
Run quality evaluations
Build and set up distributed infrastructure for training and inference
Advise on the hardware architecture from an ML perspective
Co-design hardware through ML experimentation and RTL prototypes
Work with other teams to validate numerics
Who you Are
A strong research track record in LLMs (PhD or equivalent experience), demonstrated through publications and/or shipped, open-sourced research. Depth in at least one of: reinforcement learning, quantization or attention/architecture (including long-context methods). Related experience in inference/training optimization, ML-hardware co-design, evals is a plus
Excellent software engineering skills, including building and scaling distributed training/inference codebases
Compensation
The US base salary for this full-time position is determined based on a variety of factors including role, experience, location, job related skills, and relevant education and training. Career length is only a guideline for compensation.
Early Career - $160,000 - $300,000 + equity
Mid Career - $180,000 - $425,000 + equity
Senior Career - $250,000 - $800,000 + equity
What We Offer
A Stake in our success A cash/equity mix that fits your needs and option to do early exercise
Health & Wellness Company subsidized Health, Dental, Vision, and Life insurance; Pre-tax Health Savings Accounts with generous company contribution (even if you don't)
Time To Recharge 4 weeks paid time off (accrued), 12 company holidays, and 3 weeks remote/flexible work per year
Support to Parents Up to 12 weeks of paid parental leave, regardless of your path to parenthood
Learning & Development $1,500 yearly towards your professional development e.g. conferences, courses, and other learning opportunities
Team Connection Team Lunches, quarterly off-sites, and regular town halls
Financial Wellbeing 401K and/or Roth IRA, with 5% company contribution, even if you don't!
Flexible Spending Accounts Pre-tax spend accounts for medical, dental/vision, dependent care, parking, and transit expenses
Commute On Us For those commuting up to 1 hour, put your rideshare cost on our company card and reclaim the drive-time to get work done!
MatX E[x]tras $50 per month to use on the perks you care about most
Remote Perks We work remotely Monday & Friday, supported by home-tech setup, and remote wifi expense reimbursement
What We Offer
Time off: 4 weeks PTO (accrued) + 12 company Holidays + up to 3 weeks remote work
Health: Company-subsidized Medical (Kaiser or Anthem) for employees & dependents, Guardian Dental and Vision insurances for employee & dependents, and life insurance (employee only), plus HSA and FSA offerings via Lively.
Financial Security: Choose from Roth or pre-tax 401K (or both) with a 5% company contribution (even if you don't contribute), 100% company-paid life insurance (up to $300K), long-term disability and travel insurance.
Professional Development: $1500 per year Professional Development Budget
Team Meals: MatX provides onsite team lunch & dinner Monday - Friday, with your choice of ordering via WeBox, Specialty's or via our reimbursement system
Commute on Us: We pay 100% for your daily commute. Commute via our company rideshare account, reimburse public transportation, or get a Fasttrak card (or all three)
MatX E[x]tras: $50/mo to use on the perk you value most
Cell & Internet Reimbursement: $35/mo for cellular and $40/mo for wifi
Remote Home Setup: Use our Amazon business account for up to $1000 in office setup purchases.
Mental Wellbeing: 100% paid mental health benefit via SpringHealth and Guardian EAP.
Support to Parents: Up to 12 weeks paid parental leave regardless of path to parenthood, 10 weeks pregnancy disability leave, flexible return-to-work hours, and a $6K Family Fund to cover fertility, surrogacy, adoption, menopausal health, preservation, family counseling and more.
