What You'll Do Here- Design and optimize kernels that interface directly with our hardware
- Work in partnership with our ML Research and Hardware Engineering teams
- Provide expertise and guidance on hardware architecture from a programmer's perspective, ensuring seamless integration with the software stack
Who You Are- Bachelor of Computer Science or equivalent degree
- Experience optimizing software for specialized hardware, employing techniques such as parallelism, SIMD programming, C, assembly-level optimization, or GPU/CUDA programming
- Language: at least one of assembly, C++, C, Zig, or Rust
- This is a hybrid role that will require you to work from our Mountain View, CA office 3 days a week on Tuesday through Thursday
Bonus Points If You Have- Experience implementing kernels for ML models such as Transformers
- Experience using and implementing distributed parallelism techniques such as AllReduce, AllToAll, data parallelism, tensor parallelism.
- Familiarity with how compilers work
CompensationThe US base salary for this full-time position is determined based on a variety of factors including role, experience, location, job related skills, and relevant education and training. Career length is only a guideline for compensation.
- Early Career - $120,000 - $275,000 + equity
- Mid Career - $175,000 - $400,000 + equity
- Senior Career - $250,000 - $600,000 + equity
What We Offer- A Stake in our success A flexible cash equity compensation mix that fits your needs
- Health & Wellness Company subsidized Health, Dental, Vision, and Life insurance; Pre-tax Health Savings Accounts with generous company contribution (even if you don't)
- Time To Recharge 4 weeks paid time off (accrued), 12 company holidays, and 3 weeks remote/flexible work per year
- Support to Parents Up to 12 weeks of paid parental leave, regardless of your path to parenthood
- Learning & Development $1,500 yearly towards your professional development e.g. conferences, courses, and other learning opportunities
- Team Connection Team Lunches, quarterly off-sites, and regular town halls
- Financial Wellbeing 401K and/or Roth IRA, with 5% company contribution, even if you don't!
- Flexible Spending Accounts Pre-tax spend accounts for medical, dental/vision, dependent care, parking, and transit expenses
- Commute On Us For those commuting up to 1 hour, put your rideshare cost on our company card and reclaim the drive-time to get work done!
- MatX E[x]tras $50 per month to use on the perks you care about most
- Remote Perks We work remotely Monday & Friday, supported by home-tech setup, and remote wifi expense reimbursement
