Silicon Architect, AI Accelerator

MatX

$120K — $500K+*
Enterprise Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • Strong background in computer architecture, particularly in AI accelerators like GPUs and TPUs.
  • Experience in translating AI workloads into hardware architecture.
  • Solid foundations in microarchitecture principles.
  • Understanding of performance metrics like latency, throughput, and scalability.
  • Familiarity with numeric formats and their tradeoffs in AI performance.
  • Experience with programming and performance analysis at kernel level.
  • Strong written and verbal communication skills.

Responsibilities

  • Define the architecture for MatX's AI compute subsystem including ISA and control.
  • Derive architectural requirements from specific AI use cases.
  • Conduct performance analysis using both analytical and empirical methods.
  • Collaborate with cross-functional teams in hardware and software for optimal silicon architecture.
  • Evaluate tradeoffs in power, area, and performance with various stakeholders.
  • Support test plan reviews and first-silicon debugging activities.

Benefits

  • 4 weeks PTO plus 12 company holidays and up to 3 weeks remote work.
  • Company-subsidized health insurance for employees and dependents, including dental and vision.
  • Retirement plans with company contributions, alongside company-paid life and disability insurance.
  • Annual professional development budget of $1500.
  • On-site meals provided Monday through Friday.
  • Commuting costs covered by the company.
  • Monthly stipend for personal perks, alongside reimbursements for cell and internet costs.
  • 100% funded mental health benefits available via SpringHealth.
  • Comprehensive parental support including paid leave and flexible work hours.
  • Access to significant AI resources and support from an internal tooling team.
Full Job Description
What MatX Is Building

MatX designs hardware tailored for the world's best AI models. Our hardware will make a given level of intelligence available 3-5 years sooner. We are developing vertically integrated full-stack solutions from silicon to systems including hardware and software to train and run the world's largest models. MatX is seeking an Architect to join our team as we create best-in-class silicon for high-performance and sustainable GenAI. The successful candidate for this role will be responsible for delivering performant silicon architecture at the full-chip or subsystem level.

MatX is seeking an AI Accelerator Compute Architect to help define the compute architecture for our next-generation GenAI accelerators.

What You'll Do
  • Define the architecture for MatX's AI compute subsystem, including ISA, connectivity, memories, and control..
  • Derive architectural requirements from AI use cases.
  • Conduct analytical and empirical performance analysis.
  • Collaborate closely with Research, SW, and HW teams to ensure we architect just-right silicon for workloads, programmability, and PPA.
  • Work through power, area, performance tradeoffs with stakeholders.
  • Support test plan reviews, first-silicon bring-up, and post-silicon debug.
Who You Are
  • Strong background in computer architecture, especially AI accelerators, GPUs, TPUs, vector processors, SIMD, VLIW, or other parallel compute architectures.
  • Experience translating workloads into hardware architecture.
  • Solid microarchitecture fundamentals.
  • First-principles understanding of latency, throughput, utilization, and scalability.
  • Familiarity with numeric formats, quantization, rounding, and precision/performance tradeoffs.
  • Programming, code optimization, or kernel-level performance analysis experience.
  • Excellent written and verbal communication skills.
  • Familiarity with performance-optimization techniques in large-scale transformer models is a plus.
Work Location

This is a hybrid role based in our Mountain View, CA office, with in-office work Tuesday through Thursday. In exceptional cases, remote work arrangements may be considered.
Compensation

The US base salary for this full-time position is determined based on a variety of factors including role, experience, location, job related skills, and relevant education and training. Career length is only a guideline for compensation.
  • Early Career - $120,000 - $275,000 + equity
  • Mid Career - $175,000 - $450,000 + equity
  • Senior Career - $275,000 - $600,000 + equity

What We Offer
  • Time off: 4 weeks PTO (accrued) + 12 company Holidays + up to 3 weeks remote work
  • Health: Company-subsidized Medical (Kaiser or Anthem) for employees & dependents, Guardian Dental and Vision insurances for employee & dependents, and life insurance (employee only), plus HSA and FSA offerings via Lively.
  • Financial Wellbeing: Choose from Roth IRA/ 401K (or both) retirement plans with up to 5% company contribution to 401K (even if you don't contribute). Also, 100% company-paid life insurance (up to $300K) and long-term disability insurances.
  • Professional Development: $1500 Professional Development Budget (per year)
  • Team Meals: MatX provides onsite team lunch & dinner Monday - Friday, with your choice of ordering via WeBox, Specialty's or via our reimbursement system
  • Commute on Us: Commute on our company Uber account, or reimburse your train rides. Either way, we pay 100% for your daily commute.
  • MatX E[x]tras: $50/mo to use on the perk you value most
  • Cell & Internet Reimbursement: $35/mo for cellular and $40/mo for wifi
  • Mental Wellbeing: 100% paid mental health benefit via SpringHealth and Guardian EAP.
  • Support to Parents: Up to 12 weeks paid parental leave regardless of path to parenthood, 10 weeks pregnancy disability leave, flexible return-to-work hours, and Benepass reproductive health & parental benefit.
  • AI Resources: Up to $20K/month plus a dedicated internal AI Tooling Team to support your productivity

Similar Jobs

More Jobs at MatX

  • Controller
    $220K — $300K *
    Mountain View, CA 94040 (Santa Clara County)
    Manufacturing & Automotive
    In-Person
  • Silicon Validation Engineer
    $160K — $500K+*
    Mountain View, CA 94040 (Santa Clara County)
    Telecommunications & Hardware
    In-Person
  • Power Architect
    $120K — $500K+*
    Mountain View, CA 94040 (Santa Clara County)
    Enterprise Technology
    In-Person
  • Lead Software Engineer, Kernels
    $250K — $500K+*
    Mountain View, CA 94040 (Santa Clara County)
    Enterprise Technology
    In-Person
  • AI Silicon Architect
    $120K — $500K+*
    Mountain View, CA 94040 (Santa Clara County)
    Enterprise Technology
    In-Person

More Enterprise Technology Jobs

Find similar Silicon Architect, AI Accelerator jobs: