Please Note:To provide the best candidate experience amidst our high application volumes, each candidate is limited to 10 applications across all open jobs within a 6-month period.
What You'll DoThe successful candidate will lead pioneering research on next-generation memory-centric AI system architectures. This role entails the end-to-end co-design of AI workloads, system-level modeling, and hardware platforms. The objective is to develop high-performance AI systems that utilize Samsung's advanced memory solutions and technologies to eliminate bottlenecks related to memory capacity, bandwidth, and interconnect.
Location: Daily onsite presence at our San Jose Headquarters in alignment with our Flexible Work policy
Research & Innovation Management- Define the research vision and strategy for memory-centric AI systems, aligned with Samsung's memory technology roadmap.
- Deliver strategic architectural recommendations to senior leadership and external partners.
- Manage multidisciplinary research teams, including AI system architects and CPU architects, and technical roadmaps to ensure high-impact publication and patent output.
- Build and scale a world-class research organization by recruiting, developing, and retaining top talent.
- Drive strategic partnerships with leading hyperscalers and academic institutions.
AI System Architecture Leadership- Collaborate with SAIT HQ teams to ensure modeling insights are effectively integrated into real-world AI system implementations.
- Establish system-level architectures designed to overcome memory capacity, bandwidth, and interconnect bottlenecks for large-scale AI workloads, including LLMs and recommendation systems.
- Direct rack-scale performance modeling, simulation, and design-space exploration to inform strategic architectural decisions across performance, power, and cost.
- Spearhead architecture path-finding for large-scale AI training and inference, focused on throughput, latency, and energy efficiency.
- Oversee system architecture specifications, including memory hierarchy design, to optimize AI workload execution.
What You BringEducation: Ph.D. in Computer Science, Electrical Engineering, or a related field.
Experience: 10+ years in system-level architecture research or large-scale computing platform design, with a strong focus on AI workloads.
10+ years of experience leading, building and managing high performing Engineering teams
Technical Expertise Required:
- Proven track record of designing system-level architectures for large-scale AI inference, from node up to rack or cluster scale, with a strong understanding of memory, networking, accelerators, and AI models.
- Comprehensive understanding of modern AI accelerator and system architectures (GPU, NPU, TPU) and heterogeneous integration strategies (CPU ISA knowledge is a plus).
Communication Skills: Excellent written and verbal communication; proven ability to deliver technical presentations to senior stakeholders.
Preferred Experience- Strong background in performance modeling and quantitative analysis of compute-memory-interconnect systems to inform architectural decisions (e.g., large-scale design-space exploration and PPA trade-off studies).
- Deep understanding of AI models (e.g., LLMs, MoE, recommendation models), with experience driving HW/SW co-design and HW-aware model optimization.
- Understanding of the inference serving and training software stack, with experience optimizing inference serving performance across multiple devices.
- Proven track record of publishing high-impact research papers (e.g., NeurIPS, ICML, MLSys, ISCA, MICRO, HPCA).
- Strong collaborative history with cross-functional teams (hardware, software, memory technology).
- Experience working in global, multi-geographic environments (e.g., U.S.-based or international technology companies), with proven effectiveness in cross-cultural collaboration across geographies and time zones.
#LI-SF1
What We OfferThe pay range below is for all roles at this level across all US locations and functions. Pay within this range varies by work location and may also depend on job-related knowledge, skills, and experience. We also offer incentive opportunities that reward employees based on individual and company performance.
This is in addition to our diverse package of benefits centered around the wellbeing of our employees and their loved ones. In addition to the usual Medical/Dental/Vision/401k, our inclusive rewards plan empowers our people to care for their whole selves. An investment in your future is an investment in ours.
Give Back With a charitable giving match and frequent opportunities to get involved, we take an active role in supporting the community.
Enjoy Time Away You'll start with 4+ weeks of paid time off a year, plus holidays and sick leave, to rest and recharge.
Care for Family Whatever family means to you, we want to support you along the way-including a stipend for fertility care or adoption, caregiver support, and medical travel support.
Prioritize Emotional Wellness With on-demand apps and free confidential therapy sessions, you'll have support no matter where you are.
Stay Fit Eating well and being active are important parts of a healthy life. Our onsite Café and gym, plus virtual classes, make it easier.
Embrace Flexibility Benefits are best when you have the space to use them. That's why we facilitate a flexible environment so you can find the right balance for you.
Base Pay Range
$350,000-$500,000 USD