Micron Technology

Member of Technical Staff, AI Engineering

Micron Technology • $130K — $180K *
Boise, ID 83709In-Person
Information Technology
5 - 7 years of experience
Reposted Today
Be an Early Applicant
Job Overview by Ladders

Qualifications

  • Technical Degree required; Ph.D. in Computer Science or Statistics preferred.
  • 5+ years in performance optimization/parallel computing/low-level systems.
  • Deep expertise in C++ and GPGPU frameworks (CUDA preferred).
  • Hands-on experience with DDP, FSDP, and building end-to-end ML systems.
  • Proficiency with large language models (LLMs) and fine-tuning techniques.
  • Strong programming skills in Python or Java, with experience in CI/CD and cloud tools.

Responsibilities

  • Architect and complete large-scale custom model training on multi-node, multi-GPU clusters.
  • Optimize training throughput and memory efficiency with distributed training strategies.
  • Design and develop autonomous AI Agents for manufacturing workflow automation.
  • Analyze and profile workloads to identify computing and memory bottlenecks.
  • Write and optimize high-performance kernels to leverage hardware capabilities.
  • Collaborate with Hardware Architects on next-generation GPU features.
  • Mentor junior engineers on parallel programming and optimization techniques.

Benefits

  • Choice of medical, dental, and vision plans to meet healthcare needs.
  • Income protection programs for illness or injury-related work absences.
  • Paid family leave to support personal needs.
  • Robust paid time off program and paid holidays.
Full Job Description
This role is critical to how we train, optimize, and deploy large-scale AI systems on modern GPU platforms. As a GPU Performance Engineer, you will push the limits of multi-GPU and distributed training, shape next-generation AI workloads, and partner closely with data scientists, engineers, and hardware architects. Your work will directly influence performance, cost, and speed across Micron's AI-powered manufacturing stack.

Responsibilities:
  • Architect and complete large-scale custom model training and fine-tuning jobs (SFT, RLHF) on multi-node, multi-GPU clusters.
  • Optimize training throughput and memory efficiency using distributed training strategies (FSDP, DeepSpeed, Megatron-LM) and mixed-precision techniques (FP16/BF16).
  • Design and develop autonomous AI Agents capable of multi-step reasoning, planning, and tool execution to automate complex manufacturing workflows.
  • Analyze and profile complex workloads (e.g., LLM training, Rendering pipelines) to identify bottlenecks in compute, memory bandwidth, and latency.
  • Write and optimize high-performance kernels using CUDA, HIP, or custom assembly (PTX/SASS) to unlock hardware capabilities.
  • Collaborate with Hardware Architects to define features for next-generation GPUs based on workload characterization.
  • Design and implement performance regression testing suites to catch degradations in drivers or compilers.
  • Mentor engineers who are developing skills in parallel programming paradigms and optimization techniques.


Minimum Qualifications:

  • 10+ years of experience with deep expertise in GPU architecture (memory hierarchy, tensor cores, NVLink) and GPU resource management across cloud and on-prem environments, along with 5+ years in performance optimization, parallel computing, and low-level systems using C++ and GPGPU frameworks (CUDA preferred; HIP/OpenCL/Metal acceptable).
  • Strong hands-on experience building scalable ML systems, including distributed training (DDP, FSDP), model parallelism, and end-to-end automation of training, testing, and deployment workflows.
  • Deep proficiency in LLMs, including prompt engineering, tool/function calling, chain-of-thought reasoning, fine-tuning with PEFT methods (LoRA, QLoRA), and inference optimization using engines like vLLM and TensorRT-LLM.
  • Experience developing GenAI applications and AI agents using frameworks such as LangChain, LangGraph, LlamaIndex, and AutoGen, with strong knowledge of ML frameworks (PyTorch required; TensorFlow/scikit-learn a plus).
  • Strong programming in Python (preferred) or Java, with experience in CI/CD and cloud-native tools (Git, Jenkins, Docker, Kubernetes); excellent communication skills, fast-paced delivery mentality, and a Bachelor's or Master's degree in Computer Science, Statistics, or a related field.


Preferred Qualifications:

  • Ph.D. in Computer Science, Statistics, or related field (or equivalent experience), with strong foundations in mathematics, probability, statistics, and algorithms.
  • Experience with HPC job schedulers (e.g., Slurm) and orchestrating large-scale GPU workloads on Kubernetes using tools such as Ray and Kubeflow.
  • Strong expertise in CUDA programming, Triton kernels, and developing custom C++ extensions for PyTorch to optimize and accelerate workloads.
  • Experience designing and coordinating multi-agent systems, including collaboration between specialized agents in complex architectures.
  • Proven ability to productionize data science solutions, with experience in computer vision and/or signal processing for classification and feature extraction.


As a world leader in the semiconductor industry, Micron is dedicated to your personal wellbeing and professional growth. Micron benefits are designed to help you stay well, provide peace of mind and help you prepare for the future. We offer a choice of medical, dental and vision plans in all locations enabling team members to select the plans that best meet their family healthcare needs and budget. Micron also provides benefit programs that help protect your income if you are unable to work due to illness or injury, and paid family leave. Additionally, Micron benefits include a robust paid time-off program and paid holidays. For additional information regarding the Benefit programs available, please see the Benefits Guide posted on micron.com/careers/benefits.

To learn more about Micron, please visit micron.com/careers

About Micron Technology

Micron Technology Careers

Join the vibrant team at Micron Technology, a leader in memory and storage solutions, and propel your career into the future of technology. At Micron, we are committed to fostering a culture of diversity and innovation, offering a range of job opportunities that encourage professional growth and leadership development.

Work You’ll Do

At Micron Technology, you will collaborate with some of the brightest minds in the industry, working on groundbreaking projects that redefine how the world uses information to enrich life. Our team is dedicated to leading through a unique position in the marketplace, at the intersection of technology, industry expertise, and digital innovation.

Explore Micron Technology’s Career Opportunities

Whether you are looking for an internship, a full-time position, or a leadership role, Micron offers a path to personal and professional growth. We are hiring across multiple disciplines, seeking passionate, curious, and innovative team players.

Innovative Work

Join our global team of professionals and be part of a company that values innovation and leadership. Micron provides targeted solutions and technologies that are integral to advancing how the world works, learns, and plays.

Be Part of a Great Team

Experience Micron’s inclusive culture where we value diversity and provide extensive benefits to ensure the well-being of all our team members. Engage in networking opportunities within the company to expand your skills and advance your career.

Future-Proof Your Career

Micron is dedicated to your career development, offering unmatched training, development programs, and certification support to help you reach your goals. Our commitment to innovation and leadership in the memory and storage industry ensures that your work at Micron is not just a job, but a pathway to future opportunities.

Stay Connected

Join Our Team

Search open positions that match your skills and interests. We look for driven, creative, and solution-oriented individuals. Explore the vast array of job opportunities at Micron Technology today.

Keep Up to Date

Stay ahead with career tips, insider perspectives, and industry-leading insights you can put to use today—all from the people who work at Micron.

Job Alert Emails

Customize your subscription to receive job alerts, the latest news, and insider tips tailored to your preferences. Discover the exciting and rewarding career opportunities waiting for you at Micron Technology. Micron Technology is not just a company—it’s a community of leaders and innovators eager to make an impact in the global landscape. Join us and be a part of shaping the future of technology.
Learn more about Micron Technology
Size
43,000 employees
Market Cap
$53.7 billion
Industry
Manufacturing & Automotive
Net Income
$2.9 billion
Founded
1978
5 Year Trend
+8.6%
Revenue
$22 billion
NASDAQ
MU
* Ladders Estimates

Similar Jobs

Ad banner background

Get Ready For Your
Next Interview

More Jobs at Micron Technology

More Information Technology Jobs

Find similar Member of Technical Staff, AI Engineering jobs:

NationwideBoise, ID