Senior AI Infrastructure Engineer, LLM/AI Platforms

CrowdStrike Holdings, Inc.$140K — $215K *
US-AnywhereRemote in United States
Information Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • Bachelor's degree in Computer Science, Data Engineering, or a related STEM field; Master's degree preferred
  • 6+ years of experience in Infrastructure/Data Engineering, with at least 2 years focused on LLM systems
  • Demonstrable hands-on experience in LLM infrastructure engineering
  • Exceptional coding skills with a strong focus on delivering results
  • Thorough understanding of engineering practices
  • Demonstrates technical leadership and mentorship capabilities
  • Proven experience utilizing AI technologies for business improvement

Responsibilities

  • Provision and configure large GPU clusters for LLM workloads
  • Develop and optimize LLM model-serving infrastructure
  • Lead model lifecycle management including versioning and reproducibility
  • Design evaluation frameworks to ensure model performance and reliability
  • Identify and address GPU utilization and memory efficiency bottlenecks
  • Architect and maintain data platforms for LLMs and AI systems
  • Deliver production-ready code with emphasis on performance and maintainability
  • Define and enforce best practices for MLOps surrounding LLMs

Benefits

  • Market leader in compensation and equity awards
  • Comprehensive physical and mental wellness programs
  • Competitive vacation and holidays for recharge
  • Paid parental and adoption leaves
  • Professional development opportunities for all employees
  • Employee Networks and volunteer opportunities
  • Vibrant office culture with world-class amenities
  • Great Place to Work Certified™ across the globe
Full Job Description
About the Role:

CrowdStrike is looking for a Senior AI Infrastructure Engineer with expertise in Large Language Models (LLMs) Infrastructure and data platforms to join our growing AI Infrastructure Team. You will be a key leader, helping to design, build, and deploy cutting-edge AI infrastructure that powers our next generation of AI-driven security products. This role requires hands-on experience in LLM infrastructure to support multiple large scale training pipelines and scalable AI-powered systems. You will champion engineering best practices, write high-quality code, and actively mentor and strengthen the team's technical knowledge and capabilities.

CrowdStrike is a computer security company, but we do not require candidates for this role to have prior security industry experience. We will mentor and train in security topics as needed. We do expect a strong interest in CrowdStrike's mission and a willingness to engage with the needs of our product teams.

The scale of our systems and data are approaching Exabytes in size. Experience with extremely large-scale systems, including DevSecOps patterns, practices, and standards are important for this work.

What You'll Do:
  • Provision and configure large GPU clusters and compute resources for LLM training, finetuning, and inference workloads.
  • Develop and optimize LLM model-serving infrastructure, including deployment and optimization of various inference frameworks.
  • Lead model lifecycle management including versioning, checkpointing and reproducibility across training and inference deployments.
  • Design and champion robust evaluation frameworks to assess model performance, accuracy, and reliability, ensuring AI systems are consistently at production-ready standards.
  • Identify and address GPU utilization and GPU memory efficiency bottlenecks and apply techniques like quantization, batching, and caching.
  • Architect and maintain data platforms and pipelines specifically designed to support LLMs, Retrieval-Augmented Generation (RAG), and AI Agentic Systems at scale.
  • Deliver production-ready code with a focus on performance, maintainability, and testing rigor, ensuring the ability to ship fast without compromising quality.
  • Apply expertise in data modeling, normalization, and semantic cataloging for AI/ML workloads.
  • Define and enforce best practices for MLOps/DataOps surrounding LLMs, including monitoring, observability, and zero-touch recovery mechanisms for AI services.
  • Document architectural designs thoroughly and communicate technical decisions clearly to stakeholders
  • Collaborate across the organization with Data Scientists, Product Managers, and other engineering teams to transform research prototypes into robust, production-grade services.

Tech Stack (Experience in several areas is expected):
  • Hands-on experience with MLOps Tools (MLflow, Sagemaker, Vertex AI).
  • Strong understanding of CUDA, NVIDIA drivers, GPU, and TPU compute fundamentals.
  • Experience with inference serving frameworks such as vLLM and Triton Inference Server.
  • Proficiency with distributed training frameworks including Pytorch, Ray, Megatron, and JAX.
  • Expert-level proficiency in a high-level coding language (Python).
  • Deep knowledge of containerization and orchestration (Docker, Kubernetes, Slurm, Airflow).
  • Proficiency with Infrastructure as Code tooling like Terraform and Ansible.
  • Experience with cloud platforms (AWS, GCP, or OCI) and related data services.

What You'll Need:
  • Bachelor's degree in Computer Science, Data Engineering, or a related STEM field; Master's degree preferred
  • 6+ years of experience in Infrastructure/Data Engineering, with at least 2 years focused on building and maintaining platforms/pipelines that support LLM-based systems and applications
  • Demonstrable hands-on experience in LLM infrastructure engineering including cluster provisioning, optimizing training workloads, and maintaining inference pipelines
  • Exceptional ability to write clean, elegant, performant, and well-tested code, coupled with a strong focus on action and delivering results quickly.
  • Thorough understanding of engineering practices including effective peer code reviews and resilient architecture design
  • Demonstrates technical leadership and mentorship capabilities
  • Proven experience utilizing AI technologies to enhance decision-making, streamline workflows and processes, improve efficiency and drive business outcomes.
Bonus Points:
  • Prior experience in the cybersecurity, intelligence, or high-compliance industries.
  • Direct experience building, deploying, and managing LLMs in a production environment.
  • Experience with common agentic workflow frameworks (e.g., LangChain, LlamaIndex).
  • Experience with distributed data processing frameworks (e.g., Spark, Dask, Flink).


#LI-RC1

#LI-Remote

Benefits of Working at CrowdStrike:
  • Market leader in compensation and equity awards
  • Comprehensive physical and mental wellness programs
  • Competitive vacation and holidays for recharge
  • Paid parental and adoption leaves
  • Professional development opportunities for all employees regardless of level or role
  • Employee Networks, geographic neighborhood groups, and volunteer opportunities to build connections
  • Vibrant office culture with world class amenities
  • Great Place to Work Certified™ across the globe


CrowdStrike, Inc. is committed to fair and equitable compensation practices. Placement within the pay range is dependent on a variety of factors including, but not limited to, relevant work experience, skills, certifications, job level, supervisory status, and location. The base salary range for this position for all U.S. candidates is $140,000 - $215,000 per year, with eligibility for bonuses, equity grants and a comprehensive benefits package that includes health insurance, 401k and paid time off.

For detailed information about the U.S. benefits package, please click here.

Expected Close Date of Job Posting is:09-06-2026

About CrowdStrike Holdings, Inc.

CrowdStrike Holdings, Inc. Careers

Joining CrowdStrike Holdings, Inc. presents an unparalleled opportunity to advance a career in the tech industry with a company at the forefront of digital security. As a leader in cybersecurity solutions, CrowdStrike Holdings, Inc. offers a range of job opportunities that cater to a variety of skills and experiences, from entry-level positions to senior leadership roles.

Explore Job Opportunities

CrowdStrike Holdings, Inc. is continuously seeking talented individuals who are passionate about protecting organizations against cyber threats. With a commitment to innovation and excellence, the company is hiring professionals who are eager to contribute to a team that values hard work and creative solutions.

Innovation and Professional Growth

At CrowdStrike Holdings, Inc., employees are encouraged to push the boundaries of technology and leadership. The company supports professional growth through robust training programs, including leadership development and diversity training, ensuring that every team member has the resources to thrive in their career.

Culture and Benefits

The culture at CrowdStrike Holdings, Inc. is dynamic and inclusive, fostering a workplace where diversity is celebrated and every voice is heard. Employees enjoy comprehensive benefits that support both their professional and personal lives, enhancing job satisfaction and team morale.

Internship Programs

For those starting their career, CrowdStrike Holdings, Inc. offers internship programs that provide a rich learning environment. Interns gain hands-on experience, working alongside seasoned professionals and participating in projects that deliver real-world solutions.

Networking and Career Advancement

CrowdStrike Holdings, Inc. emphasizes the importance of networking within the industry, offering numerous opportunities for employees to connect with thought leaders and innovators. These connections can lead to career advancement and a deeper understanding of the cybersecurity landscape.

Applying for a Position

To apply for a position at CrowdStrike Holdings, Inc., candidates should prepare a resume that highlights relevant experience and skills. The interview process is designed to assess not only professional qualifications but also a candidate's fit within the company culture and team.

Stay Connected with CrowdStrike Careers

Interested candidates can stay informed about new openings and company news by subscribing to job alert emails. This personalized service ensures that potential applicants are the first to know about new opportunities that match their career interests and skills.

Join the Team

CrowdStrike Holdings, Inc. is looking for curious, creative, and solution-driven team players. Explore the employment opportunities on the CrowdStrike Holdings, Inc. careers page to find a position that matches your skills and passions.

SEARCH CROWDSTRIKE JOBS

Keep Up to Date

Stay ahead with career tips, insider perspectives, and industry-leading insights you can put to use today—all from the professionals who work at CrowdStrike Holdings, Inc.

READ CAREERS BLOG

Job Alert Emails

Customize your subscription to receive job alerts, latest news, and insider tips tailored to your preferences. Discover the exciting and rewarding career opportunities waiting at CrowdStrike Holdings, Inc.
Learn more about CrowdStrike Holdings, Inc.

Similar Jobs

More Jobs at CrowdStrike Holdings, Inc.

More Information Technology Jobs

Find similar Senior AI Infrastructure Engineer, LLM/AI Platforms jobs: