Software Engineer Manager - ML Infra

Meta

$175K — $210K *
Information Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • 3+ years of experience managing high-performing software engineering teams
  • Technical expertise in AI/ML systems, distributed systems, or GPU/accelerator model optimization
  • Ability to dive deep into technical work and influence decisions
  • Experience in mentoring engineers and supporting their career development
  • Strong skills in communicating technical strategies to diverse stakeholders

Responsibilities

  • Build and retain a high-performing engineering team through mentorship and performance management
  • Engage in technical leadership through architecture decisions and design reviews
  • Drive complex hardware-software co-design projects and manage timelines
  • Collaborate with cross-functional teams including AI Infra, Hardware Engineering, and Product management
  • Represent the engineering team to leadership and ensure alignment on project goals

Benefits

  • Opportunity to lead innovative AI initiatives at scale
  • Collaborative environment with cross-functional teams
  • Focus on professional development and team engagement
  • Exposure to cutting-edge technologies in AI and hardware architecture
  • Emphasis on responsible and ethical AI practices
Full Job Description
Lead a team at the intersection of AI, distributed systems, and hardware architecture. The role drives ML model efficiency and scale, infrastructure costs, and enables next-generation AI capabilities. Directly supporting Meta's ability to train and serve AI models at scale.

Responsibilities

People Leadership: Build/retain an engineering team; provide coaching, mentorship, and performance management
• Technical Leadership: Engage in design reviews, architecture decisions, and technical trade-offs; define technical vision with Tech Leads
• Execution: Drive complex hardware-software co-design projects to completion; manage roadmaps, timelines, and risk mitigation
• Cross-Functional Partnership: Collaborate with AI Infra, Hardware Engineering, Product, and Research; represent the team to leadership

Minimum Qualifications
• 3+ years managing software engineering teams with high-performing team track record
• Technical background in at least two of: AI/ML systems, distributed/HPC systems, or model optimization with GPUs/accelerators
• Demonstrated ability to engage deep in technical work and guide decisions
• Experience supporting engineer development through mentorship, technical guidance, and career growth planning
• Experience communicating technical strategy and influencing cross-functional stakeholders through written proposals and presentations

Preferred Qualifications
• Experience adhering to and implementing responsible, ethical AI practices (e.g., risk assessment, bias mitigation, quality and accuracy reviews)
• Demonstrated ongoing AI skill development (e.g., prompt/context engineering, agent orchestration) and staying current with emerging AI technologies
• Demonstrated ability to integrate AI tools to optimize/redesign workflows and drive measurable impact (e.g., efficiency gains, quality improvements)
• M.S. or Ph.D. in CS, EE, or related field
• Familiarity with AI compilers, high-performance kernel development, or hardware enablement
• Experience building teams in ambiguous, exploratory domains
• Background in performance optimization/profiling
• Prior Tech Lead, TLM, or IC experience before management
• Experience with PyTorch, TensorFlow, or equivalent AI frameworks
• Track record of maintaining team engagement through regular feedback, clear goal-setting, and retention-focused practices, with consistent delivery outcomes

Similar Jobs

More Jobs at Meta

More Information Technology Jobs

Find similar Software Engineer Manager - ML Infra jobs: