Nutanix

Software Engineer 4 - LLM Inference

Nutanix$148K — $222K *
Information Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • 6+ years experience in product development with maintainable and resilient code.
  • Strong programming fundamentals in data structures and algorithms.
  • Extensive knowledge of Docker, Kubernetes, and cloud-native technologies.
  • Proficient in building applications with Go and Python.
  • Experience with CI/CD pipeline management.
  • Deep understanding of data center design and computing architectures.
  • Familiarity with machine learning and frameworks like TensorFlow or PyTorch is a plus.

Responsibilities

  • Architect and design scalable, containerized services on Kubernetes.
  • Enhance system performance for low-latency and high-throughput applications.
  • Optimize technology stack performance across multiple layers.
  • Contribute to relevant open-source cloud native projects.
  • Develop observability architectures for analyzing and reporting metrics.
  • Collaborate with product and backend teams to deliver high-quality outputs.
  • Engage in all phases of the product lifecycle: design, development, testing, and launch.

Benefits

  • RRSP with dollar-for-dollar matching up to 7% of base salary.
  • Dedicated mental health coverage and paramedical benefits.
  • Fully paid maternity and parental leave, with generous bereavement leave.
  • RSUs and Employee Stock Purchase Plan at a 15% discount.
  • Company holidays, sick days, wellness days, and vacation starting at 10 days.
Full Job Description
The Opportunity

At Nutanix, we're simplifying the future of AI with the Nutanix Cloud Platform for AI, enabling organizations to easily build, fine-tune, and run Generative AI, Large Language Models (LLMs), and next-generation Agentic AI applications without the complexity of managing AI infrastructure themselves. Our high-performance, full-stack machine learning cloud platform delivers AI-ready capabilities out of the box ("GPT-in-a-Box") through a software-defined, full-stack infrastructure solution that simplifies AI deployment across on-premises data centers, edge locations, and public clouds.

The Enterprise AI team is at the forefront of this innovation, driving strategic products such as LLM Inference, the AI Gateway, and the Agentic AI Platform, recently showcased at NVIDIA GTC and NEXT 2026. Join the team responsible for the foundational AI technologies powering the next wave of intelligent applications at Nutanix.

About the Team:
We are a fast-paced, globally distributed team building the foundational layers of the enterprise AI stack. By joining our team, you'll help shape the next generation of enterprise AI platforms, working at the intersection of large-scale distributed systems and machine learning infrastructure. This is an opportunity to solve complex technical challenges, influence the direction of key AI technologies, and build systems that power AI workloads at enterprise scale.

You will report to a seasoned Technical Manager who will provide mentorship and guidance as you navigate through your responsibilities. The work setup at Nutanix AI is a hybrid model, offering a blend of in-office collaboration and remote work flexibility. As a new hire, you will be expected to be in the office for 3 days a week, ensuring that you have the opportunity to engage with your team and foster strong working relationships.

Your Role:
  • Architect, design, and develop horizontally scalable, containerized, fault-tolerant services on Kubernetes.
  • Improve the performance of systems to deliver for low-latency and high-throughput use cases.
  • Optimize any part of the stack, including low-level systems.
  • Leverage and contribute to relevant open-source cloud native projects.
  • Develop scalable, efficient, and fault-tolerant observability architectures for collecting, analyzing, and reporting metrics for various platform services.
  • Collaborate closely with globally located product management and backend development teams to deliver high-quality products in a fast-paced environment.
  • Contribute to all stages of the product development cycle: technical design, development, test, experimentation, analysis, and launch.
  • Be a team player by reviewing code and design docs, giving feedback on product specs and mocks, and documentation.
  • Participate in an ongoing process definition and technology selection to ensure our technology stack is current with relevant trends.
  • Continuously learn and improve your technical and non-technical abilities.


What You Will Bring
  • 6+ years of experience developing maintainable, modular, resilient, fail-safe, and long-lasting code from a Product Development company.
  • Have strong programming fundamentals, data structure, and algorithms.
  • Strong experience in Docker, Kubernetes, and Cloud native technologies
  • Experience building applications with Go and Python
  • Experience building and managing CI/CD pipelines
  • Strong understanding of datacenter design, including computing, storage, and networking.
  • Familiarity with on-prem, cloud, and hybrid software deployment architectures
  • Good experience in designing and tuning high-performance system software
  • Strong understanding of distributed computing and storage architectures
  • Strong knowledge of OS internals, virtualization, application performance monitoring, compute storage, and networking management
  • Familiarity with machine learning concepts and popular frameworks (like TensorFlow, PyTorch, etc) is a strong plus
  • Experience with hardware accelerators, such as GPUs, is a strong plus.
  • Experience working with large codebases or contributing to open source is a strong plus.
  • Experience in building multi-tenant services on a virtualized infrastructure is a solid plus.
  • Detail-oriented with a strong focus on quality, design, and user experience.
  • Inquisitive and highly motivated self-starter and problem solver with a drive to integrate, communicate, and work well with large projects and teams.
  • Track record of being reliable, responsible, and thorough.
  • Bachelor's/Master's in Computer Science or equivalent work experience


Learn More About the Technology: https://www.nutanixbible.com/

Highlighted Benefits (Vancouver, Canada)
Retirement: RRSP with dollar-for-dollar matching up to 7% of base salary
Mental Health: Dedicated mental health coverage plus top-tier paramedical benefits
Family: Fully paid maternity and parental leave and generous bereavement leave, including time for the loss of a pet
Equity: RSUs and Employee Stock Purchase Plan at a 15% discount
Time Off: Company holidays, sick days, company wellness days, and vacation starting at 10 days

Work Arrangement Hybrid: This role operates in a hybrid capacity, blending the benefits of remote work with the advantages of in-person collaboration. In locations where our workplace policy applies (i.e. San Jose, Durham, Mexico City, Vancouver, Bangalore, Pune, Hoofddorp, Belgrade, Barcelona, Singapore, Sydney and Tokyo), employees are expected to work onsite a minimum of 3 days per week to foster collaboration, team alignment, and access to in-office resources. Workplace type may vary based on location and team requirements. Please speak with your recruiter for details. Additional team-specific guidance and norms will be provided by your manager.

Pay Transparency - Role Location The pay range for this position at commencement of employment is expected to be between CAD $148,000 and CAD $222,000 per annual.
However, base pay offered may vary depending on multiple individualized factors, including market location, job-related knowledge, skills, and experience. The total compensation package for this position may also include other elements, including a sign-on bonus, restricted stock units, and discretionary awards in addition to a full range of medical, financial and/or other benefits (including 401(k) eligibility and various paid time off benefits, such as vacation, sick time, and parental leave), dependent on the position offered. Details of participation in these benefit plans will be provided if an employee receives an offer of employment.

If hired, employee will be in an "at-will position" and the Company reserves the right to modify base salary (as well as any other discretionary payment or compensation program) at any time, including for reasons related to individual performance, Company or individual department/team performance, and market factors. Our application deadline is 40 days from the date of posting. In good faith, the posting may be removed prior to this date if the position is filled or extended in good faith.

About Nutanix

Nutanix is a cloud computing software company that sells what it calls hyper-converged infrastructure (HCI) appliances and software-defined storage. Nutanix's software delivers a full infrastructure stack that integrates compute, virtualization, storage, networking, and security to power any application, at any scale. Nutanix software runs across different cloud environments to harmonize IT operations and bring frictionless mobility to all applications. Nutanix solutions are used by companies in a wide range of industries, including healthcare, manufacturing, education, and financial services.
Learn more about Nutanix
Size
6,080 employees
Market Cap
$6.3 billion
Industry
Net Income
-$978.4 million
Founded
2009
5 Year Trend
+13.3%
Revenue
$1.3 billion
NASDAQ

Similar Jobs

More Jobs at Nutanix

More Information Technology Jobs

Find similar Software Engineer 4 - LLM Inference jobs: