Customer Success Engineer (CSE), GPU Cluster

Together AI

$260K — $290K *
Enterprise Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • 5+ years in a customer-facing technical role, ideally focused on AI or HPC infrastructure
  • Proven expertise in GPU infrastructure diagnostics and RMA workflows
  • Hands-on experience with large-scale Ethernet and InfiniBand fabric architectures
  • Familiarity with enterprise storage systems like NVMe and parallel file systems
  • Experience in managing data center operations and service level agreements
  • Strong incident management and communication skills with executive-level customers
  • Proficient in infrastructure monitoring tools like Prometheus and Grafana
  • Experience with programming/scripting in Python or Bash preferred

Responsibilities

  • Serve as the primary technical liaison for a key customer, handling all aspects of the infrastructure relationship
  • Conduct regular meetings with customer stakeholders to report on status and drive technical discussions
  • Transform customer feedback into actionable insights for engineering and product strategies
  • Manage issue resolution processes across technical teams, ensuring swift escalations and root cause analysis
  • Oversee hardware lifecycle management, from testing to health reporting, for GPU deployments
  • Implement observability strategies, including creating dashboards and defining alert policies
  • Coordinate data center operations, ensuring compliance with SLAs and optimal cluster functionality
  • Lead project management for capacity expansions, overseeing complete deployment lifecycles

Benefits

  • Competitive compensation package including startup equity
  • Comprehensive health insurance coverage
  • Flexible remote work options
  • Supportive work environment with a focus on personal and professional growth
Full Job Description
About the role

As a Customer Success Engineer at Together AI, you will serve as the named technical owner for one of our most strategic customer relationships. You will be the primary technical point of contact across all infrastructure domains - compute, networking, storage, and facilities - ensuring flawless delivery and operational health of large-scale GPU deployments. This role sits at the intersection of deep infrastructure expertise and high-stakes customer partnership, making you a critical driver of both customer success and company growth.
Responsibilities
  • Serve as the named technical point of contact for a dedicated strategic customer, owning the end-to-end technical relationship across compute, networking, storage, and facilities
    • Drive structured engagement through regular cadences including status reporting, technical steering meetings, and executive business reviews
    • Translate customer operational feedback into actionable input for Engineering, Product, and Infrastructure roadmaps
  • Lead issue lifecycle management, escalation, and RCA authorship across all infrastructure domains in partnership with Support, SRE, DC Ops, and Engineering teams
  • Own end-to-end RMA coordination and hardware lifecycle management, including acceptance testing, spare inventory management, and hardware health reporting for large-scale GPU deployments
  • Maintain deep technical expertise across the customer's infrastructure stack - GPU compute, high-speed fabric, and large-scale storage systems - advising on configuration, operational best practices, and incident resolution
  • Own the observability strategy for the customer estate, including alert policy definition, dashboard development, and proactive health management across all infrastructure layers
  • Coordinate DC operations and facilities events in partnership with internal teams and hosting providers, ensuring SLA compliance and cluster availability
  • Act as project manager for all capacity expansions, owning the full node deployment lifecycle from freight receipt through production acceptance
Qualifications
  • 5+ years in a customer-facing technical role, with 2+ years in dedicated technical account management or solutions architecture for large-scale AI or HPC infrastructure
  • Deep expertise in GPU infrastructure - GPU health diagnostics, RMA workflows, and hardware acceptance testing
  • Hands-on experience with large-scale Ethernet and InfiniBand fabric architecture
  • Working knowledge of enterprise storage systems, including high-density NVMe, parallel file systems, and metadata infrastructure
  • Experience with DC operations, facilities coordination, and hosting provider SLA management
  • Strong ownership mindset for incident management, RCA authorship, and executive-level customer communication
  • Proficiency in infrastructure monitoring and observability tooling (Prometheus, Grafana, or equivalent)
  • Proven ability to manage multiple concurrent workstreams with hyperscaler-level rigor and communication standards
  • Proficiency in Python, Bash, or infrastructure automation tools preferred
Compensation

We offer competitive compensation, startup equity, health insurance, and other benefits, as well as flexibility in terms of remote work. The US base salary range for this full-time position is: $260-290K OTE + equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.
Location

San Francisco, CA (Hybrid) or New York, NY (Hybrid)

Similar Jobs

More Jobs at Together AI

More Enterprise Technology Jobs

Find similar Customer Success Engineer (CSE), GPU Cluster jobs: