Infrastructure Design Engineer

Together AI

$210K — $250K *
Information Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • 7+ years of experience in data center design or critical facilities engineering
  • Experience as an owner's engineer or resident engineer
  • Strong knowledge of electrical and cooling infrastructures for high-density systems
  • Proficiency in CAD/BIM tools like AutoCAD and Revit
  • Familiarity with industry standards such as TIA-942 and ASHRAE guidelines
  • Ability to manage multiple projects in fast-paced environments
  • Willingness to travel for site inspections and deployment sign-offs

Responsibilities

  • Architect HPC clusters with optimal whitespace layouts and airflow strategies
  • Collaborate with electrical and mechanical engineers for power and cooling integration
  • Define and validate cabling and networking requirements for AI interconnects
  • Guide contractors to ensure compliance with design specifications
  • Develop and maintain CAD drawings and technical documentation
  • Manage capacity planning and scaling of the whitespace
  • Validate electrical load distribution and review load balancing plans
  • Provide design review and technical guidance during fit-out phases
  • Drive improvements in design standards and technology implementations
  • Ensure compliance with relevant safety and building codes

Benefits

  • Competitive compensation and startup equity
  • Health insurance coverage
  • Flexibility for remote work options
Full Job Description
About The Role

Together AI is building its infrastructure footprint at scale, and this role is central to making that happen. As an Infrastructure Design Engineer, you will own the design, planning, and technical execution of whitespace environments (where servers, storage, and network equipment are deployed) across our AI data center portfolio. You are the in-house expert who ensures that rack layouts, power distribution, cooling strategy, structured cabling, and physical infrastructure design are all built to support the density, redundancy, network and reliability requirements of large-scale AI GPU clusters.

You will serve as the lead engineer across our DC portfolio, creating white space designs, reviewing partner and contractor designs, and ensuring plans are executed to spec. You will work closely with the Infrastructure Strategy, Infrastructure Engineering, and Operations teams, as well as external MEP consultants, general contractors, and data center partners. This is a technical role on a small, high-accountability team where your judgment directly shapes our ability to bring capacity online on time and to spec.
Responsibilities
  • Architect HPC clusters by designing whitespace layouts, including rack placement, aisle configuration, hot/cold aisle containment, equipment density, and airflow strategy for high-density GPU deployments
  • Collaborate with electrical and mechanical engineers to integrate power and cooling infrastructure into whitespace environments
  • Collaborate with Network Engineering to define and validate physical layer requirements (structured cabling, pathway planning, port density) for high-speed AI cluster interconnects, ensuring design compatibility with both physical and logical network architectures.
  • Advise Data Center build teams/ contractors to ensure data center build out matches design and architecture specifications. Provide direction to optimize performance, scalability and cost-effectiveness
  • Develop and maintain CAD/BIM drawings, schematics, capacity planning models, and technical documentation to support site design, construction, operations, and audits of data center white space
  • Own capacity planning within the white space through modeling that incorporates growth, utilization, and infrastructure scaling
  • Validate electrical and mechanical load distribution across whitespace fit-outs, including review of striping plans and upstream load balancing under normal and failover conditions.
  • Partner with Infrastructure Strategy and Operations by providing design review and technical guidance during the white space fit-out phase.
  • Drive continuous improvement in design standards, build processes, and quality assurance, including identifying opportunities to improve infrastructure reliability, reduce time-to-rack, and apply new technologies such as liquid cooling and high-density power architectures.
  • Ensure all designs comply with applicable standards including TIA-942, Uptime Institute Tier guidelines, ASHRAE thermal recommendations, and relevant local codes and safety regulations.
Requirements
  • 7+ years of experience in data center design, critical facilities engineering, or infrastructure delivery, with deep technical knowledge across the full stack (power, cooling, network) as it pertains to white space design and implementation
  • Demonstrated experience serving as an owner's engineer or resident engineer, including reviewing consultant drawings, managing contractor compliance, and interpreting construction specifications and submittal documents
  • Strong working knowledge of how facility electrical (UPS, switchgear) and cooling (CRAC/CRAH) infrastructures interface with, and support, high-density white space systems (PDUs, in-row cooling, CDUs, RPPs)
  • Proficiency with CAD/BIM tools such as AutoCAD, Revit, or equivalent; ability to produce and review technical drawings, schematics, and capacity models
  • Working knowledge of industry standards including TIA-942, Uptime Institute Tier classifications, ASHRAE thermal guidelines, and ANSI/BICSI; familiarity with local building codes and safety regulations
  • Proven ability to manage multiple concurrent projects across different sites and work effectively with MEP engineers, general contractors, and equipment vendors in fast-moving environments.
  • Willingness to travel to data center sites as required for technical due diligence, design inspections, and final white space deployment sign-off
Nice to Have
  • Experience with liquid cooling systems for high-density GPU clusters, including direct liquid cooling (DLC), immersion cooling, or rear-door heat exchangers, and familiarity with associated power and plumbing infrastructure
  • Background in hyperscale or AI-native infrastructure deployments, including reference architecture validation, and the development of final design acceptance criteria at scale.
  • Familiarity with DCIM platforms, telemetry and monitoring systems, and infrastructure-as-code tooling for capacity and utilization tracking
Compensation

We offer competitive compensation, startup equity, health insurance, and other benefits, as well as flexibility in terms of remote work. The US base salary range for this full-time position is: $210-250K + equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.

Similar Jobs

More Jobs at Together AI

More Information Technology Jobs

Find similar Infrastructure Design Engineer jobs: