OverviewWe are seeking a Principal Technical Program Manager to drive technical strategy, infrastructure planning, and cross-functional execution across our LLM inference platform.
In this role, you will lead end-to-end programs spanning GPU capacity planning, inference optimization, model migrations, and cost-per-token efficiency, while building standardized benchmarking frameworks and governance policies to evaluate, select, and scale open-weight models safely across the organization. The scope will evolve as the platform and industry mature, so success requires strong technical judgment, structured execution, and comfort operating in ambiguity.
Responsibilities
Set a long-term strategy and roadmap for the open-weight LLM inference platform. Base it on business goals, customer needs, barriers to adoption and industry trends, and build it with stakeholders across Engineering, Product, Security and Finance.
Turn business goals into ranked technical problems, such as cost per token, latency, throughput, reliability and model coverage.
Define and run programs for GPU capacity planning, inference optimization, model migrations, high availability and performance.
Build a consistent way to benchmark and evaluate open-weight models, covering serving performance, quality and cost.
Give leadership and teams data-backed recommendations for model selection.
Work with Security, Legal and Compliance on the policies and security requirements that let teams adopt open-weight and OSS models safely.
Partner with and influence engineers, ML engineers and architects to settle trade-offs and keep programs moving.
Own programs end to end, from initiation through forecasting, budgeting and scheduling to delivery, including inference cost models.
Manage complex dependencies across the company and with external partners, such as cloud and GPU providers.
Compensation
At Atlassian, we strive to design equitable, explainable, and competitive compensation programs. We follow consistent hiring practices and account for each candidate's skills, knowledge, and experience when setting base pay within the range.
Please visit go.atlassian.com/payzones for more information on which locations are included in each of our geographic pay zones. However, please confirm the zone for your specific location with your recruiter.
This role may also be eligible for benefits, bonuses, commissions, and equity.
Pay Ranges
In The United States, we have three geographic pay zones. For this role, our current base pay ranges for new hires in each zone are:
Zone A: $204,300 - $266,725
Zone B: $183,870 - $240,053
Zone C: $169,569 - $221,382
Qualifications
10+ years on software teams as a Development Manager or TPM, including 3+ years on ML, AI platform or large-scale infrastructure programs.
Working knowledge of LLM architecture, inference optimization, serving frameworks and GPU infrastructure economics.
Experience with multi-vendor GPU or inference-provider strategies and AI cost management
Experience with benchmarking and model evaluation methods.
TPMs are not expected to write or read code, but must understand system flows, block architectures and APIs.
A track record of running end-to-end, complex, cross-org technical programs with significant budget.
Strategic thinking and ability to turn business objectives into technical programs with measurable results.
Strong leadership, organizational and communication skills, including influencing senior engineers and executives without direct authority.
Benefits & Perks
Atlassian offers a wide range of perks and benefits designed to support you, your family and to help you engage with your local community. Our offerings include health and wellbeing resources, paid volunteer days, and so much more. To learn more, visit go.atlassian.com/perksandbenefits.
