Principal Software Engineering (AI Infrastructure) - North America Software Center

Taiwan Semiconductor Manufacturing Company Limited, TSMC

$137K — $199K *
Enterprise Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • BS/MS/PhD in Computer Science or related field.
  • 7+ years of software engineering experience.
  • 3+ years leading architecture for distributed systems or cloud infrastructure.
  • 2+ years hands-on experience designing enterprise AI platforms.
  • 1+ years' experience as a Principal Engineer, Staff Engineer, or Technical Lead.

Responsibilities

  • Define the architecture and technical strategy for enterprise AI infrastructure.
  • Design highly scalable platforms supporting LLM serving and GPU scheduling.
  • Lead architecture for high availability AI services and multi-region deployment.
  • Drive engineering best practices for Kubernetes and AI deployment automation.

Benefits

  • Comprehensive medical, dental, and vision insurance.
  • Life insurance and access to a 401(k) plan with employer match.
  • 12 holidays per year and accrued paid time off annually.
  • Onsite amenities including a fitness center and subsidized café.
  • Tuition assistance for professional development.
Full Job Description
Who We're Looking For:
We develop next-generation AI infrastructure, cloud platforms, data infrastructure, developer platforms, and site reliability engineering (SRE) capabilities supporting engineering teams and manufacturing facilities worldwide. As TSMC accelerates AI adoption across the enterprise, we are building enterprise-scale AI platforms that enable secure, scalable, and reliable AI services across global regions.

We are seeking a talented and experienced AI Infrastructure Engineer to define and build TSMC's enterprise AI Infrastructure Platform.

You will design and lead enterprise-scale AI infrastructure that enables thousands of engineers across multiple global regions to securely develop, deploy, and operate AI applications using both internal and external foundation models.

You will collaborate with engineering teams in North America and Taiwan to build a highly scalable AI platform supporting model serving, inference, AI gateways, GPU infrastructure, observability, governance, and platform automation.

This role combines deep expertise in distributed systems, cloud infrastructure, AI platforms, and software architecture.

Key Responsibilities:
  • Define AI Platform Architecture. Lead the architecture and technical strategy for enterprise AI infrastructure. Drive long-term technical direction for: AI Platform, Enterprise AI Gateway, Multi-model inference platform, GPU infrastructure, AI governance, AI observability.
  • Build Enterprise AI Infrastructure: Design highly scalable platforms supporting LLM serving, GPU scheduling, Model routing, Model lifecycle management, RAG infrastructure, Vector databases, AI orchestration.
  • Design Distributed Systems: Lead architecture for high availability AI services, multi-region deployment, disaster recovery, service mesh, distributed caching, event-driven architecture, global load balancing.
  • AI Platform Engineering: Drive engineering best practices for: Kubernetes, Platform-as-a-Service, AI deployment automation.


Minimum Requirements:
  • BS/MS/PhD in Computer Science or related field.
  • 7+ years of software engineering experience.
  • 3+ years leading architecture for distributed systems or cloud infrastructure.
  • 2+ years hands-on experience designing enterprise AI platforms.
  • 1+ years' experience as a Principal Engineer, Staff Engineer, Distinguished Engineer, or Technical Lead.
  • Strong technical communication skills for collaborating with global cross-functional teams.


Required Technical Experience:

AI Infrastructure, strong experience with:
  • LLM inference
  • Enterprise AI Gateway
  • AI serving infrastructure
  • GPU scheduling
  • Multi-model AI architecture
  • Model lifecycle management


Experience with technologies such as:
  • NVIDIA GPU ecosystem
  • vLLM
  • TensorRT-LLM
  • Triton Inference Server
  • Ray
  • Kubeflow
  • MLflow


Cloud Native Infrastructure Deep expertise with:
  • Kubernetes
  • Docker
  • Helm
  • ArgoCD
  • Service Mesh
  • AWS or Azure or GCP


Software Engineering
  • Strong programming skills in one or more of Go, Python, JAVA.
  • Experience with:
    • REST APIs
    • Microservices
    • SDKs


Work Location & Schedule:

This position is based on-site at our Vancouver, Washington location during core business hours, Monday through Friday from 8 am to 5 pm. Additional hours may be required to meet project demands.

Compensation and Benefits:
  • At TSMC, your base pay is just one component of your comprehensive compensation package. For new hires in this position, the starting salary typically ranges between $137,300 and $183,650 per year. The full salary range for this Job Grade extends from $137,300 - $199,100 depending on factors such as skills, qualifications, education, experience, tenure, and position level. TSMC's total compensation package also includes market-competitive pay, profit sharing and incentive bonuses, and tuition assistance.
  • Comprehensive benefits include medical, dental, and vision insurance, life insurance, and access to a 401(k) plan with employer match.
  • Employees enjoy 12 holidays per year and accrue paid time off annually.
  • Onsite amenities include a fitness center, game room, physical therapist, and subsidized café.


Date: Aug 27, 2026

Country/Region: US

City: Vancouver

Company: TSMC Washington

Similar Jobs

More Jobs at Taiwan Semiconductor Manufacturing Company Limited, TSMC

More Enterprise Technology Jobs

Find similar Principal Software Engineering (AI Infrastructure) - North America Software Center jobs: