Senior AI Infrastructure EngineerInference & Optimization | Montreal (hybrid-friendly) | Full-time | Founding team
The role Reporting to the Chief Technology Officer, we are seeking a Senior AI Infrastructure Engineer to design, build, and operate large-scale infrastructure that powers AI inference workloads on public cloud and on-prem.
As a founding team member and individual contributor, you will carry significant influence combining strong software engineering skills with deep systems and cloud expertise to deliver secure, scalable, reliable and efficient platforms for serving AI models.
What you'll do
- Build and manage Cloud infrastructure on GCP, AWS, Azure and On-Prem infrastructures for internal and external needs.
- Build and Manage our Infrastructure Lab
- Benchmark AI Inference workloads
- Support customers in the deployment of our solution for their infrastructure
- Build and run infrastructure with Ansible, Terraform, and Kubernetes to enable scaling to a massive number of concurrent users
- Build monitoring systems to ensure the highest quality service for our customers
What we're looking for - 5+ years of professional experience in AI infrastructure or a related field
- Experience with Ansible, Terraform, and Kubernetes
- Experience with Agentic workflows required
- Experience with Helm
- Experience with Ray, RayClusters, KubeRay
- Proficiency in Python
- Experience shipping LLM serving systems at scale in production environments
- Experience building and supporting APIs
- Experience developing and operating scalable platforms
- Bachelor's degree in Computer Science or a related field, or equivalent practical experience
On credentials No PhD required. We care about what you've shipped and what you can prove on a GPU. A pull request closes the loop faster than a CV.
Why join CarbonForge - Mission that compounds. Power is the binding constraint for AI deployment this decade. You'll build the layer that makes every joule count - and every token more useful.
- World-class science bench. Work alongside two Canada CIFAR AI Chairs and core Mila researchers: Pierre-Luc Bacon (UdeM, scientific co-founder) and Christophe Dubach (McGill, scientific advisor). Full support of Mila, Canada's leading AI research institute, with access to its talent pipeline and research bench.
- Real hardware from day one. H100, H200, AMD MI-series, and design-partner engagements already in motion.
- Resources to match the ambition. Seed-funded by strong operator and institutional investors. We have the resources to hire the best, give them the compute they need, and run the long experiments that matter. Founding-engineer equity, direct ownership, no bureaucracy - your code reaches production in weeks, not quarters.
- Remote-friendly. Montreal preferred for regular in-person work with the founding team.
A note on fit If not every bullet above describes you perfectly, apply anyway. We're hiring for trajectory and proof of work, not a checklist. What matters is whether you can ship the outcomes we've described and push us to be better at the work.
