Bachelor's degree or equivalent experience in computer science, engineering, machine learning, or related field.
Four years of software engineering experience, excluding internships.
Proficient in building and operating production infrastructure on AWS, with IAM expertise.
Experience with Infrastructure-as-Code (Terraform or similar) at a multi-account scale.
Strong understanding of multi-tenant isolation principles.
Proven track record of managing complex, production-critical systems end to end.
Strong coding skills in Python, Rust, or similar languages.
Responsibilities
Build and operate cloud infrastructure for training and serving customer models.
Design and enforce data isolation boundaries for customer data and models.
Collaborate with researchers and engineers to enhance security and isolation.
Evaluate and secure tools and providers used in infrastructure.
Lead security operations, including logging, monitoring, and incident response.
Benefits
In-person role in San Francisco office.
Competitive cash compensation.
Startup equity opportunities.
Full Job Description
About the role
Every Engram customer gets models trained on their own context, such as their documents, messages, code, and knowledge bases, and retrained continuously as that context changes. That means isolation can't stop at where data is stored: it has to follow the data into training runs and into the models themselves.
We're looking for an infrastructure engineer to own and evolve the systems that make that true, from ingestion through training to inference, as we add customers and providers. You'll work closely with our researchers so the secure path is also the fast one.
What you'll do
Build and operate the cloud infrastructure responsible for training and serving Engram customer models.
Design and enable the boundaries that keep each customer's data, training runs, and models separate; both on the cloud and on Engram-managed baremetal compute.
Partner with researchers and engineers on paved roads that improve our isolation and security posture.
Evaluate and secure the providers and tools we build on, including Modal, Baseten, and Fireworks as well as compute on baremetal or Kubernetes.
Take the lead on security operations and customer trust: maintain the logging and monitoring we rely on, respond to incidents, and bring clarity to security reviews and compliance work.
Your background looks like
A bachelor's degree, or equivalent practical experience, in computer science, engineering, machine learning, or a related field.
Four years of work experience as a software engineer or equivalent, exclusive of internships.
Experience building and operating production infrastructure on AWS, including IAM expertise: cross-account roles, STS, resource and key policies, KMS, and multi-account organizations.
Infrastructure-as-Code (Terraform or similar) at multi-account scale, with secure patterns for networks, IAM, and shared services.
A rigorous approach to multi-tenant isolation.
A track record of owning complex, production-critical systems end to end.
Comfort with ambiguity and high ownership at an early-stage company.
Strong production-grade coding skills (Python, Rust, or similar). This role involves shipping code as well as configuration.
No prior ML experience is required.
Bonus points if you have
Experience as an early infrastructure or security hire at a startup.
Experience with ML infrastructure, such as GPU training and model serving.
Experience supporting enterprise security reviews and compliance programs such as SOC 2.
Open-source contributions, talks, or writing on cloud or infrastructure security.
Experience on Azure or GCP.
Engram is based in San Francisco. This role is in-person in our SF office. We offer competitive cash compensation and startup equity.
