What you will ownOne or more platform components end to end: model gateway (routing, failover, caching, per-line cost attribution), agent runtime and orchestration, evaluation harness, guardrail engine, tool and agent registry, or shared product services
The training and adaptation loop: pipelines that turn production traces and evaluation verdicts into reinforcement learning and fine-tuning datasets, and the infrastructure to train, evaluate, and serve NewCo-tuned LLMs and SLMs behind the same gates as vendor models
Reliability, latency, and cost of what you build; platform services carry baselines and you hold them
The self-service surfaces product engineers use: your components ship with documentation, sane defaults, and no ticket queue
Co-building with product teams: new shared services start embedded with a product line and graduate to platform services when proven
What you will need Strong production engineering: Python plus one systems language (Go or Rust welcome), Kubernetes, infrastructure-as-code, and one major cloud
Hands-on experience with LLM infrastructure: a model gateway pattern (such as LiteLLM or in-house), model serving (such as vLLM or managed endpoints), and vector or retrieval systems
Agent-systems experience: you have built with an agent orchestration framework (such as LangGraph or first-party agent SDKs) and understand tool calling and the Model Context Protocol (MCP)
Evaluation engineering: you have built or operated eval harnesses (golden datasets, regression gates in CI, LLM-judge calibration) and can explain why they gate merges
Post-training fluency: you have fine-tuned or post-trained a model, built the data pipeline behind one, or reproduced techniques from recent papers in production systems
Daily, hands-on use of AI coding assistants as part of your own development workflow
We care about depth in four or five of these areas more than surface familiarity with all of them.
What sets you apart
Guardrail-engine or AI-observability experience (NeMo Guardrails, OpenTelemetry GenAI conventions, LangSmith, Braintrust, or equivalent)
Reinforcement learning infrastructure (reward modelling, RLHF or GRPO-class pipelines) or SLM distillation experience
Multi-tenant SaaS infrastructure: tenancy isolation, metering, usage-based billing
Financial services engineering (banks, insurers, or payment providers) is the ideal background; other regulated-industry or security engineering depth also counts
Open-source contributions or a portfolio of deployed agents and eval suites (we would rather see this than a CV)
The reference stack
The reference technology stack for this role is our supported paved road: self-hosted LangSmith and LangGraph Platform as the agent runtime and evaluation plane, model providers behind a swappable gateway seam, PostgreSQL with pgvector plus ClickHouse and S3-compatible object storage as the data platform, Neo4j Enterprise as the semantic knowledge graph, an agent memory plane serving episodic and precedent memory over MCP, MCP-native connectors, OpenTelemetry and Grafana for observability, all on CNCF-conformant Kubernetes with Helm and Argo CD, deployable to any hyperscaler or on-prem. A tool-for-tool match is not expected: analogous experience counts fully. If you have built and operated systems of this shape on comparable components (a different orchestration framework, graph engine, evaluation platform, or serving stack), you have what we are looking for.
How we work Engineers write specs, harnesses, evals, and guardrails; AI agents execute the implementation loops. Review, not typing, is where engineering judgment goes.
Three human gates govern everything we ship: spec approval, merge, and release. Regulated code paths (money movement, authentication, cryptography, secrets) are always human owned.
Small and senior by design. No separate QA function, no scrum masters; quality .
The base compensation range for this role in the posted location is: 129,000 to 143,000.
Capgemini offers a comprehensive, non-negotiable benefits package to all regular, full-time employees. In the U.S. and Canada, available benefits are determined by local policy and eligibility and may include:
- Paid time off based on employee grade (A-F), defined by policy: Vacation: 12-25 days, depending on grade, Company paid holidays, Personal Days, Sick Leave
- Medical, dental, and vision coverage (or provincial healthcare coordination in Canada)
- Retirement savings plans (e.g., 401(k) in the U.S., RRSP in Canada)
- Life and disability insurance
- Employee assistance programs
- Other benefits as provided by local policy and eligibility
