Principal Software Engineer –CoCounsel
 
CoCounsel is our most advanced AI offering to date – combining generative and agentic AI capabilities to help legal professionals move beyond prompting and start delegating.  As a Principal Software Engineer, you will set the technical direction for the backend, AI orchestration, and identity systems that turn frontier models into reliable, secure, production-grade workflows that attorneys, in-house legal departments, and government agencies trust on real client matters every day. 

This role sits at the heart of theCoCounselLegal engineering organization, partnering closely with AI/ML engineers, researchers, product, and our identity and platform teams to deliver world-class legal content and AI experiences at scale.

About the role:

• Own identity and trust at the core:Set the direction for how users, agents, and services authenticate and authorize acrossCoCounselLegal – ensuring the right person and the right agent can access the right matter, document, and content, with full auditability.Own the design and evolution of authentication and authorization across CoCounsel Legal – considering roles, autonomous agents, etc.. Partner with security, platform, and compliance teams on multi-tenancy isolation, data residency, privilege protection, and the audit trails that legal and government customers require.  Partner with security, platform, and compliance teams on multi-tenancy isolation, data residency, privilege protection, and the audit trails that legal and government customers require.

• Small team, big surface area:Join a tight group of senior engineers and researchers shipping quickly, with direct access to product leadership and customers. Think ownership of a startup with the runway of a public company.

• Technical leadership and cross-functional influence:Lead and/or design initiatives that cut across AI, product, identity, and infrastructure.  Mentor staff and senior engineers, raising the bar on AI integration practices, system design, code quality, and security across the org.  Be the expert in new model capabilities, collaborating closely with AI/ML engineers, researchers, designers, and PMs to translate industry improvements into reliable, user-facing workflows that legal professionals trust.  Help shape the team’s roadmap, technical strategy, and engineering culture – from experimentation practices to testing, rollout, and postmortems.  

• Scale, reliability, and performance:Design for high-throughput, low-latency AI workloads: caching, queuing, rate-limiting, model failover, and cost/performance trade-offs.  Work with large-scale data: millions of documents, retrieval and search, vector stores, and indexing strategies tailored to legal use cases.  Establish and refine SLOs, observability, and incident response for AI systems that must be correct, auditable, and trustworthy in professional legal workflows.

About You:

You are a fit for the position of Principal Software Engineer if your background includes:

• Bachelor’s Degree in Computer Science, Computer Engineering, a related field, or equivalent experience.

• Hands-on experience with identity and access management – designing or integrating authentication and authorization at scale (SSO, SAML, OIDC, OAuth 2.0, RBAC/ABAC, token/session management, or comparable IAM systems).

• Deep Python expertise and experience with production systems using frameworks likeFastAPI(or similar), relational databases (PostgreSQL or equivalent), and a major cloud provider (AWS preferred).

• Strong background in distributed systems: data modeling, API contracts, observability, resilience patterns, and performance tuning under load.

• Demonstrated experience building with AI – LLMs, agents, and retrieval – and a strong point of view on what “AI-native” software should look like.

• Proven track record owning large, complex projects end-to-end: architecture, execution, rollout, and long-term operation.

• Excellent communication skills and the ability to partner with product, design, security, and ML teams in a fast-moving environment.

Preferred Skills & Experience:

• Deeper identity and security experience: identity providers (e.g., Okta, Auth0, Entra ID/Azure AD, AWS Cognito), multi-tenant isolation, secrets management, zero-trust patterns, and securing how AI agents access sensitive data.

• Hands-on experience designing and operating agentic systems in production – tool calling, MCP servers, multi-step workflows, and orchestration around third-party and in-house LLMs (e.g., Anthropic, OpenAI), including prompt/response management, cost controls, and safety considerations.

• Experience with AI-adjacent infrastructure: vector databases, embeddings, semantic search, or custom retrieval pipelines.

• Opinions and experience around automated testing, reliability, and release practices for systems with non-deterministic model behavior.

#LI-ES1