Job SummaryYou will lead the software engineering for evaluation and scoring in AI Proving Grounds (AIPG). Customers need to see what an agent attempted, what happened and whether the evidence supports the assessment.
AI-native development is central to this role. Use coding agents as a primary tool for design, implementation, testing and diagnosis, and build repeatable workflows for the team. You will contribute critical code and guide design across TPA features. The Engineering Manager owns staffing, people and delivery priorities. Evaluation specialists review methods and scoring criteria; you own implementation and evidence integrity.
What will you be doing at SimSpace?- Lead technical design across TPA's evaluation workflow and implement critical paths from execution coordination and evidence capture through scoring and results. Agree shared infrastructure and frontend responsibilities with the owning teams.
- Establish reusable agent instructions, repository context and spec-driven workflows. Build automated checks, review generated changes and coach engineers to use the workflow effectively within approved data and access boundaries.
- Define versioned APIs and data contracts that preserve the identity, environment, method, access permissions and source evidence behind each result, including known uncertainty.
- Build asynchronous services with explicit state, duplicate protection, bounded retries, cancellation and recovery from interrupted work.
- Work with Data Scientists on reference cases and reproducible scoring. Show missing, invalid or inconclusive evidence explicitly so incomplete input cannot produce an unsupported passing result.
- Establish integration tests, diagnostics and operating documentation that distinguish software, environment and evaluation-method failures through rollout and support.
- Guide other engineers through implementation and review. Keep designs coherent across features, document decisions and coordinate shared-interface changes with their owners.
What are the qualifications to apply?- Experience leading technical design across related features, contributing production code and helping other engineers carry the design through rollout and operation.
- Evidence of shipping and maintaining software with AI coding agents and improving the workflow for others, including task decomposition, useful repository context, independent verification and correction of generated errors.
- Strong API and data-contract design skills, including access controls, validation, compatibility and interface migration across components.
- Experience building distributed or asynchronous systems that tolerate failures and diagnosing partial failures across service boundaries.
- Experience integrating analytical, data-processing or model-based capabilities into maintained software services.
- Ability to design tests and observability that explain evidence provenance, incorrect results and recovery behavior.
- Technical leadership through mentoring, design reviews, written decisions and coordination with engineers and specialists outside your immediate team.
Who you are- You test whether a conclusion is supported and make the evidence and its limits visible in interfaces and results.
- You explain the cost of technical trade-offs and choose designs that support useful releases and future work.
- You improve how the team works with agents, judging progress through reliable delivery, review effort and rework.
Nice to have but not required- Experience with agent evaluation frameworks, experimental platforms, or evidence and audit systems.
- Production experience with Go and Python, including integration between services and analytical workers.
- Experience with cybersecurity, simulation or secure handling of evaluation artifacts.
Our Tech Stack IncludesThe team works across Go and Python services, application and browser integrations, distributed execution, containers and automated qualification. The development workflow centers on AI coding agents, written requirements, automated checks and code review.
We're proud to offer a competitive and comprehensive package designed to support your well-being, growth, and success:- Compensation. Base salary range: $180,000 - $260,000, reflecting our confidence in your expertise and impact, with the opportunity for annual bonuses tied to company performance and individual contributions.
- Health & Wellness. Comprehensive medical, dental, and vision benefits, plus savings plans-coverage starts on day one!
- Mental Health Support. Access to company-paid counseling, coaching, and resources for you and your family through Spring Health.
- Financial Well-Being. Plan for your future with a 401(k)-retirement savings plan featuring a company match.
- Flexible Time Off. Take the time you need with unlimited vacation and dedicated health & wellness days. SimSpace provides flexible solutions to meet the diverse work-life needs of team members.
- Parental Leave. Paid leave plans to support you and your loved ones during life's most important moments.
- Ownership Opportunities: Equity stock options at hire, with annual performance-based grants-become an invested stakeholder in our shared success.
- Referral Rewards: Earn $1,500-$3,500 for every qualified hire through our employee referral program.
- Peloton Interactive Wellness Program: Full- and partial- subsidized membership plans and equipment discounts to help you reach your personalized fitness goals.
- Continuous Learning: Access a LinkedIn Learning membership to prioritize your personal and professional development.
- Social Connections: Monthly reimbursements for meaningful connections with teammates through our SocialSpace Community.
- Extra Perks: Legal plan coverage, pet insurance, wellness reimbursements, and more to simplify life's details.
Actual compensation for the position is based on a variety of factors, including, but not limited to affordability, skills, qualifications and experience, and may vary from the range.