Job SummaryYou will lead TPA's evaluation and scoring work for AI Proving Grounds (AIPG). The team turns evaluation methods into software that helps customers see what an agent did, what evidence supports its assessment and how results compare.
TPA's software engineers and Data Scientists will report directly to you. As a hands-on player-coach, you will regularly implement and debug software, tests and automation while developing the team and owning delivery. The Staff Engineer leads design across features. Evaluation specialists review method validity; engineering makes the implementation reliable and keeps results traceable to evidence.
What will you be doing at SimSpace?- Hire, coach and develop software engineers and Data Scientists through clear expectations and regular feedback. Arrange scientific mentorship and method review with the appropriate specialists.
- Define assessment questions, reference cases, evidence requirements and acceptance criteria with Product and evaluation specialists before expanding the work.
- Lead delivery from execution coordination through evidence capture, scoring and usable results. Agree shared infrastructure, frontend work and operating support with the teams that provide them.
- Review architecture and code with the Staff Engineer. Write focused changes, such as a test harness or integration fix, while helping engineers take ownership and keeping time for people leadership.
- Build tests for missing evidence, incompatible versions, interrupted runs and misleading results. Use AI-assisted development with code review, tests and security checks.
- Keep a ranked plan that accounts for support and maintenance. Raise changes in scope, dependencies or staffing early, and agree who will operate the capability before release.
What Success Looks LikeThe Director and Product will agree initial priorities and timing with you, based on staffing and partner commitments.
- The team has a reviewed assessment plan with methods, reference cases, known limitations and named reviewers.
- An assessment workflow produces results that can be traced to evidence and clearly reports missing or inconclusive inputs.
- Engineers and Data Scientists understand their responsibilities and use a capacity plan that covers hiring, support and maintenance.
What are the qualifications to apply?- Experience managing software engineers through hiring, coaching, performance feedback and career development, with the ability to coach Data Scientists using role-appropriate goals and specialist support.
- Recent experience personally implementing, testing and debugging production software, with the ability to review designs and diagnose service failures.
- Experience delivering work across software and analytical, modeling or research disciplines, with clear engineering and specialist responsibilities.
- Experience turning data-processing or analytical methods into supported software through tested APIs, reproducible inputs and observable results.
- Ability to reason about asynchronous execution, data integrity, access control and recovery, and explain how tests expose incorrect or unsupported results.
- Evidence of bringing an uncertain problem through a supported release by choosing scope, securing dependencies and improving delivery through automation.
Who you are- You invite challenge, explain trade-offs and raise uncertainty early enough for the team to act.
- You give specialists useful feedback, respect their judgment and help them deliver a working product together.
Nice to have but not required- Experience with agent evaluation, experimentation, scoring or scientific software.
- Prior experience directly managing Data Scientists or other research specialists.
- Experience with Go or Python, cybersecurity or simulation products. Specific evaluation frameworks can be learned.
Our Tech Stack IncludesThe planned platform uses Go operational services and Python evaluation components, service APIs, durable workflows, versioned evidence, automated tests and containers.
We're proud to offer a competitive and comprehensive package designed to support your well-being, growth, and success:- Compensation. Base salary range: $160,000 - $220,000, reflecting our confidence in your expertise and impact, with the opportunity for annual bonuses tied to company performance and individual contributions.
- Health & Wellness. Comprehensive medical, dental, and vision benefits, plus savings plans-coverage starts on day one!
- Mental Health Support. Access to company-paid counseling, coaching, and resources for you and your family through Spring Health.
- Financial Well-Being. Plan for your future with a 401(k)-retirement savings plan featuring a company match.
- Flexible Time Off. Take the time you need with unlimited vacation and dedicated health & wellness days. SimSpace provides flexible solutions to meet the diverse work-life needs of team members.
- Parental Leave. Paid leave plans to support you and your loved ones during life's most important moments.
- Ownership Opportunities: Equity stock options at hire, with annual performance-based grants-become an invested stakeholder in our shared success.
- Referral Rewards: Earn $1,500-$3,500 for every qualified hire through our employee referral program.
- Peloton Interactive Wellness Program: Full- and partial- subsidized membership plans and equipment discounts to help you reach your personalized fitness goals.
- Continuous Learning: Access a LinkedIn Learning membership to prioritize your personal and professional development.
- Social Connections: Monthly reimbursements for meaningful connections with teammates through our SocialSpace Community.
- Extra Perks: Legal plan coverage, pet insurance, wellness reimbursements, and more to simplify life's details.
Actual compensation for the position is based on a variety of factors, including, but not limited to affordability, skills, qualifications and experience, and may vary from the range.
