5-7 years of experience in backend engineering or related field
Strong foundations in machine learning and deep learning
Hands-on experience with LLM evaluation and reinforcement learning
Proficient in Python and building reliable ML infrastructure
Ability to navigate open-ended research problems
High standards for experimental rigor and engineering quality
Responsibilities
Design and build evaluation frameworks for agentic systems
Research methods for agent evaluation and reward modeling
Develop benchmarks to measure agent performance and reliability
Own research streams and build infrastructure for working systems
Publish research findings through technical blogs and open-source contributions
Benefits
Competitive salary with equity package
Comprehensive medical benefits and generous PTO
Flexible work arrangements
Direct impact on company direction and technical decisions
High ownership and opportunity for career-defining impact
Visa sponsorship
Full Job Description
The Role
We are looking for a Backend Engineer to own the systems that ingest, evaluate, and serve agent behavior data at production scale. You will work across telemetry ingestion, platform reliability, sandbox infrastructure, and the API surface that customers and integrations build on. Some weeks you will be deep in distributed systems and query performance. Other weeks you will ship a customer-facing feature across backend, APIs, and the data layer. What you'll do:
Design and build evaluation frameworks for agentic systems
Research methods for agent evaluation, reward modeling, reward-hacking, post-training, and self-improving systems
Develop rubrics, verifiers, reward signals, and benchmarks to measure agent performance, reliability, and generalisation
Own research streams end-to-end and building infrastructure to ship working systems
Publish research findings through technical blogs, papers, and open-source contributions
What we look for:
Moving fast with high agency
Strong foundations in machine learning, deep learning, and computer science
Hands-on experience with LLM evaluation, agentic systems, reinforcement learning, or post-training
Strong programming skills in Python and experience building reliable ML research infrastructure
Strong research taste and the ability to identify and solve complex and meaningful problems
Comfortable navigating open-ended research problems and quickly translating ideas into working implementations
High standards for experimental rigor, engineering quality, and clear technical communication
Benefits and perks
Competitive salary plus meaningful equity package
Comprehensive medical benefits and generous PTO
Flexible work arrangements
Direct impact on company direction and technical decisions
High ownership and the opportunity to make a career-defining impact
Visa sponsorship
As a founding member, you'll help define the technical foundation of NeoSigma. Your scope will grow with the company, from owning core systems end-to-end to shaping architecture, hiring, and engineering culture. This role has a natural path toward technical leadership or engineering management as the team scales.