Pony.ai

Software Engineer - Evaluation

Pony.ai$120K — $200K *
Transportation
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • Strong programming skills in C/C++, Python, and software design
  • Solid foundation in mathematics and theoretical computer science
  • Demonstrated engineering discipline and interest in large-scale system building
  • Ability to maximize performance while minimizing complexity and cost
  • Bachelor's, Master's, or Ph.D in Computer Science or a related field

Responsibilities

  • Design and implement algorithms to enhance AI decision-making
  • Build scalable data pipelines for large-scale data processing
  • Create system-level evaluation metrics and testing frameworks
  • Develop high-performance backend services for real-time processing
  • Establish comprehensive system monitoring and alerting frameworks
  • Optimize workflows for Large Language Models to ensure reliable outputs

Benefits

  • Health Care Plan (Medical, Dental & Vision)
  • Retirement Plan (Traditional and Roth 401k)
  • Life Insurance (Basic, Voluntary & AD&D)
  • Paid Time Off (Vacation & Public Holidays)
  • Family Leave (Maternity, Paternity)
  • Short Term & Long Term Disability
  • Free Food & Snacks
Full Job Description
Responsibility
  • Design and implement algorithms and evaluation metrics to drive core AI decision-making.
  • Build scalable data pipelines and toolchains for large-scale data ingestion, batch processing, and evaluation.
  • Design system-level evaluation metrics, testing frameworks, and simulation environments across business components.
  • Design and implement high-performance backend services and distributed architectures , capable of handling large-scale real-time event processing.
  • Establish and maintain comprehensive system monitoring, fine-grained observability metrics, and automated alerting frameworks to ensure low latency and reliable production operations.
  • Build and optimize downstream engineering workflows for Large Language Models (LLMs), programmatically steering model reasoning, establishing guardrails, and mitigating hallucinations to ensure reliable outputs.


Requirements

  • Strong programming skills in C/C++, Python, and software design
  • Strong foundation in mathematics and theoretical computer science, such as linear algebra, calculus, graph theory, computational geometry, combinatorial optimization algorithms, stochastic processes, and complexity analysis.
  • Possessing solid engineering discipline, or demonstrating strong interest and potential in building large-scale systems, with the ability to maximize performance while keeping complexity and cost to a minimum.
  • BS/MS or Ph.D in Computer Science or a related field


Compensation and Benefits

Base Salary Range: $120,000 - $200,000 Annually

Compensation may vary outside of this range depending on many factors, including the candidate's qualifications, skills, competencies, experience, and location. Base pay is one part of the Total Compensation and this role may be eligible for bonuses/incentives and restricted stock units.

Also, we provide the following benefits to eligible employees:
  • Health Care Plan (Medical, Dental & Vision)
  • Retirement Plan (Traditional and Roth 401k)
  • Life Insurance (Basic, Voluntary & AD&D)
  • Paid Time Off (Vacation & Public Holidays)
  • Family Leave (Maternity, Paternity)
  • Short Term & Long Term Disability
  • Free Food & Snacks

About Pony.ai

Pony.ai is a Chinese-American company that develops autonomous driving technology. The company was founded in 2016 and is headquartered in Fremont, California. Pony.ai has partnerships with automakers such as Toyota and Hyundai and has raised over $1 billion in funding. The company has expanded its services to include autonomous delivery and ride-hailing. Pony.ai has been recognized as one of the most innovative companies in the world by Fast Company.
Learn more about Pony.ai
Size
1,000 employees
Industry
Founded
2016

Similar Jobs

More Transportation Jobs

Find similar Software Engineer - Evaluation jobs: