Bachelor's degree or equivalent practical experience.
5 years of software development experience in one or more programming languages.
3 years of experience in testing, maintaining, or launching software products; 1 year in software design and architecture.
2 years of experience with GenAI technologies, applied ML, or ML platform/infrastructure.
Responsibilities
Write and test product or system development code.
Collaborate with peers and stakeholders through design and code reviews.
Triage product or system issues and debug/track/resolve them.
Lead the end-to-end design and development of next-gen evaluation systems.
Research, publish, and innovate Cyber Evaluation benchmarks.
Benefits
Comprehensive health and wellness programs.
Generous paid time off and holidays.
Retirement savings plans with company match.
Professional development opportunities.
Equity benefits.
Full Job Description
info_outline X In most instances, this position requires in-person interviews as part of the hiring process.
Applicants in San Francisco: Qualified applications with arrest or conviction records will be considered for employment in accordance with the San Francisco Fair Chance Ordinance for Employers and the California Fair Chance Act.
Minimum qualifications:
Bachelor's degree or equivalent practical experience.
5 years of experience with software development in one or more programming languages.
3 years of experience testing, maintaining, or launching software products, and 1 year of experience with software design and architecture.
2 years of experience with state-of-the art GenAI technologies (e.g., Large Language Model (LLMs), Agentic development etc), applied ML or Core ML development, or ML platform/infrastructure (e.g., model deployment, model evaluation, data processing, debugging).
Preferred qualifications:
Master's degree or PhD in Computer Science or related technical field.
5 years of experience with data structures and algorithms.
1 year of experience in a technical leadership role.
Experience with RL, post-training, preference optimization or feedback driven model / harness improvement. Experience in highly scalable and available distributed systems, cloud services or data platforms
Proven experience in building and deploying Agentic AI systems. End-to-end Agent development and iteration experience, as well as research experience in benchmarking.
Understanding of security related areas.
Responsibilities
Write and test product or system development code.
Collaborate with peers and stakeholders through design and code reviews to ensure best practices amongst available technologies (e.g., style guidelines, checking code in, accuracy, testability, and efficiency).
Triage product or system issues and debug/track/resolve by analyzing the sources of issues and the impact on hardware, network, or service operations and quality.
Lead the end-to-end design and development of next-gen evaluation system.
Research, publish and innovate Cyber Evaluation benchmarks, and develop foundational AI feedback loop with foundational AI model and core cyber harness, agentic system.
Individual pay is determined by factors including job-related skills, experience, and relevant education or training.
Google is a multinational technology company that specializes in Internet-related services and products. These include online advertising technologies, search engine, cloud computing, software, and hardware. Google was founded in 1998 by Larry Page and Sergey Brin while they were Ph.D. students at Stanford University. The company has grown tremendously since then and has become one of the most valuable companies in the world. Google's mission is to organize the world's information and make it universally accessible and useful.
