Master's degree in Natural Science or computational science, or equivalent experience.
Experience with performance measurement and optimization of Large Language Models (LLMs) for scientific applications.
Ability to break down complex workflows into actionable tasks and quality standards.
Experience collaborating with technical teams to enhance AI capabilities for scientific use.
Demonstrated expertise in both scientific research and AI, with a background in machine learning or related fields.
Strong skills in evaluating machine learning models and applying LLMs to scientific workflows.
Responsibilities
Set the data strategy for Science by mapping workflows and prioritizing capabilities.
Design tasks and evaluation rubrics to create high-quality Science data.
Analyze model failures to identify gaps in scientific knowledge and assumptions.
Develop benchmarks to assess the success of the data strategy and guide evaluation efforts.
Recruit and mentor subject matter experts to ensure data quality and usability.
Benefits
Comprehensive health and wellness programs.
Generous paid time off and holiday policies.
Opportunities for professional development and training.
Access to cutting-edge technology and resources.
Flexible working locations in New York, NY or Mountain View, CA.
Full Job Description
info_outline X Note: By applying to this position you will have an opportunity to share your preferred working location from the following: New York, NY, USA; Mountain View, CA, USA.
Minimum qualifications:
Master's degree in Natural Science (e.g., Biology, Chemistry, Physics), computational science, or equivalent practical experience.
Experience measuring the performance of Large Language Models (LLMs) or generative AI tools and optimizing them for scientific use cases.
Preferred qualifications:
Experience breaking down laboratory or computational workflows into concrete tasks, evaluation rubrics, and quality standards.
Experience prioritizing AI capabilities and collaborating closely with cross-functional technical partners to unlock value for scientists.
Demonstrated dual expertise bridging scientific research and AI, such as transitioning from a scientist into a technical machine learning role, or vice versa.
Strong technical capabilities evaluating machine learning models, and applying Large Language Models to complex scientific workflows.
About the job At Google DeepMind, we are expanding Gemini's frontier AI capabilities into highly specialized professional domains. We are seeking a Science Expert Lead to shape our foundational data strategy for the financial sector. In this role, you will apply your deep domain knowledge to map complex Science workflows, identify critical areas for model enhancement, and curate the high-quality data necessary to make Gemini the ultimate AI assistant for Science professionals.
Responsibilities
Set the Science data strategy by mapping workflows into a use-case taxonomy, and partnering with research to prioritize capabilities, data coverage, and sourcing pipelines.
Create high-quality Science data by designing tasks and rubrics, and QA-ing datasets from vendors, customers, and synthetic pipelines for correctness, realism, and coverage.
Steer data priorities using model failures by reproducing reported losses and stress-testing checkpoints on real workflows to identify missing scientific knowledge and false assumptions.
Build Science evaluations by assessing industry benchmarks to measure data strategy success, and advise cross-team evaluation efforts on scientific coverage and realism.
Scale expertise by recruiting and guiding SMEs, acting as the domain authority to enforce vendor quality, and converting expert contributions into usable training data.
Individual pay is determined by factors including job-related skills, experience, and relevant education or training.
Google is a multinational technology company that specializes in Internet-related services and products. These include online advertising technologies, search engine, cloud computing, software, and hardware. Google was founded in 1998 by Larry Page and Sergey Brin while they were Ph.D. students at Stanford University. The company has grown tremendously since then and has become one of the most valuable companies in the world. Google's mission is to organize the world's information and make it universally accessible and useful.
