PhD in Computer Science, Economics, Computational Social Science, Data Science, Political Science, or related field, or equivalent experience.
2 years of experience in statistical concepts, data analysis, and visualization.
2 years of programming experience with languages like R or Python and relevant libraries.
2 years of experience in AI evaluation.
Responsibilities
Identify new research areas and questions.
Design and conduct research and experiments.
Develop and test new metrics and measures.
Perform data analysis to synthesize and visualize findings.
Lead writing results for research publications.
Benefits
Comprehensive health and wellness programs.
Generous paid time off and holidays.
Retirement savings plans with company matching.
Access to professional development resources.
Collaborative and innovative work environment.
Full Job Description
Minimum qualifications:
PhD in Computer Science, Economics, Computational Social Science, Data Science, or Political Science or a related field, or equivalent practical experience.
2 years of experience with statistical concepts, data analysis, and visualization.
2 years of experience with programming languages (e.g., R, Python), relevant libraries (e.g., Pandas, NumPy, Scikit-learn), or other scripting languages.
2 years of experience with AI evaluation.
Preferred qualifications:
Experience creating AI evaluations or benchmarks.
Advanced understanding of statistical concepts, and ability to perform data analysis and visualization.
Excellent communication and collaboration skills and ability to effectively communicate and work with researchers from a wide variety of backgrounds in research publications, policy briefs, or presentations targeted at both technical and non-technical audiences.
Peer reviewed publication on AI auditing/evaluation, especially if it relates to societal impact.
About the job
As a Research Scientist on the Sociotechnical Analysis of Model Behavior (SAMBA) team in the Responsible Research Group (R2), you will conduct research on model behaviors that impact people and society. You will design tools and methods for measuring the impact of AI on society, broadly defined, design experiments, and develop measures to characterize model properties relevant to responsibility and safety. As one part of your work, you will collaborate closely with other Research Scientists and Research Engineers to build frontier evaluations, apply them in practice, and publish results.
You will be joining a specialized Responsibility team within Google. While our reporting structure sits within Google's broader Trust & Safety organization, our work remains deeply integrated with DeepMind.
Perform data analysis to synthesize and visualize research findings and evaluation results.
Lead writing results for research publications.
About Google
Google is a multinational technology company that specializes in Internet-related services and products. These include online advertising technologies, search engine, cloud computing, software, and hardware. Google was founded in 1998 by Larry Page and Sergey Brin while they were Ph.D. students at Stanford University. The company has grown tremendously since then and has become one of the most valuable companies in the world. Google's mission is to organize the world's information and make it universally accessible and useful.
