Job Summary
This role is centered around formulating research questions, orchestrating experiments, and establishing metrics to assess model performance and its societal implications. The position involves analyzing and visualizing results from evaluations, engaging in advanced AI assessments, and spearheading the development of research publications.
Responsibilities
- Identify key research questions relevant to AI evaluations.
- Design and execute experiments to explore model behavior.
- Develop metrics to assess both model performance and societal impact.
- Analyze evaluation results and create visual representations of findings.
- Collaborate on cutting-edge AI evaluations with team members and stakeholders.
- Lead the writing and publishing of research papers in relevant fields.
Qualifications
- PhD in Computer Science, Economics, or a closely related discipline, or equivalent practical experience.
- A minimum of five years in statistical analysis and programming.
- At least two years of experience specifically in AI evaluation and working with industry codebases.
- Experience in developing AI evaluations or benchmarks is preferred.
- Strong communication and collaboration abilities.
- Established record of peer-reviewed publications regarding AI auditing or evaluation, with a focus on societal impact.
Google provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.
