Job Summary
This role is focused on steering the Trust and Safety Responsible AI SCALE technical roadmap, which involves transforming high-risk evaluations into efficient automated testing frameworks. The position also includes setting up metrics and governance to ensure safe product launches.
Responsibilities
- Define and implement scalable automated testing pipelines for high-risk evaluations.
- Establish metrics and governance to facilitate safe product launches.
- Design and develop connected evaluation and monitoring systems.
- Collaborate with DeepMind and product engineering teams to create standards and autoraters.
- Provide technical expertise and mentorship to analysts within the team.
Qualifications
- Bachelor’s degree or equivalent practical experience required.
- A minimum of five years of experience in data analysis.
- At least five years of experience in project management, including defining scope, goals, and deliverables.
- Preferred: Master’s degree in a quantitative field.
- Familiarity with programming languages such as SQL, R, Python, or C++ and experience with machine learning systems.
- Strong written and verbal communication abilities are essential.
