Job Summary
Build and maintain evaluation systems and automated testing frameworks that help ensure AI-powered features are accurate, reliable, and safe. In this role, you will assess model performance, uncover recurring failure patterns, and work with cross-functional partners to improve how AI supports healthcare workflows.
Responsibilities
- Develop and maintain evaluation systems and automated tests for AI-powered features.
- Analyze model performance to assess accuracy, reliability, and safety.
- Identify patterns in model failures and share findings to guide improvements.
- Collaborate with cross-functional teams to improve AI behavior in healthcare workflows.
Qualifications
- At least 3 years of professional experience in machine learning or software engineering.
- Strong programming skills in Python or TypeScript.
- Experience testing or evaluating AI models.
- Solid understanding of machine learning metrics and experimental methodologies.
Bask Health provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.


