Job Summary
The role involves designing and constructing synthetic data environments and task generators aimed at training and assessing large language models. Additionally, the candidate is tasked with developing comprehensive testing and evaluation frameworks to pinpoint model shortcuts while guaranteeing exceptional performance quality.
Responsibilities
- Design and implement synthetic data frameworks and task generators for large language models.
- Create detailed testing and evaluation frameworks to detect model shortcuts.
- Ensure the maintenance of high standards in model performance through rigorous assessments.
Qualifications
- Proven experience in building training or evaluation environments for large language models.
- Strong proficiency in Python programming.
- Familiarity with working in containerized environments and using sandboxes.
- Experience with asynchronous programming.
- Legal authorization to work in the EU.
ellamind provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.
