Job Summary
This role is centered around spearheading the quality strategy for medium-to-large features, which encompasses a variety of tasks such as risk assessment, test strategy formulation, establishing release criteria, automation processes, CI/CD checkpoints, and granting final approvals. The position involves setting quality benchmarks for testing and evaluating AI-generated outputs, alongside developing monitoring techniques for LLM features. Furthermore, the role includes mentoring quality engineers and collaborating closely with product and engineering teams to ensure successful outcomes.
Responsibilities
- Lead the quality strategy related to medium-to-large feature sets.
- Conduct comprehensive risk analysis and formulate test planning.
- Establish clear release criteria and implement automation processes.
- Define CI/CD gates and manage final sign-off on features.
- Set and uphold team standards regarding testing and AI-generated content.
- Develop evaluation metrics and monitoring strategies for LLM features.
- Guide and mentor quality engineers in best practices.
- Collaborate effectively with product and engineering teams to drive quality initiatives.
Qualifications
- A minimum of five years of experience in QA or software development.
- Experience at the team level in establishing testing standards.
- Proficient in automation with a modern framework and CI/CD methodologies.
- Strong understanding of programming with code, particularly in Python/Django, React, and databases like SQL and PostgreSQL.
- Experience with evaluating production-level LLM features.
- Effective mentoring abilities and strong communication skills regarding quality risks.
Zipliens provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.
