San Francisco, California, 94102
Job description
As the owner of the infrastructure tasked with handling a substantial number of requests from various AI providers, you will ensure optimal reliability, minimal latency, and cost-effectiveness. This responsibility includes overseeing structured outputs, implementing caching strategies, managing routing, and monitoring processes for over 30 billion tokens on a monthly basis. A solid foundation in engineering principles and a data-driven approach with meticulous attention to detail and verification is essential. While direct experience in this specific position is not necessary, the ideal candidate should be a quick learner adept at navigating complex AI infrastructure.
STEMHUNTER is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex (including pregnancy, sexual orientation, gender identity, and gender expression), national origin, age, disability, genetic information, veteran status, or any other status protected by applicable federal, state, or local law. We comply with all applicable equal employment opportunity and affirmative action regulations.
