Show HN: Python lib to run evals across providers: OpenAI, Anthropic, etc.

8 points by cr4zy 2 years ago · 1 comment · 1 min read

Library makes requests asynchronously across models, so you can spend a lot of $$ quickly if you want XD. But seriously I hope this enables folks to create and run evals (especially safety ones) a lot easier than before.