Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.
openai/evals is #2,127 on the bestofgithub Elo ladder, in Platinum II, with a rating of 1,713 (−7 this week). It has 19,746 stars, 26 gained in the last week.