← Back to the directory

openai/evals

View on GitHub

Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.

openai/evals is #2,127 on the bestofgithub Elo ladder, in Platinum II, with a rating of 1,713 (−7 this week). It has 19,746 stars, 26 gained in the last week.

Platinum II

1,713 Elo

  • #2,127 on the ladder
  • −6 today · −7 this week
  • Peak 1,739
13 Elo to Platinum I

Stars

19,746

  • +3 today
  • +26 this week
  • – this month

Repository

Forks
3.1k
Watchers
271
Language
Python
Last push

Achievements

bestofgithub badgeMaintainer? Show your league in your README

Card: your league's emblem, from Copper to Legendary

[![bestofgithub](https://bestofgithub.dev/badge/openai/evals.svg?style=card)](https://bestofgithub.dev/repo/openai/evals)

Flat: fits beside your other badges

[![bestofgithub](https://bestofgithub.dev/badge/openai/evals.svg)](https://bestofgithub.dev/repo/openai/evals)

Install

pip
pipx install evals

README

Loading README…