← Back to the directory

confident-ai/deepeval

View on GitHub

The LLM Evaluation Framework

confident-ai/deepeval is #1,117 on the bestofgithub Elo ladder, in Emerald II, with a rating of 1,838 (+9 this week). It has 19,492 stars, 121 gained in the last week.

Emerald II

1,838 Elo

  • #1,117 on the ladder
  • −3 today · +9 this week
  • Peak 1,856
35 Elo to Emerald I

Stars

19,492

  • +13 today
  • +121 this week
  • – this month

Repository

Forks
2.2k
Watchers
64
Language
Python
Last push

Achievements

bestofgithub badgeMaintainer? Show your league in your README

Card: your league's emblem, from Copper to Legendary

[![bestofgithub](https://bestofgithub.dev/badge/confident-ai/deepeval.svg?style=card)](https://bestofgithub.dev/repo/confident-ai/deepeval)

Flat: fits beside your other badges

[![bestofgithub](https://bestofgithub.dev/badge/confident-ai/deepeval.svg)](https://bestofgithub.dev/repo/confident-ai/deepeval)

Install

git
git clone https://github.com/confident-ai/deepeval.git

Similar repositories

promptfoo/promptfoo

Open on GitHubTypeScript

Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.

  • 1,980+12 Elo, change today
  • 27.2k stars
  • 2.7k forks
  • 77 watchers
npm
npm install -g promptfoo
  • ci
  • ci-cd
  • cicd
  • evaluation

jeinlee1991/chinese-llm-benchmark

Open on GitHub

非线智能 NoneLinear - ReLE评测:中文AI大模型能力评测(持续更新):目前已囊括374个大模型,覆盖chatgpt、gpt-5.4、谷歌gemini-3.1-pro、Claude-4.6、文心ERNIE-X1.1、ERNIE-5.0、qwen3.6-max、qwen3.6-plus、百川、讯飞星火、商汤senseChat等商用模型, 以及step3.5-flash、kimi-k2.6、ernie4.5、MiniMax-M2.7、deepseek-v4、Qwen3.6、llama4、智谱GLM-5.1、MiMo-V2、LongCat、gemma4、mistral等开源大模型。不仅提供排行榜,也提供规模超200万的大模型缺陷库!方便广大社区研究分析、改进大模型。

  • 1,331+5 Elo, change today
  • 6.5k stars
  • 261 forks
git
git clone https://github.com/jeinlee1991/chinese-llm-benchmark.git
  • agentic-ai
  • artificial-intelligence
  • llm-agent
  • llm-evaluation

README

Loading README…