alpaca_eval
by tatsu-labstaleIn its repository's words: “An automatic evaluator for instruction-following language models. Human-validated, high-quality, cheap, and fast.”
Facts from GitHub
- Licence
- Apache-2.0 (Apache License 2.0), permissive, our reading
- Activity
- Last push 9 Aug 2025: no push for over a year
- Latest release
- not fetched yet
- Stars
- 2.0k
- Main language
- Jupyter Notebook
- On GitHub since
- 25 May 2023
- Topics
- deep-learning, evaluation, foundation-models, instruction-following, large-language-models, leaderboard, nlp, rlhf
Other tools in Evaluate
- promptfoo promptfoo, 27k stars
- deepeval confident-ai, 20k stars
- lm-evaluation-harness EleutherAI, 15k stars
- garak NVIDIA, 10k stars
- opencompass open-compass, 7.6k stars
- SWE-bench SWE-bench, 6.2k stars
Tool data from the GitHub API, fetched 19 Nov 2026, 15:36 UTC. Listing is not endorsement and nobody can pay to be listed. Something wrong here? Write to hello@weightsnotwalls.com.