lm-evaluation-harness
by EleutherAIIn its repository's words: “A framework for few-shot evaluation of language models.”
Facts from GitHub
- Licence
- MIT (MIT License), permissive, our reading
- Activity
- Last push 4 Nov 2026: pushed to in the last 90 days
- Latest release
- not fetched yet
- Stars
- 15k
- Main language
- Python
- On GitHub since
- 28 Aug 2020
- Topics
- evaluation-framework, language-model, transformer
Other tools in Evaluate
- promptfoo promptfoo, 27k stars
- deepeval confident-ai, 20k stars
- garak NVIDIA, 10k stars
- opencompass open-compass, 7.6k stars
- SWE-bench SWE-bench, 6.2k stars
- simple-evals openai, 4.7k stars
Tool data from the GitHub API, fetched 19 Nov 2026, 15:34 UTC. Listing is not endorsement and nobody can pay to be listed. Something wrong here? Write to hello@weightsnotwalls.com.