helm
by stanford-crfmIn its repository's words: “Holistic Evaluation of Language Models (HELM) is an open source Python framework created by the Center for Research on Foundation Models (CRFM) at Stanford for holistic, reproducible and transparent evaluation of foundation models, including large language models (LLMs) and multimodal models.”
Facts from GitHub
- Licence
- Apache-2.0 (Apache License 2.0), permissive, our reading
- Activity
- Last push 1 Sep 2026: pushed to in the last 90 days
- Latest release
- not fetched yet
- Stars
- 3.0k
- Main language
- Python
- On GitHub since
- 29 Nov 2021
Other tools in Evaluate
- promptfoo promptfoo, 27k stars
- deepeval confident-ai, 20k stars
- lm-evaluation-harness EleutherAI, 15k stars
- garak NVIDIA, 10k stars
- opencompass open-compass, 7.6k stars
- SWE-bench SWE-bench, 6.2k stars
Tool data from the GitHub API, fetched 19 Nov 2026, 15:36 UTC. Listing is not endorsement and nobody can pay to be listed. Something wrong here? Write to hello@weightsnotwalls.com.