VLMEvalKit
by open-compassIn its repository's words: “Open-source evaluation toolkit of large multi-modality models (LMMs), support 220+ LMMs, 80+ benchmarks”
Repository on GitHubhuggingface.co/spaces/opencompass/open_vlm_leaderboard
Facts from GitHub
- Licence
- Apache-2.0 (Apache License 2.0), permissive, our reading
- Activity
- Last push 19 Nov 2026: pushed to in the last 90 days
- Latest release
- not fetched yet
- Stars
- 4.5k
- Main language
- Python
- On GitHub since
- 1 Dec 2023
- Topics
- chatgpt, claude, clip, computer-vision, evaluation, gemini, gpt, gpt-4v, gpt4, large-language-models, llava, llm, multi-modal, openai, openai-api, pytorch, qwen, vit, vqa
Other tools in Evaluate
- promptfoo promptfoo, 27k stars
- deepeval confident-ai, 20k stars
- lm-evaluation-harness EleutherAI, 15k stars
- garak NVIDIA, 10k stars
- opencompass open-compass, 7.6k stars
- SWE-bench SWE-bench, 6.2k stars
Tool data from the GitHub API, fetched 19 Nov 2026, 15:35 UTC. Listing is not endorsement and nobody can pay to be listed. Something wrong here? Write to hello@weightsnotwalls.com.