llm-compressor
by vllm-projectIn its repository's words: “State-of-the-art LLM compression, built for production inference with vLLM”
Facts from GitHub
- Licence
- Apache-2.0 (Apache License 2.0), permissive, our reading
- Activity
- Last push 19 Nov 2026: pushed to in the last 90 days
- Latest release
- not fetched yet
- Stars
- 4.0k
- Main language
- Python
- On GitHub since
- 20 Jun 2024
- Topics
- compression, quantization
Other tools in Quantise and convert
- bitsandbytes bitsandbytes-foundation, 8.5k stars
- mergekit arcee-ai, 7.5k stars
- Model-Optimizer NVIDIA, 5.6k stars
- AutoGPTQ AutoGPTQ, 5.1k stars
- llm-awq mit-han-lab, 3.7k stars
- optimum huggingface, 3.5k stars
Tool data from the GitHub API, fetched 19 Nov 2026, 15:36 UTC. Listing is not endorsement and nobody can pay to be listed. Something wrong here? Write to hello@weightsnotwalls.com.