GPTQModel
by ModelCloudIn its repository's words: “LLM model quantization (compression) toolkit with HW acceleration support for Nvidia CUDA, AMD ROCm, Intel XPU, Tenstorrent, Huawei Ascent NPU, and Intel/AMD/Apple CPU via HF, vLLM, and SGLang.”
Facts from GitHub
- Licence
- Apache-2.0 (Apache License 2.0), permissive, our readingGitHub's licence detection could not identify the licence file, so we read the file on 19 Nov 2026: The Apache License 2.0 text with an SPDX header.
- Activity
- Last push 19 Nov 2026: pushed to in the last 90 days
- Latest release
- not fetched yet
- Stars
- 1.3k
- Main language
- Python
- On GitHub since
- 17 Jun 2024
- Topics
- cuda, gptq, metal, mlx, npu, optimum, peft, quantization, rocm, sglang, tenstorrent, transformers, vllm, xla, xpu
Other tools in Quantise and convert
- bitsandbytes bitsandbytes-foundation, 8.5k stars
- mergekit arcee-ai, 7.5k stars
- Model-Optimizer NVIDIA, 5.6k stars
- AutoGPTQ AutoGPTQ, 5.1k stars
- llm-compressor vllm-project, 4.0k stars
- llm-awq mit-han-lab, 3.7k stars
Tool data from the GitHub API, fetched 19 Nov 2026, 15:35 UTC. Listing is not endorsement and nobody can pay to be listed. Something wrong here? Write to hello@weightsnotwalls.com.