Skip to content
Weights Not Walls
Menu

GPTQModel

by ModelCloud

In its repository's words: “LLM model quantization (compression) toolkit with HW acceleration support for Nvidia CUDA, AMD ROCm, Intel XPU, Tenstorrent, Huawei Ascent NPU, and Intel/AMD/Apple CPU via HF, vLLM, and SGLang.”

Repository on GitHubx.com/Qubitium

Facts from GitHub

Licence
Apache-2.0 (Apache License 2.0), permissive, our readingGitHub's licence detection could not identify the licence file, so we read the file on 19 Nov 2026: The Apache License 2.0 text with an SPDX header.
Activity
Last push 19 Nov 2026: pushed to in the last 90 days
Latest release
not fetched yet
Stars
1.3k
Main language
Python
On GitHub since
17 Jun 2024
Topics
cuda, gptq, metal, mlx, npu, optimum, peft, quantization, rocm, sglang, tenstorrent, transformers, vllm, xla, xpu

Other tools in Quantise and convert

All of Quantise and convert

Tool data from the GitHub API, fetched 19 Nov 2026, 15:35 UTC. Listing is not endorsement and nobody can pay to be listed. Something wrong here? Write to hello@weightsnotwalls.com.