Skip to content
Weights Not Walls
Menu

gpustack

by gpustack

In its repository's words: “A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.”

Repository on GitHubgpustack.ai

Facts from GitHub

Licence
Apache-2.0 (Apache License 2.0), permissive, our reading
Activity
Last push 19 Nov 2026: pushed to in the last 90 days
Latest release
not fetched yet
Stars
6.1k
Main language
Python
On GitHub since
11 May 2024
Topics
ascend, cuda, deepseek, distributed-inference, genai, high-performance-inference, inference, llama, llm, llm-inference, llm-serving, maas, mindie, openai, qwen, rocm, sglang, vllm

What it says it supports

Runs on
Linux, macOS, Windows
Hardware
NVIDIA, AMD

Each item is on our list for this tool and named in its README. A mention is not a test: check the project's documentation for your setup.

Other tools in Serve

All of Serve

Tool data from the GitHub API, fetched 19 Nov 2026, 15:35 UTC. Listing is not endorsement and nobody can pay to be listed. Something wrong here? Write to hello@weightsnotwalls.com.