gpustack
by gpustackIn its repository's words: “A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.”
Facts from GitHub
- Licence
- Apache-2.0 (Apache License 2.0), permissive, our reading
- Activity
- Last push 19 Nov 2026: pushed to in the last 90 days
- Latest release
- not fetched yet
- Stars
- 6.1k
- Main language
- Python
- On GitHub since
- 11 May 2024
- Topics
- ascend, cuda, deepseek, distributed-inference, genai, high-performance-inference, inference, llama, llm, llm-inference, llm-serving, maas, mindie, openai, qwen, rocm, sglang, vllm
What it says it supports
- Runs on
- Linux, macOS, Windows
- Hardware
- NVIDIA, AMD
Each item is on our list for this tool and named in its README. A mention is not a test: check the project's documentation for your setup.
Other tools in Serve
Tool data from the GitHub API, fetched 19 Nov 2026, 15:35 UTC. Listing is not endorsement and nobody can pay to be listed. Something wrong here? Write to hello@weightsnotwalls.com.