textgen
by oobaboogaIn its repository's words: “Open-source desktop app for local LLMs. Text, vision, tool-calling, OpenAI/Anthropic-compatible API. 100% private.”
Facts from GitHub
- Licence
- AGPL-3.0 (GNU Affero General Public License v3.0), copyleft, our reading
- Activity
- Last push 17 Aug 2026: no push for 90 to 365 days
- Latest release
- v4.920 May 2026
- Stars
- 48k
- Main language
- Python
- On GitHub since
- 21 Dec 2022
What it says it supports
- Loads
- GGUF, safetensors, EXL3
- Runs on
- Linux, macOS, Windows
- Hardware
- NVIDIA, AMD, Apple silicon, Intel, CPU only
Each item is on our list for this tool and named in its README. A mention is not a test: check the project's documentation for your setup.
Reviewed models it can load
Matched by file format only, from our snapshot of the Hub: GGUF where we measured GGUF files, other formats where a conversion exists, safetensors for the original weights. Support for a new architecture can lag behind its release.
GGUF 386
openai-community/gpt2, Qwen/Qwen3-0.6B, Qwen/Qwen3-14B, deepseek-ai/DeepSeek-V3.2, Qwen/Qwen3.8-27B, Qwen/Qwen3.5-9B, Qwen/Qwen2.5-7B-Instruct, zai-org/GLM-5.3-Flash, Qwen/Qwen3-VL-8B-Instruct, google/gemma-4-31B-it, Qwen/Qwen3-8B, baidu/Unlimited-OCR, and 374 more, most downloaded first
safetensors 428
openai-community/gpt2, microsoft/Florence-2-base, Qwen/Qwen3-0.6B, Qwen/Qwen3-14B, deepseek-ai/DeepSeek-V3.2, Qwen/Qwen3.8-27B, Qwen/Qwen3.5-9B, Qwen/Qwen2.5-7B-Instruct, zai-org/GLM-5.3-Flash, Qwen/Qwen3-VL-8B-Instruct, google/gemma-4-31B-it, Qwen/Qwen3-8B, and 416 more, most downloaded first
EXL3 81
Qwen/Qwen3-0.6B, zai-org/GLM-5.3-Flash, Qwen/Qwen3-VL-8B-Instruct, Qwen/Qwen3-32B, Qwen/Qwen3-VL-4B-Instruct, Qwen/Qwen3.8-Flash-Next, mistralai/Mistral-7B-Instruct-v0.3, deepseek-ai/DeepSeek-V4-Flash-0731, zai-org/GLM-5.3, google/gemma-4-12B-it, deepseek-ai/DeepSeek-V4.1-Flash, Qwen/Qwen3.5-35B-A3B, and 69 more, most downloaded first
Other tools in Run locally
Tool data from the GitHub API, fetched 19 Nov 2026, 15:44 UTC. Listing is not endorsement and nobody can pay to be listed. Something wrong here? Write to hello@weightsnotwalls.com.