ktransformers
by kvcache-aiIn its repository's words: “A Flexible Framework for Experiencing Heterogeneous LLM Inference/Fine-tune Optimizations”
Facts from GitHub
- Licence
- Apache-2.0 (Apache License 2.0), permissive, our reading
- Activity
- Last push 13 Nov 2026: pushed to in the last 90 days
- Latest release
- not fetched yet
- Stars
- 20k
- Main language
- Python
- On GitHub since
- 26 Jul 2024
What it says it supports
- Hardware
- CPU only
Each item is on our list for this tool and named in its README. A mention is not a test: check the project's documentation for your setup.
Other tools in Run locally
Tool data from the GitHub API, fetched 19 Nov 2026, 15:35 UTC. Listing is not endorsement and nobody can pay to be listed. Something wrong here? Write to hello@weightsnotwalls.com.