Skip to content
Weights Not Walls
Menu

ktransformers

by kvcache-ai

In its repository's words: “A Flexible Framework for Experiencing Heterogeneous LLM Inference/Fine-tune Optimizations”

Repository on GitHubkvcache-ai.github.io/ktransformers

Facts from GitHub

Licence
Apache-2.0 (Apache License 2.0), permissive, our reading
Activity
Last push 13 Nov 2026: pushed to in the last 90 days
Latest release
not fetched yet
Stars
20k
Main language
Python
On GitHub since
26 Jul 2024

What it says it supports

Hardware
CPU only

Each item is on our list for this tool and named in its README. A mention is not a test: check the project's documentation for your setup.

Other tools in Run locally

All of Run locally

Tool data from the GitHub API, fetched 19 Nov 2026, 15:35 UTC. Listing is not endorsement and nobody can pay to be listed. Something wrong here? Write to hello@weightsnotwalls.com.