Skip to content
Weights Not Walls
Menu

distributed-llama

by b4rtaz

In its repository's words: “Distributed LLM inference. Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.”

Repository on GitHub

Facts from GitHub

Licence
MIT (MIT License), permissive, our reading
Activity
Last push 17 Nov 2026: pushed to in the last 90 days
Latest release
not fetched yet
Stars
3.1k
Main language
C++
On GitHub since
4 Dec 2023
Topics
distributed-computing, distributed-llm, llama2, llama3, llm, llm-inference, llms, neural-network, open-llm

What it says it supports

Runs on
Linux, macOS, Windows
Hardware
CPU only

Each item is on our list for this tool and named in its README. A mention is not a test: check the project's documentation for your setup.

Other tools in Run locally

All of Run locally

Tool data from the GitHub API, fetched 19 Nov 2026, 15:34 UTC. Listing is not endorsement and nobody can pay to be listed. Something wrong here? Write to hello@weightsnotwalls.com.