distributed-llama
by b4rtazIn its repository's words: “Distributed LLM inference. Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.”
Facts from GitHub
- Licence
- MIT (MIT License), permissive, our reading
- Activity
- Last push 17 Nov 2026: pushed to in the last 90 days
- Latest release
- not fetched yet
- Stars
- 3.1k
- Main language
- C++
- On GitHub since
- 4 Dec 2023
- Topics
- distributed-computing, distributed-llm, llama2, llama3, llm, llm-inference, llms, neural-network, open-llm
What it says it supports
- Runs on
- Linux, macOS, Windows
- Hardware
- CPU only
Each item is on our list for this tool and named in its README. A mention is not a test: check the project's documentation for your setup.
Other tools in Run locally
Tool data from the GitHub API, fetched 19 Nov 2026, 15:34 UTC. Listing is not endorsement and nobody can pay to be listed. Something wrong here? Write to hello@weightsnotwalls.com.