petals
by bigscience-workshopstaleIn its repository's words: “Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading”
Facts from GitHub
- Licence
- MIT (MIT License), permissive, our reading
- Activity
- Last push 7 Sep 2024: no push for over a year
- Latest release
- not fetched yet
- Stars
- 11k
- Main language
- Python
- On GitHub since
- 12 Jun 2022
- Topics
- bloom, chatbot, deep-learning, distributed-systems, falcon, gpt, guanaco, language-models, large-language-models, llama, machine-learning, mixtral, neural-networks, nlp, pipeline-parallelism, pretrained-models, pytorch, tensor-parallelism, transformer, volunteer-computing
What it says it supports
- Runs on
- Linux, macOS
Each item is on our list for this tool and named in its README. A mention is not a test: check the project's documentation for your setup.
Other tools in Serve
Tool data from the GitHub API, fetched 19 Nov 2026, 15:34 UTC. Listing is not endorsement and nobody can pay to be listed. Something wrong here? Write to hello@weightsnotwalls.com.