Skip to content
Weights Not Walls
Menu

petals

by bigscience-workshopstale

In its repository's words: “Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading”

Repository on GitHubpetals.dev

Facts from GitHub

Licence
MIT (MIT License), permissive, our reading
Activity
Last push 7 Sep 2024: no push for over a year
Latest release
not fetched yet
Stars
11k
Main language
Python
On GitHub since
12 Jun 2022
Topics
bloom, chatbot, deep-learning, distributed-systems, falcon, gpt, guanaco, language-models, large-language-models, llama, machine-learning, mixtral, neural-networks, nlp, pipeline-parallelism, pretrained-models, pytorch, tensor-parallelism, transformer, volunteer-computing

What it says it supports

Runs on
Linux, macOS

Each item is on our list for this tool and named in its README. A mention is not a test: check the project's documentation for your setup.

Other tools in Serve

All of Serve

Tool data from the GitHub API, fetched 19 Nov 2026, 15:34 UTC. Listing is not endorsement and nobody can pay to be listed. Something wrong here? Write to hello@weightsnotwalls.com.