web-llm
by mlc-aiIn its repository's words: “High-performance In-browser LLM Inference Engine”
Facts from GitHub
- Licence
- Apache-2.0 (Apache License 2.0), permissive, our reading
- Activity
- Last push 18 Nov 2026: pushed to in the last 90 days
- Latest release
- not fetched yet
- Stars
- 19k
- Main language
- TypeScript
- On GitHub since
- 13 Apr 2023
- Topics
- chatgpt, deep-learning, language-model, llm, tvm, webgpu, webml
What it says it supports
- Runs on
- Browser
Each item is on our list for this tool and named in its README. A mention is not a test: check the project's documentation for your setup.
Other tools in Run locally
Tool data from the GitHub API, fetched 19 Nov 2026, 15:35 UTC. Listing is not endorsement and nobody can pay to be listed. Something wrong here? Write to hello@weightsnotwalls.com.