mlc-llm
by mlc-aiIn its repository's words: “Universal LLM Deployment Engine with ML Compilation”
Facts from GitHub
- Licence
- Apache-2.0 (Apache License 2.0), permissive, our reading
- Activity
- Last push 18 Nov 2026: pushed to in the last 90 days
- Latest release
- not fetched yet
- Stars
- 23k
- Main language
- Python
- On GitHub since
- 29 Apr 2023
- Topics
- language-model, llm, machine-learning-compilation, tvm
What it says it supports
- Runs on
- Linux, macOS, Android, iOS, Browser
- Hardware
- NVIDIA, AMD, Apple silicon, Intel
Each item is on our list for this tool and named in its README. A mention is not a test: check the project's documentation for your setup.
Other tools in Run locally
Tool data from the GitHub API, fetched 19 Nov 2026, 15:35 UTC. Listing is not endorsement and nobody can pay to be listed. Something wrong here? Write to hello@weightsnotwalls.com.