Open source for data and AI

Projects749Relicensed100

749 projects · 100 relicensed

mlc-llm license, foundation and stars

Model serving and local AI · Apache 2.0 (open source) · 23,294 stars

GitHub

Universal LLM Deployment Engine with ML Compilation

License history

LICENSE file

Apache 2.0 No license change recorded since the repository was created in 2023.

Latest release

No GitHub releases published; the project releases elsewhere (tags or its own site).

More in model serving and local ai

MIT186k starsOllamaGet up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.Ollama · +684 a week · v0.40.14, Nov 3, 2026MIT133k starsllama.cppLLM inference in C/C++.+611 a week · v0.5.0, Sep 23, 2026Apache 2.096.6k starsvLLMA high-throughput and memory-efficient inference and serving engine for LLMs.PyTorch Foundation · +562 a week · v0.30.0, Sep 22, 2026MIT77.4k starsgpt4allGPT4All: Run Local LLMs on Any Device.-5 a weekMIT55k starswhisper.cppPort of OpenAI's Whisper model in C/C++.+160 a weekMIT50.1k starsLocalAILocalAI is the open-source AI engine.+145 a weekApache 2.045.2k starsJanJan is an open source alternative to ChatGPT that runs 100% offline on your computer.Menlo Research · +114 a week · relicensed May 2025Apache 2.041.9k starsairllmAirLLM 2.8T LLM inference with single 4GB GPU.+1,139 a week
ProjectStars
OllamaGet up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.OllamaMIT186k
llama.cppLLM inference in C/C++.MIT133k
vLLMA high-throughput and memory-efficient inference and serving engine for LLMs.PyTorch FoundationApache 2.096.6k
gpt4allGPT4All: Run Local LLMs on Any Device.MIT77.4k
whisper.cppPort of OpenAI's Whisper model in C/C++.MIT55k
LocalAILocalAI is the open-source AI engine.MIT50.1k
JanJan is an open source alternative to ChatGPT that runs 100% offline on your computer.Menlo ResearchApache 2.045.2k
airllmAirLLM 2.8T LLM inference with single 4GB GPU.Apache 2.041.9k
About and history
Repository
mlc-ai/mlc-llm · created Apr 29, 2023
Website
llm.mlc.ai
Language
Python
Foundation
None; run by its maintainers
GitHub detects
Apache-2.0
Stars per week
17 (GitHub weekly snapshots)

Weekly snapshots

Week ofStars
Nov 2, 202623,294
Oct 19, 202623,271
Oct 12, 202623,250
Sep 28, 202623,204
Sep 21, 202623,190

Changes

Stars per weekNov 2, 2026

Gains about 17 stars a week, down from 20.

Stars per weekOct 16, 2026

Gains about 20 stars a week, up from 14.

Stars per weekOct 4, 2026

Gains about 14 stars a week.

TrackedSep 25, 2026

Now tracked, from mlc-ai/mlc-llm on GitHub.