Reposby Glyph
airllm license, foundation and stars
Model serving and local AI · Apache 2.0 (open source) · 41,899 stars
AirLLM 2.8T LLM inference with single 4GB GPU
License history
LICENSE fileApache 2.0 No license change recorded since the repository was created in 2023.
Latest release
No GitHub releases published; the project releases elsewhere (tags or its own site).
More in model serving and local ai
OllamaGet up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.Ollama · +684 a week · v0.40.14, Nov 3, 2026
llama.cppLLM inference in C/C++.+611 a week · v0.5.0, Sep 23, 2026
vLLMA high-throughput and memory-efficient inference and serving engine for LLMs.PyTorch Foundation · +562 a week · v0.30.0, Sep 22, 2026
gpt4allGPT4All: Run Local LLMs on Any Device.-5 a weekwhisper.cppPort of OpenAI's Whisper model in C/C++.+160 a week
LocalAILocalAI is the open-source AI engine.+145 a week
JanJan is an open source alternative to ChatGPT that runs 100% offline on your computer.Menlo Research · +114 a week · relicensed May 2025
BitNetOfficial inference framework for 1-bit LLMs.Microsoft · +193 a week| Project | Stars | |||
|---|---|---|---|---|
 OllamaGet up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.OllamaMIT | MIT | 186k | +684 | v0.40.14Nov 3, 2026 |
 llama.cppLLM inference in C/C++.MIT | MIT | 133k | +611 | v0.5.0Sep 23, 2026 |
 vLLMA high-throughput and memory-efficient inference and serving engine for LLMs.PyTorch FoundationApache 2.0 | Apache 2.0 | 96.6k | +562 | v0.30.0Sep 22, 2026 |
 gpt4allGPT4All: Run Local LLMs on Any Device.MIT | MIT | 77.4k | -5 | - |
| whisper.cppPort of OpenAI's Whisper model in C/C++.MIT | MIT | 55k | +160 | - |
 LocalAILocalAI is the open-source AI engine.MIT | MIT | 50.1k | +145 | - |
 JanJan is an open source alternative to ChatGPT that runs 100% offline on your computer.Menlo ResearchApache 2.0 | Apache 2.0changed May 2025 | 45.2k | +114 | - |
 BitNetOfficial inference framework for 1-bit LLMs.MicrosoftMIT | MIT | 41.5k | +193 | - |
About and history
- Repository
- lyogavin/airllm · created Jun 12, 2023
- Language
- Jupyter Notebook
- Foundation
- None; run by its maintainers
- GitHub detects
- Apache-2.0
- Stars per week
- 1,139 (GitHub weekly snapshots)
Weekly snapshots
| Week of | Stars | |
|---|---|---|
| Nov 2, 2026 | 41,899 | |
| Oct 26, 2026 | 41,190 | |
| Oct 19, 2026 | 39,433 | |
| Oct 5, 2026 | 35,574 | |
| Sep 21, 2026 | 35,066 |