Reposby Glyph
nano-vllm license, foundation and stars
Model serving and local AI · MIT (open source) · 16,274 stars
Nano vLLM
License history
LICENSE fileMIT No license change recorded since the repository was created in 2025.
Latest release
No GitHub releases published; the project releases elsewhere (tags or its own site).
More in model serving and local ai
OllamaGet up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.Ollama · +684 a week · v0.40.14, Nov 3, 2026
llama.cppLLM inference in C/C++.+611 a week · v0.5.0, Sep 23, 2026
vLLMA high-throughput and memory-efficient inference and serving engine for LLMs.PyTorch Foundation · +562 a week · v0.30.0, Sep 22, 2026
gpt4allGPT4All: Run Local LLMs on Any Device.-5 a weekwhisper.cppPort of OpenAI's Whisper model in C/C++.+160 a week
LocalAILocalAI is the open-source AI engine.+145 a week
JanJan is an open source alternative to ChatGPT that runs 100% offline on your computer.Menlo Research · +114 a week · relicensed May 2025
airllmAirLLM 2.8T LLM inference with single 4GB GPU.+1,139 a week| Project | Stars | |||
|---|---|---|---|---|
 OllamaGet up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.OllamaMIT | MIT | 186k | +684 | v0.40.14Nov 3, 2026 |
 llama.cppLLM inference in C/C++.MIT | MIT | 133k | +611 | v0.5.0Sep 23, 2026 |
 vLLMA high-throughput and memory-efficient inference and serving engine for LLMs.PyTorch FoundationApache 2.0 | Apache 2.0 | 96.6k | +562 | v0.30.0Sep 22, 2026 |
 gpt4allGPT4All: Run Local LLMs on Any Device.MIT | MIT | 77.4k | -5 | - |
| whisper.cppPort of OpenAI's Whisper model in C/C++.MIT | MIT | 55k | +160 | - |
 LocalAILocalAI is the open-source AI engine.MIT | MIT | 50.1k | +145 | - |
 JanJan is an open source alternative to ChatGPT that runs 100% offline on your computer.Menlo ResearchApache 2.0 | Apache 2.0changed May 2025 | 45.2k | +114 | - |
 airllmAirLLM 2.8T LLM inference with single 4GB GPU.Apache 2.0 | Apache 2.0 | 41.9k | +1,139 | - |
About and history
- Repository
- GeeeekExplorer/nano-vllm · created Jun 9, 2025
- Language
- Python
- Foundation
- None; run by its maintainers
- GitHub detects
- MIT
- Stars per week
- 110 (GitHub weekly snapshots)
Weekly snapshots
| Week of | Stars | |
|---|---|---|
| Nov 2, 2026 | 16,274 | |
| Oct 19, 2026 | 16,107 | |
| Oct 12, 2026 | 15,867 | |
| Sep 28, 2026 | 15,702 | |
| Sep 21, 2026 | 15,617 |