Reposby Glyph
Text Generation Inference license, foundation and stars
Model serving and local AI · Apache 2.0 (open source) · backed by Hugging Face · 10,881 stars · archived
Large Language Model Text Generation Inference
License history
LICENSE fileHugging Face Optimized Inference License 1.0 to Apache 2.0
Hugging Face reverted TGI to Apache 2.0 after about nine months under HFOIL.
Apache 2.0 to Hugging Face Optimized Inference License 1.0
Hugging Face moved TGI from Apache 2.0 to its own HFOIL license restricting commercial hosted use.
Latest release
No GitHub releases published; the project releases elsewhere (tags or its own site).
More in model serving and local ai
OllamaGet up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.Ollama · +684 a week · v0.40.14, Nov 3, 2026
llama.cppLLM inference in C/C++.+655 a week · v0.5.0, Sep 23, 2026
vLLMA high-throughput and memory-efficient inference and serving engine for LLMs.PyTorch Foundation · +562 a week · v0.30.0, Sep 22, 2026
gpt4allGPT4All: Run Local LLMs on Any Device.-5 a weekwhisper.cppPort of OpenAI's Whisper model in C/C++.+160 a week
LocalAILocalAI is the open-source AI engine.+145 a week
JanJan is an open source alternative to ChatGPT that runs 100% offline on your computer.Menlo Research · +146 a week · relicensed May 2025
airllmAirLLM 2.8T LLM inference with single 4GB GPU.+1,139 a week| Project | Stars | |||
|---|---|---|---|---|
 OllamaGet up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.OllamaMIT | MIT | 186k | +684 | v0.40.14Nov 3, 2026 |
 llama.cppLLM inference in C/C++.MIT | MIT | 134k | +655 | v0.5.0Sep 23, 2026 |
 vLLMA high-throughput and memory-efficient inference and serving engine for LLMs.PyTorch FoundationApache 2.0 | Apache 2.0 | 96.6k | +562 | v0.30.0Sep 22, 2026 |
 gpt4allGPT4All: Run Local LLMs on Any Device.MIT | MIT | 77.4k | -5 | - |
| whisper.cppPort of OpenAI's Whisper model in C/C++.MIT | MIT | 55k | +160 | - |
 LocalAILocalAI is the open-source AI engine.MIT | MIT | 50.1k | +145 | - |
 JanJan is an open source alternative to ChatGPT that runs 100% offline on your computer.Menlo ResearchApache 2.0 | Apache 2.0changed May 2025 | 45.7k | +146 | - |
 airllmAirLLM 2.8T LLM inference with single 4GB GPU.Apache 2.0 | Apache 2.0 | 41.9k | +1,139 | - |
About and history
- Repository
- huggingface/text-generation-inference · created Oct 8, 2022
- Website
- hf.co/docs/text-generation-inference
- Language
- Python
- Foundation
- None; run by Hugging Face
- Company
- Hugging Face · on Companies · on Acquisitions · on awards · on blogs · on Attested · on Tier Zero · on Mainstage · on Leaders · on marketplaces · on papers · on Paydays · on Releases · on Nines · on training · on Hotlist
- GitHub detects
- Apache-2.0
- Stars per week
- -1 (GitHub weekly snapshots)
Weekly snapshots
| Week of | Stars | |
|---|---|---|
| Nov 2, 2026 | 10,881 | |
| Oct 26, 2026 | 10,880 | |
| Oct 12, 2026 | 10,878 | |
| Oct 5, 2026 | 10,880 | |
| Sep 21, 2026 | 10,885 |