Reposby Glyph
FasterTransformer license, foundation and stars
Model serving and local AI · Apache 2.0 (open source) · backed by Nvidia · 6,459 stars
Transformer related optimization, including BERT, GPT
License history
LICENSE fileApache 2.0 No license change recorded since the repository was created in 2021.
Latest release
release/v5.3_tag published Jan 23, 2023
More in model serving and local ai
OllamaGet up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.Ollama · +684 a week · v0.40.14, Nov 3, 2026
llama.cppLLM inference in C/C++.+611 a week · v0.5.0, Sep 23, 2026
vLLMA high-throughput and memory-efficient inference and serving engine for LLMs.PyTorch Foundation · +562 a week · v0.30.0, Sep 22, 2026
gpt4allGPT4All: Run Local LLMs on Any Device.-5 a weekwhisper.cppPort of OpenAI's Whisper model in C/C++.+160 a week
LocalAILocalAI is the open-source AI engine.+145 a week
JanJan is an open source alternative to ChatGPT that runs 100% offline on your computer.Menlo Research · +114 a week · relicensed May 2025
airllmAirLLM 2.8T LLM inference with single 4GB GPU.+1,139 a week| Project | Stars | |||
|---|---|---|---|---|
 OllamaGet up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.OllamaMIT | MIT | 186k | +684 | v0.40.14Nov 3, 2026 |
 llama.cppLLM inference in C/C++.MIT | MIT | 133k | +611 | v0.5.0Sep 23, 2026 |
 vLLMA high-throughput and memory-efficient inference and serving engine for LLMs.PyTorch FoundationApache 2.0 | Apache 2.0 | 96.6k | +562 | v0.30.0Sep 22, 2026 |
 gpt4allGPT4All: Run Local LLMs on Any Device.MIT | MIT | 77.4k | -5 | - |
| whisper.cppPort of OpenAI's Whisper model in C/C++.MIT | MIT | 55k | +160 | - |
 LocalAILocalAI is the open-source AI engine.MIT | MIT | 50.1k | +145 | - |
 JanJan is an open source alternative to ChatGPT that runs 100% offline on your computer.Menlo ResearchApache 2.0 | Apache 2.0changed May 2025 | 45.2k | +114 | - |
 airllmAirLLM 2.8T LLM inference with single 4GB GPU.Apache 2.0 | Apache 2.0 | 41.9k | +1,139 | - |
About and history
- Repository
- NVIDIA/FasterTransformer · created Apr 2, 2021
- Language
- C++
- Foundation
- None; run by Nvidia
- Company
- Nvidia · on Companies · on Acquisitions · on awards · on blogs · on certifications · on Quarterly · on Mainstage · on Leaders · on Arena · on marketplaces · on papers · on Allied · on Paydays · on predictions · on quotes · on Releases · on TechConf · on training · on Hotlist
- GitHub detects
- Apache-2.0
- Stars per week
- 1 (GitHub weekly snapshots)
Weekly snapshots
| Week of | Stars | |
|---|---|---|
| Nov 9, 2026 | 6,459 | |
| Oct 26, 2026 | 6,458 | |
| Oct 19, 2026 | 6,458 | |
| Oct 12, 2026 | 6,455 | |
| Sep 28, 2026 | 6,457 | |
| Sep 21, 2026 | 6,451 |