Open source for data and AI

Projects749Relicensed100

749 projects · 100 relicensed

server license, foundation and stars

Model serving and local AI · BSD 3-Clause (open source) · 11,128 stars

GitHub

The Triton Inference Server provides an optimized cloud and edge inferencing solution.

License history

LICENSE file

BSD 3-Clause No license change recorded since the repository was created in 2018.

Latest release

No GitHub releases published; the project releases elsewhere (tags or its own site).

More in model serving and local ai

MIT186k starsOllamaGet up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.Ollama · +684 a week · v0.40.14, Nov 3, 2026MIT133k starsllama.cppLLM inference in C/C++.+611 a week · v0.5.0, Sep 23, 2026Apache 2.096.6k starsvLLMA high-throughput and memory-efficient inference and serving engine for LLMs.PyTorch Foundation · +562 a week · v0.30.0, Sep 22, 2026MIT77.4k starsgpt4allGPT4All: Run Local LLMs on Any Device.-5 a weekMIT55k starswhisper.cppPort of OpenAI's Whisper model in C/C++.+160 a weekMIT50.1k starsLocalAILocalAI is the open-source AI engine.+145 a weekApache 2.045.2k starsJanJan is an open source alternative to ChatGPT that runs 100% offline on your computer.Menlo Research · +114 a week · relicensed May 2025Apache 2.041.9k starsairllmAirLLM 2.8T LLM inference with single 4GB GPU.+1,139 a week
ProjectStars
OllamaGet up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.OllamaMIT186k
llama.cppLLM inference in C/C++.MIT133k
vLLMA high-throughput and memory-efficient inference and serving engine for LLMs.PyTorch FoundationApache 2.096.6k
gpt4allGPT4All: Run Local LLMs on Any Device.MIT77.4k
whisper.cppPort of OpenAI's Whisper model in C/C++.MIT55k
LocalAILocalAI is the open-source AI engine.MIT50.1k
JanJan is an open source alternative to ChatGPT that runs 100% offline on your computer.Menlo ResearchApache 2.045.2k
airllmAirLLM 2.8T LLM inference with single 4GB GPU.Apache 2.041.9k
About and history
Repository
triton-inference-server/server · created Oct 4, 2018
Website
docs.nvidia.com/deeplearning/triton-inference-server/user-guide/docs/index.html
Language
Python
Foundation
None; run by its maintainers
GitHub detects
BSD-3-Clause
Stars per week
19 (GitHub weekly snapshots)

Weekly snapshots

Week ofStars
Nov 2, 202611,128
Oct 26, 202611,115
Oct 12, 202611,095
Oct 5, 202611,059
Sep 21, 202611,013

Changes

Stars per weekNov 5, 2026

Gains about 19 stars a week, down from 20.

Stars per weekOct 27, 2026

Gains about 20 stars a week, down from 27.

Stars per weekOct 18, 2026

Gains about 27 stars a week, up from 23.

Stars per weekOct 9, 2026

Gains about 23 stars a week.

TrackedSep 25, 2026

Now tracked, from triton-inference-server/server on GitHub.