Skip to content

Text Generation Inference license, foundation and stars

Model serving and local AI · Apache 2.0 (open source) · backed by Hugging Face · 10,885 stars · archived

GitHub

Large Language Model Text Generation Inference

License history

LICENSE file
Change
Hugging Face Optimized Inference License 1.0 to Apache 2.0Hugging Face reverted TGI to Apache 2.0 after about nine months under HFOIL.LICENSE commitAnnouncement
Apache 2.0 to Hugging Face Optimized Inference License 1.0Hugging Face moved TGI from Apache 2.0 to its own HFOIL license restricting commercial hosted use.LICENSE commitAnnouncement

Latest release

No GitHub releases published; the project releases elsewhere (tags or its own site).

ProjectStars
OllamaOllamaMIT182k
llama.cppMIT129k
vLLMPyTorch FoundationApache 2.092.7k
gpt4allMIT77.4k
whisper.cppMIT53.9k
LocalAIMIT49.3k
JanMenlo ResearchApache 2.044.6k
BitNetMicrosoftMIT40.3k
About and history
Repository
huggingface/text-generation-inference · created Oct 8, 2022
Website
hf.co/docs/text-generation-inference
Language
Python
Foundation
None; run by Hugging Face
Company
Hugging Face · on Companies · on Acquisitions · on awards · on blogs · on Attested · on Tier Zero · on Mainstage · on Leaders · on marketplaces · on papers · on Paydays · on Releases · on Nines · on training · on Hotlist
GitHub detects
Apache-2.0
Stars per week
From the second weekly snapshot

Weekly snapshots

Week ofStars
Sep 21, 202610,885

Changes

What changed
RelicensedHugging Face Optimized Inference License 1.0 to Apache 2.0
RelicensedApache 2.0 to Hugging Face Optimized Inference License 1.0
TrackedAdded: huggingface/text-generation-inference

License changes by email

Only when a tracked project changes its license, foundation or name, at most once a week.

Double opt-in. Unsubscribe any time.