Open source for data and AI

Projects749Relicensed100

749 projects · 100 relicensed

evals license, foundation and stars

ML frameworks · Custom or mixed (see the LICENSE file) (source-available) · backed by OpenAI · 19,724 stars

GitHub

Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.

License history

LICENSE file

Custom or mixed (see the LICENSE file) No license change recorded since the repository was created in 2023.

Latest release

No GitHub releases published; the project releases elsewhere (tags or its own site).

More in ml frameworks

Apache 2.0201k starsTensorFlowAn Open Source Machine Learning Framework for Everyone.Google · +180 a week · v2.21.0, Mar 6, 2026Apache 2.0169k starsTransformersTransformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.Hugging Face · +337 a week · v5.17.0, Sep 9, 2026MIT112k starswhisperRobust Speech Recognition via Large-Scale Weak Supervision.OpenAI · +387 a weekBSD-style105k starsPyTorchTensors and Dynamic neural networks in Python with strong GPU acceleration.PyTorch Foundation · +311 a week · v2.14.0, Sep 2, 2026Apache 2.092.2k starsPaddleOCRTurn any PDF or image document into structured data for your AI.+333 a weekApache 2.091.4k starsopencvOpen Source Computer Vision Library.+77 a weekApache 2.079.2k starsunslothLocal UI to run and train LLMs and diffusion models.+407 a weekApache 2.077.4k starstesseractA machine learning library by tesseract-ocr, written in C++.+122 a week
ProjectStars
TensorFlowAn Open Source Machine Learning Framework for Everyone.GoogleApache 2.0201k
TransformersTransformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.Hugging FaceApache 2.0169k
whisperRobust Speech Recognition via Large-Scale Weak Supervision.OpenAIMIT112k
PyTorchTensors and Dynamic neural networks in Python with strong GPU acceleration.PyTorch FoundationBSD-style105k
PaddleOCRTurn any PDF or image document into structured data for your AI.Apache 2.092.2k
opencvOpen Source Computer Vision Library.Apache 2.091.4k
unslothLocal UI to run and train LLMs and diffusion models.Apache 2.079.2k
tesseractA machine learning library by tesseract-ocr, written in C++.Apache 2.077.4k
About and history
Repository
openai/evals · created Jan 23, 2023
Language
Python
Foundation
None; run by OpenAI
Company
OpenAI · on Companies · on Acquisitions · on awards · on blogs · on Attested · on Downtime · on Mainstage · on Leaders · on Arena · on papers · on Allied · on Paydays · on predictions · on Metered · on quotes · on Releases · on Nines · on TechConf · on Titlewave · on training · on Hotlist
GitHub detects
NOASSERTION (a custom or multi-license file; the license above is read from the file itself)
Stars per week
31 (GitHub weekly snapshots)

Weekly snapshots

Week ofStars
Nov 9, 202619,724
Oct 26, 202619,683
Oct 19, 202619,625
Oct 12, 202619,597
Sep 28, 202619,516
Sep 21, 202619,505

Changes

Stars per weekNov 10, 2026

Gains about 31 stars a week, down from 36.

Stars per weekOct 31, 2026

Gains about 36 stars a week, up from 30.

Stars per weekOct 21, 2026

Gains about 30 stars a week, down from 31.

Stars per weekOct 13, 2026

Gains about 31 stars a week, up from 11.

Stars per weekSep 28, 2026

Gains about 11 stars a week.

TrackedSep 25, 2026

Now tracked, from openai/evals on GitHub.