Reposby Glyph
RedPajama-Data license, foundation and stars
ML frameworks · Apache 2.0 (open source) · backed by Together AI · 4,998 stars
GitHubUnverified
The RedPajama-Data repository contains code for preparing large datasets for training large language models.
License history
LICENSE fileApache 2.0 No license change recorded since the repository was created in 2023.
Latest release
No GitHub releases published; the project releases elsewhere (tags or its own site).
More in ml frameworks
TensorFlowAn Open Source Machine Learning Framework for Everyone.Google · +198 a week · v2.21.0, Mar 6, 2026
TransformersTransformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.Hugging Face · +341 a week · v5.17.0, Sep 9, 2026
whisperRobust Speech Recognition via Large-Scale Weak Supervision.OpenAI · +401 a week
PyTorchTensors and Dynamic neural networks in Python with strong GPU acceleration.PyTorch Foundation · +360 a week · v2.14.0, Sep 2, 2026
PaddleOCRTurn any PDF or image document into structured data for your AI.+353 a week
opencvOpen Source Computer Vision Library.+90 a week
unslothLocal UI to run and train LLMs and diffusion models.+400 a week
tesseractA machine learning library by tesseract-ocr, written in C++.+104 a week| Project | Stars | |||
|---|---|---|---|---|
 TensorFlowAn Open Source Machine Learning Framework for Everyone.GoogleApache 2.0 | Apache 2.0 | 201k | +198 | v2.21.0Mar 6, 2026 |
 TransformersTransformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.Hugging FaceApache 2.0 | Apache 2.0 | 168k | +341 | v5.17.0Sep 9, 2026 |
 whisperRobust Speech Recognition via Large-Scale Weak Supervision.OpenAIMIT | MIT | 112k | +401 | - |
 PyTorchTensors and Dynamic neural networks in Python with strong GPU acceleration.PyTorch FoundationBSD-style | BSD-style | 105k | +360 | v2.14.0Sep 2, 2026 |
 PaddleOCRTurn any PDF or image document into structured data for your AI.Apache 2.0 | Apache 2.0 | 91.6k | +353 | - |
 opencvOpen Source Computer Vision Library.Apache 2.0 | Apache 2.0 | 91.3k | +90 | - |
 unslothLocal UI to run and train LLMs and diffusion models.Apache 2.0 | Apache 2.0 | 78.7k | +400 | - |
 tesseractA machine learning library by tesseract-ocr, written in C++.Apache 2.0 | Apache 2.0 | 77.2k | +104 | - |
About and history
- Repository
- togethercomputer/RedPajama-Data · created Apr 14, 2023
- Language
- Python
- Foundation
- None; run by Together AI
- Company
- Together AI · on Companies · on awards · on blogs · on calendar · on Attested · on compute · on Tier Zero · on Rounds · on labs · on lawsuits · on Leaders · on Paydays · on Metered · on problems · on Releases · on salaries · on socials · on standards · on sunsets · on terms · on Titlewave
- GitHub detects
- Apache-2.0
- Stars per week
- From the second weekly snapshot
Weekly snapshots
| Week of | Stars | |
|---|---|---|
| Oct 26, 2026 | 4,998 |