Open-source data and AI projects

Open-source projects under the data and AI stack: engines (DuckDB, Spark, Flink, Trino, Polars), table formats (Iceberg, Delta Lake, Hudi), Kafka, pipelines (Airflow, dbt, Dagster, n8n), databases (ClickHouse, Redis, Valkey, MongoDB, CockroachDB), search and vector (Elasticsearch, OpenSearch, Milvus, Qdrant), infrastructure (Terraform, OpenTofu, Vault, MinIO), model serving (vLLM, SGLang, llama.cpp, Ollama), frameworks (PyTorch, JAX, Transformers, Ray, LangChain), agents and image generation, and BI (Superset, Metabase). A daily run adds new ones from OSS Insight collections, foundation lists, GitHub topics and the GitHub organisations of companies in the companies.fru.dev registry; the aim is every data and AI project with 10,000 or more stars, and every relicensed one.

Elasticsearch (Apache 2.0 to SSPL or the Elastic License in 2021, AGPL added in 2024), Redis (BSD to RSAL or SSPL in 2024, AGPL added in 2025), Terraform and Vault (MPL 2.0 to the Business Source License in 2023), CockroachDB (to the BSL in 2019, to the CockroachDB Software License in 2024), MongoDB (AGPL to SSPL in 2018), MinIO (Apache 2.0 to AGPL in 2021) and Airbyte (MIT to the Elastic License, 2021 and 2025). Each change links to the commit that changed the LICENSE file.

OpenSearch (from Elasticsearch 7.10.2, 2021), OpenTofu (from Terraform, 2023), OpenBao (from Vault, 2023) and Valkey (from Redis 7.2.4, 2024). Each now lives at a foundation.

Open source here means at least one of the licenses offered is approved by the Open Source Initiative (MIT, Apache 2.0, BSD, MPL, AGPL and so on). Source-available licenses such as the Business Source License, SSPL, the Elastic License or RSAL publish the code but limit how it can be used, typically offering it as a service.

From weekly snapshots of GitHub star counts: stars added between two readings at least six days apart, per week. Until two snapshots exist, the figure comes from OSS Insight's weekly star history for the three weeks to September 21, 2026, and is labelled as such.

Yes. There is a public JSON API with an OpenAPI spec, llms.txt for language models, and a For AI agents page with copy-paste examples. Please cite Repos (repos.fru.dev).

Every project page has Suggest a correction, and the listing pages have Suggest a missing project. Each suggestion is checked against the source before anything changes.