Open source for data and AI

Projects748Relicensed100

748 projects · 100 relicensed

Apache Spark license, foundation and stars

Query and processing engines · Apache 2.0 (open source) · Apache Software Foundation · backed by Databricks · 44,428 stars

GitHub

Apache Spark - A unified analytics engine for large-scale data processing

License history

LICENSE file

Apache 2.0 No license change recorded since the repository was created in 2014.

Latest release

No GitHub releases published; the project releases elsewhere (tags or its own site).

More in query and processing engines

Custom or mixed (see the LICENSE file)62k starspathwayPython ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.-36 a weekBSD 3-Clause50.3k starspandasFlexible and powerful data analysis / manipulation library for Python, providing labeled data structures similar to R data.frame objects, statistical functions, and much more.+85 a weekMIT42.7k starsDuckDBDuckDB is a high-performance analytical database system.DuckDB Foundation · +202 a week · v1.5.5, Jul 22, 2026MIT40.3k starsPolarsExtremely fast Query Engine for DataFrames, written in Rust.Polars · +67 a week · py-1.44.2, Sep 9, 2026Apache 2.017.3k starsApache ArrowApache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics.Apache · +20 a week · apache-arrow-25.0.1, Aug 10, 2026Apache 2.016.8k starsprestoThe official home of the Presto distributed SQL query engine for big data.+5 a weekApache 2.015.7k starsApache HadoopA query and processing engine by apache, written in Java.+8 a weekApache 2.013.5k starsTrinoOfficial repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (.Starburst · +34 a week · 483, Jul 18, 2026
ProjectStars
pathwayPython ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.Custom or mixed (see the LICENSE file)62k
pandasFlexible and powerful data analysis / manipulation library for Python, providing labeled data structures similar to R data.frame objects, statistical functions, and much more.BSD 3-Clause50.3k
DuckDBDuckDB is a high-performance analytical database system.DuckDB FoundationMIT42.7k
PolarsExtremely fast Query Engine for DataFrames, written in Rust.PolarsMIT40.3k
Apache ArrowApache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics.ApacheApache 2.017.3k
prestoThe official home of the Presto distributed SQL query engine for big data.Apache 2.016.8k
Apache HadoopA query and processing engine by apache, written in Java.Apache 2.015.7k
TrinoOfficial repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (.StarburstApache 2.013.5k
About and history
Repository
apache/spark · created Feb 25, 2014
Website
spark.apache.org
Language
Scala
Foundation
Apache Software Foundation, top-level project · source
Company
Databricks · on Companies · on Acquisitions · on awards · on blogs · on certifications · on Attested · on Tier Zero · on Rounds · on Downtime · on Mainstage · on Leaders · on marketplaces · on papers · on Allied · on Paydays · on Metered · on quotes · on Footprint · on Releases · on Nines · on Stories · on TechConf · on Titlewave · on training
GitHub detects
Apache-2.0
Stars per week
65 (GitHub weekly snapshots)

Weekly snapshots

Week ofStars
Nov 2, 202644,428
Oct 26, 202644,335
Oct 12, 202644,237
Oct 5, 202644,152
Sep 21, 202644,036

Changes

Stars per weekNov 7, 2026

Gains about 65 stars a week, up from 60.

Stars per weekOct 27, 2026

Gains about 60 stars a week, down from 67.

Stars per weekOct 18, 2026

Gains about 67 stars a week, up from 58.

Stars per weekOct 9, 2026

Gains about 58 stars a week, up from 42.

TrackedSep 24, 2026

Now tracked, from apache/spark on GitHub.