Apache Beam license, foundation and stars

Query and processing engines · Apache 2.0 (open source) · 8,712 stars

Apache Beam is a unified programming model for Batch and Streaming data processing.

License history

Apache 2.0 No license change recorded since the repository was created in 2016.

No GitHub releases published; the project releases elsewhere (tags or its own site).

Project	License	Stars	Per week	Latest release
pathwayPython ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.Custom or mixed (see the LICENSE file)	Custom or mixed (see the LICENSE file)	62k	-36	-
pandasFlexible and powerful data analysis / manipulation library for Python, providing labeled data structures similar to R data.frame objects, statistical functions, and much more.BSD 3-Clause	BSD 3-Clause	50.3k	+85	-
Apache SparkApache Spark - A unified analytics engine for large-scale data processing.ApacheApache 2.0	Apache 2.0	44.4k	+65	-
DuckDBDuckDB is a high-performance analytical database system.DuckDB FoundationMIT	MIT	43k	+180	v1.5.5Jul 22, 2026
PolarsExtremely fast Query Engine for DataFrames, written in Rust.PolarsMIT	MIT	40.3k	+67	py-1.44.2Sep 9, 2026
Apache ArrowApache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics.ApacheApache 2.0	Apache 2.0	17.3k	+20	apache-arrow-25.0.1Aug 10, 2026
prestoThe official home of the Presto distributed SQL query engine for big data.Apache 2.0	Apache 2.0	16.8k	+5	-
Apache HadoopA query and processing engine by apache, written in Java.Apache 2.0	Apache 2.0	15.7k	+8	-