luigi license, foundation and stars

Pipelines and orchestration · Apache 2.0 (open source) · 18,783 stars

GitHubSuggest a correction

Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.

More in pipelines and orchestration

n8n Sustainable Use License 1.0209k starsn8nFair-code workflow automation platform with native AI capabilities.n8n · +587 a week · relicensed Mar 2022AGPL v3200k starsfirecrawlSupercharge your AI agents with data from the web and beyond.+2,266 a weekBSD 3-Clause97.4k starsScraplingThe BEST Web Scraping framework that handles everything from a single request to a full-scale crawl!+2,308 a weekApache 2.047.4k starsApache AirflowApache Airflow - A platform to programmatically author, schedule, and monitor workflows.Apache · +70 a week · 3.3.2, Sep 17, 2026MIT32.5k starsScrapegraph-aiPython scraper based on AI.+207 a weekApache 2.032.4k starsconductorConductor is an event driven agentic workflow engine providing durable and highly resilient execution engine for applications and AI Agents.+32 a weekApache 2.030.2k starsopendataloader-pdfPDF Parser for AI-ready data.+132 a weekApache 2.030.1k starskestraOrchestrate everything, everywhere.+351 a week · v2.0.7, Oct 20, 2026

Project	License	Stars	Per week	Latest release
n8nFair-code workflow automation platform with native AI capabilities.n8nn8n Sustainable Use License 1.0	n8n Sustainable Use License 1.0changed Mar 2022	209k	+587	-
firecrawlSupercharge your AI agents with data from the web and beyond.AGPL v3	AGPL v3	200k	+2,266	-
ScraplingThe BEST Web Scraping framework that handles everything from a single request to a full-scale crawl!BSD 3-Clause	BSD 3-Clause	97.4k	+2,308	-
Apache AirflowApache Airflow - A platform to programmatically author, schedule, and monitor workflows.ApacheApache 2.0	Apache 2.0	47.4k	+70	3.3.2Sep 17, 2026
Scrapegraph-aiPython scraper based on AI.MIT	MIT	32.5k	+207	-
conductorConductor is an event driven agentic workflow engine providing durable and highly resilient execution engine for applications and AI Agents.Apache 2.0	Apache 2.0	32.4k	+32	-
opendataloader-pdfPDF Parser for AI-ready data.Apache 2.0	Apache 2.0	30.2k	+132	-
kestraOrchestrate everything, everywhere.Apache 2.0	Apache 2.0	30.1k	+351	v2.0.7Oct 20, 2026