Statistics for topic etl

RepositoryStats tracks 603,442 Github repositories, of these 268 are tagged with the etl topic. The most common primary language for repositories using this topic is Python (93). Other languages include: Go (40),  Java (32),  TypeScript (13),  Rust (12),  JavaScript (11),  Scala (11)

Stargazers over time for topic etl

Most starred repositories for topic etl (view more)

apache
airflow apache
14.5k
38.3k
apache-2.0
766
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
dag elt etl mlops apache python airflow workflow scheduler automation data-science orchestration apache-airflow data-pipelines workflow-engine data-engineering data-integration machine-learning data-orchestrator workflow-orchestration
Created 2015-04-13
27,629 commits to main branch, last one 11 hours ago
airbytehq
airbyte airbytehq
4.2k
16.9k
other
186
The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.
s3 elt etl data java mssql mysql python bigquery pipeline redshift snowflake postgresql self-hosted data-analysis data-pipeline data-collection data-engineering data-integration change-data-capture
Created 2020-07-27
25,605 commits to master branch, last one 12 hours ago
apache
doris apache
3.3k
13.0k
apache-2.0
287
Apache Doris is an easy-to-use, high performance and unified analytics database.
dbt elt etl sql hive hudi olap spark hadoop iceberg bigquery database redshift lakehouse real-time snowflake delta-lake query-engine
Created 2017-08-10
24,020 commits to master branch, last one 4 hours ago
pathwaycom
pathway pathwaycom
278
12.4k
other
43
Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
etl rust kafka python pathway dataflow real-time streaming etl-framework iot-analytics data-analytics data-pipelines data-processing batch-processing stream-processing time-series-analysis machine-learning-algorithms
Created 2022-11-27
990 commits to main branch, last one a day ago
dagster-io
dagster dagster-io
1.5k
12.2k
apache-2.0
125
An orchestration platform for the development, production, and observation of data assets.
etl mlops python dagster metadata workflow analytics scheduler data-science orchestration data-pipelines data-engineering data-integration data-orchestrator workflow-automation
Created 2018-04-30
21,783 commits to master branch, last one 5 hours ago
redpanda-data
connect redpanda-data
847
8.2k
unknown
120
Fancy stream processing made operationally mundane
go etl amqp cqrs logs nats kafka golang data-ops rabbitmq message-bus message-queue event-sourcing streaming-data data-engineering stream-processor stream-processing
Created 2016-03-22
5,873 commits to main branch, last one a day ago

Trending repositories for topic etl (view more)

Last 3 days (new repositories)
no newly created repositories trending in the last 3 days
Last 3 days (absolute gain)
apache
apache/airflow

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

38,255 (+28)
apache-2.0
chonkie-ai
chonkie-ai/chonkie

🦛 CHONK your texts with Chonkie ✨ - The no-nonsense RAG chunking library

2,224 (+12)
mit
dagster-io
dagster-io/dagster

An orchestration platform for the development, production, and observation of data assets.

12,250 (+11)
apache-2.0
risingwavelabs
risingwavelabs/risingwave

Best-in-class stream processing, analytics, and management. Perform continuous analytics, or build event-driven applications, real-time ETL pipelines, and feature stores in minutes. Unified streaming ...

7,252 (+9)
apache-2.0
pathwaycom
pathwaycom/pathway

Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

12,387 (+6)
Last 3 days (relative gain)
mattlianje
mattlianje/etl4s

Powerful, whiteboard-style ETL

26 (+8%)
gpl-3.0
datazip-inc
datazip-inc/olake

Fastest open-source tool for replicating Databases to Apache Iceberg or Data Lakehouse. ⚡ Efficient, quick and scalable data ingestion for real-time analytics. Starting with MongoDB

88 (+4%)
apache-2.0
pracdata
pracdata/awesome-open-source-data-engineering

A curated list of open source tools used in analytics platforms and data engineering ecosystem

174 (+2%)
ebonnal
ebonnal/streamable

Pythonic Stream-like manipulation of iterables.

208 (+2%)
apache-2.0
apecloud
apecloud/ape-dts

Ape Data Transfer Suite, written in Rust. Provides ultra-fast data replication between MySQL, PostgreSQL, Redis, MongoDB, Kafka and ClickHouse, ideal for disaster recovery (DR) and migration scenarios...

281 (+1%)
agpl-3.0
Last week (new repositories)
no newly created repositories trending in the last week
Last week (absolute gain)
airbytehq
airbytehq/airbyte

The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.

16,865 (+178)
pathwaycom
pathwaycom/pathway

Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

12,387 (+92)
apache
apache/airflow

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

38,255 (+82)
apache-2.0
dagster-io
dagster-io/dagster

An orchestration platform for the development, production, and observation of data assets.

12,250 (+48)
apache-2.0
chonkie-ai
chonkie-ai/chonkie

🦛 CHONK your texts with Chonkie ✨ - The no-nonsense RAG chunking library

2,224 (+34)
mit
Last week (relative gain)
mattlianje
mattlianje/etl4s

Powerful, whiteboard-style ETL

26 (+73%)
gpl-3.0
datazip-inc
datazip-inc/olake

Fastest open-source tool for replicating Databases to Apache Iceberg or Data Lakehouse. ⚡ Efficient, quick and scalable data ingestion for real-time analytics. Starting with MongoDB

88 (+13%)
apache-2.0
turbot
turbot/steampipe-plugin-github

Use SQL to instantly query repositories, users, gists and more from GitHub. Open source CLI. No DB required.

84 (+6%)
apache-2.0
ebonnal
ebonnal/streamable

Pythonic Stream-like manipulation of iterables.

208 (+3%)
apache-2.0
pracdata
pracdata/awesome-open-source-data-engineering

A curated list of open source tools used in analytics platforms and data engineering ecosystem

174 (+3%)
Last month (new repositories)
no newly created repositories trending in the last month
Last month (absolute gain)
pathwaycom
pathwaycom/pathway

Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

12,387 (+5,442)
apache
apache/airflow

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

38,255 (+665)
apache-2.0
airbytehq
airbytehq/airbyte

The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.

16,865 (+420)
chonkie-ai
chonkie-ai/chonkie

🦛 CHONK your texts with Chonkie ✨ - The no-nonsense RAG chunking library

2,224 (+364)
mit
dagster-io
dagster-io/dagster

An orchestration platform for the development, production, and observation of data assets.

12,250 (+192)
apache-2.0
Last month (relative gain)
mattlianje
mattlianje/etl4s

Powerful, whiteboard-style ETL

26 (+160%)
gpl-3.0
datazip-inc
datazip-inc/olake

Fastest open-source tool for replicating Databases to Apache Iceberg or Data Lakehouse. ⚡ Efficient, quick and scalable data ingestion for real-time analytics. Starting with MongoDB

88 (+159%)
apache-2.0
pathwaycom
pathwaycom/pathway

Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

12,387 (+78%)
apecloud
apecloud/ape-dts

Ape Data Transfer Suite, written in Rust. Provides ultra-fast data replication between MySQL, PostgreSQL, Redis, MongoDB, Kafka and ClickHouse, ideal for disaster recovery (DR) and migration scenarios...

281 (+33%)
agpl-3.0
ebonnal
ebonnal/streamable

Pythonic Stream-like manipulation of iterables.

208 (+30%)
apache-2.0
Last 12-months (new repositories)
chonkie-ai
chonkie-ai/chonkie

🦛 CHONK your texts with Chonkie ✨ - The no-nonsense RAG chunking library

2,224
mit
ucbepic
ucbepic/docetl

A system for agentic LLM-powered data processing and ETL

1,419
mit
amphi-ai
amphi-ai/amphi-etl

Visual Data Transformation and Data Preparation. Low-Code Python-based ETL.

961
pgflo
pgflo/pg_flo

Stream, transform, and route PostgreSQL data in real-time.

746
apache-2.0
yobix-ai
yobix-ai/extractous

Fast and efficient unstructured data extraction. Written in Rust with bindings for many languages.

655
apache-2.0
Last 12-months (absolute gain)
pathwaycom
pathwaycom/pathway

Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

12,387 (+11,307)
apache
apache/airflow

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

38,255 (+5,182)
apache-2.0
airbytehq
airbytehq/airbyte

The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.

16,865 (+4,056)
nucleuscloud
nucleuscloud/neosync

Open source data anonymization and synthetic data orchestration for developers. Create high fidelity synthetic data and sync it across your environments.

3,654 (+3,272)
dagster-io
dagster-io/dagster

An orchestration platform for the development, production, and observation of data assets.

12,250 (+2,872)
apache-2.0
Last 12-months (relative gain)
pgflo
pgflo/pg_flo

Stream, transform, and route PostgreSQL data in real-time.

746 (+18,550%)
apache-2.0
superlinked
superlinked/superlinked

Superlinked is a Python framework for AI Engineers building high-performance search & recommendation applications that combine structured and unstructured data.

846 (+16,820%)
apache-2.0
ebonnal
ebonnal/streamable

Pythonic Stream-like manipulation of iterables.

208 (+5,100%)
apache-2.0
marly-ai
marly-ai/marly

Context-aware structured outputs. Search your documents or the web for specific data and get it back in JSON or Markdown.

138 (+2,200%)
pracdata
pracdata/awesome-open-source-data-engineering

A curated list of open source tools used in analytics platforms and data engineering ecosystem

174 (+1,482%)