Statistics for topic data-integration

RepositoryStats tracks 596,206 Github repositories, of these 58 are tagged with the data-integration topic. The most common primary language for repositories using this topic is Python (20).

Stargazers over time for topic data-integration

Most starred repositories for topic data-integration (view more)

apache
airflow apache
14.4k
38.0k
apache-2.0
764
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
dag elt etl mlops apache python airflow workflow scheduler automation data-science orchestration apache-airflow data-pipelines workflow-engine data-engineering data-integration machine-learning data-orchestrator workflow-orchestration
Created 2015-04-13
27,387 commits to main branch, last one 6 hours ago
Avaiga
taipy Avaiga
1.9k
17.4k
apache-2.0
79
Turns Data and AI algorithms into production-ready web applications in no time.
mlops python data-ops pipeline scenario workflow pipelines taipy-gui automation taipy-core datascience hacktoberfest job-scheduler orchestration developer-tools data-engineering data-integration hacktoberfest2023 scenario-analysis data-visualization
Created 2022-02-18
7,294 commits to develop branch, last one 2 days ago
airbytehq
airbyte airbytehq
4.2k
16.5k
other
187
The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.
s3 elt etl data java mssql mysql python bigquery pipeline redshift snowflake postgresql self-hosted data-analysis data-pipeline data-collection data-engineering data-integration change-data-capture
Created 2020-07-27
24,628 commits to master branch, last one 13 hours ago
dagster-io
dagster dagster-io
1.5k
12.1k
apache-2.0
124
An orchestration platform for the development, production, and observation of data assets.
etl mlops python dagster metadata workflow analytics scheduler data-science orchestration data-pipelines data-engineering data-integration data-orchestrator workflow-automation
Created 2018-04-30
21,587 commits to master branch, last one 14 hours ago
apache
seatunnel apache
1.9k
8.2k
apache-2.0
175
SeaTunnel is a next-generation super high-performance, distributed, massive data integration tool.
cdc elt batch apache offline real-time streaming data-ingestion data-integration high-performance change-data-capture
Created 2017-08-05
4,544 commits to dev branch, last one 17 hours ago
mage-ai
mage-ai mage-ai
778
8.0k
apache-2.0
62
🧙 Build, run, and manage data pipelines for integrating and transforming data.
dbt elt etl sql data spark python pipeline pipelines reverse-etl data-science orchestration data-pipelines transformation data-engineering data-integration machine-learning artificial-intelligence
Created 2022-05-16
5,511 commits to master branch, last one 12 hours ago

Trending repositories for topic data-integration (view more)

Last 3 days (new repositories)
no newly created repositories trending in the last 3 days
Last 3 days (absolute gain)
apache
apache/airflow

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

37,952 (+130)
apache-2.0
Avaiga
Avaiga/taipy

Turns Data and AI algorithms into production-ready web applications in no time.

17,443 (+60)
apache-2.0
bruin-data
bruin-data/ingestr

ingestr is a CLI tool to copy data between any databases with a single command seamlessly.

2,708 (+22)
mit
airbytehq
airbytehq/airbyte

The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.

16,522 (+13)
dagster-io
dagster-io/dagster

An orchestration platform for the development, production, and observation of data assets.

12,107 (+12)
apache-2.0
Last 3 days (relative gain)
artie-labs
artie-labs/reader

Perform historical snapshots without database locks and read change data capture logs from databases. Artie Reader is compatible with Debezium and is written in Go.

39 (+3%)
bruin-data
bruin-data/ingestr

ingestr is a CLI tool to copy data between any databases with a single command seamlessly.

2,708 (+0.8%)
mit
pracdata
pracdata/awesome-open-source-data-engineering

A curated list of open source tools used in analytics platforms and data engineering ecosystem

164 (+0.6%)
saeyslab
saeyslab/nichenetr

NicheNet: predict active ligand-target links between interacting cells

501 (+0.4%)
Avaiga
Avaiga/taipy

Turns Data and AI algorithms into production-ready web applications in no time.

17,443 (+0.3%)
apache-2.0
Last week (new repositories)
no newly created repositories trending in the last week
Last week (absolute gain)
apache
apache/airflow

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

37,952 (+343)
apache-2.0
Avaiga
Avaiga/taipy

Turns Data and AI algorithms into production-ready web applications in no time.

17,443 (+186)
apache-2.0
bruin-data
bruin-data/ingestr

ingestr is a CLI tool to copy data between any databases with a single command seamlessly.

2,708 (+123)
mit
airbytehq
airbytehq/airbyte

The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.

16,522 (+61)
dagster-io
dagster-io/dagster

An orchestration platform for the development, production, and observation of data assets.

12,107 (+46)
apache-2.0
Last week (relative gain)
bruin-data
bruin-data/ingestr

ingestr is a CLI tool to copy data between any databases with a single command seamlessly.

2,708 (+5%)
mit
starlake-ai
starlake-ai/starlake

Declarative text based tool for data analysts and engineers to extract, load, transform and orchestrate their data pipelines.

63 (+3%)
apache-2.0
artie-labs
artie-labs/reader

Perform historical snapshots without database locks and read change data capture logs from databases. Artie Reader is compatible with Debezium and is written in Go.

39 (+3%)
pracdata
pracdata/awesome-open-source-data-engineering

A curated list of open source tools used in analytics platforms and data engineering ecosystem

164 (+1%)
Avaiga
Avaiga/taipy

Turns Data and AI algorithms into production-ready web applications in no time.

17,443 (+1%)
apache-2.0
Last month (new repositories)
no newly created repositories trending in the last month
Last month (absolute gain)
Avaiga
Avaiga/taipy

Turns Data and AI algorithms into production-ready web applications in no time.

17,443 (+1,935)
apache-2.0
apache
apache/airflow

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

37,952 (+679)
apache-2.0
dagster-io
dagster-io/dagster

An orchestration platform for the development, production, and observation of data assets.

12,107 (+311)
apache-2.0
airbytehq
airbytehq/airbyte

The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.

16,522 (+272)
bruin-data
bruin-data/ingestr

ingestr is a CLI tool to copy data between any databases with a single command seamlessly.

2,708 (+145)
mit
Last month (relative gain)
Avaiga
Avaiga/taipy

Turns Data and AI algorithms into production-ready web applications in no time.

17,443 (+12%)
apache-2.0
linkml
linkml/linkml-model

Link Modeling Language (LinkML) model

39 (+11%)
pracdata
pracdata/awesome-open-source-data-engineering

A curated list of open source tools used in analytics platforms and data engineering ecosystem

164 (+10%)
starlake-ai
starlake-ai/starlake

Declarative text based tool for data analysts and engineers to extract, load, transform and orchestrate their data pipelines.

63 (+9%)
apache-2.0
bruin-data
bruin-data/ingestr

ingestr is a CLI tool to copy data between any databases with a single command seamlessly.

2,708 (+6%)
mit
Last 12-months (new repositories)
bruin-data
bruin-data/ingestr

ingestr is a CLI tool to copy data between any databases with a single command seamlessly.

2,708
mit
pracdata
pracdata/awesome-open-source-data-engineering

A curated list of open source tools used in analytics platforms and data engineering ecosystem

164
DerwenAI
DerwenAI/ERKG

Demonstrate integration of Senzing and Neo4j to construct an Entity Resolved Knowledge Graph

26
mit
Last 12-months (absolute gain)
Avaiga
Avaiga/taipy

Turns Data and AI algorithms into production-ready web applications in no time.

17,443 (+14,768)
apache-2.0
apache
apache/airflow

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

37,952 (+5,127)
apache-2.0
airbytehq
airbytehq/airbyte

The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.

16,522 (+3,914)
dagster-io
dagster-io/dagster

An orchestration platform for the development, production, and observation of data assets.

12,107 (+2,884)
apache-2.0
bruin-data
bruin-data/ingestr

ingestr is a CLI tool to copy data between any databases with a single command seamlessly.

2,708 (+2,707)
mit
Last 12-months (relative gain)
swimos
swimos/swim-rust

Self-contained distributed software platform for building stateful, massively real-time streaming applications in Rust.

323 (+2,207%)
apache-2.0
pracdata
pracdata/awesome-open-source-data-engineering

A curated list of open source tools used in analytics platforms and data engineering ecosystem

164 (+1,391%)
Avaiga
Avaiga/taipy

Turns Data and AI algorithms into production-ready web applications in no time.

17,443 (+552%)
apache-2.0
Teichlab
Teichlab/cellhint

A tool for semi-automatic cell type harmonization and integration

98 (+367%)
mit
starlake-ai
starlake-ai/starlake

Declarative text based tool for data analysts and engineers to extract, load, transform and orchestrate their data pipelines.

63 (+142%)
apache-2.0