43 results found Sort:

13.7k
35.0k
apache-2.0
755
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
Created 2015-04-13
24,768 commits to main branch, last one 12 hours ago
3.7k
14.6k
other
180
The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.
Created 2020-07-27
16,523 commits to master branch, last one 6 hours ago
3.1k
11.7k
apache-2.0
281
Apache Doris is an easy-to-use, high performance and unified analytics database.
Created 2017-08-10
19,845 commits to master branch, last one 15 hours ago
1.5k
9.1k
apache-2.0
137
dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build applications.
Created 2016-03-10
6,740 commits to main branch, last one 9 hours ago
1.6k
7.5k
apache-2.0
173
SeaTunnel is a next-generation super high-performance, distributed, massive data integration tool.
Created 2017-08-05
4,000 commits to dev branch, last one a day ago
667
7.3k
apache-2.0
63
🧙 Build, run, and manage data pipelines for integrating and transforming data.
Created 2022-05-16
5,319 commits to master branch, last one 11 hours ago
403
6.9k
apache-2.0
61
Infinitely scalable, event-driven, language-agnostic orchestration and scheduling platform to manage millions of workflows declaratively in code.
Created 2019-08-24
3,284 commits to develop branch, last one 12 hours ago
500
5.6k
mpl-2.0
60
The open source high performance ELT framework powered by Apache Arrow
Created 2020-11-18
17,834 commits to main branch, last one 13 hours ago
1.8k
5.4k
apache-2.0
143
Flink CDC is a streaming data integration tool
Created 2020-07-27
996 commits to master branch, last one a day ago
36
2.0k
apache-2.0
12
Open-source BI for engineers
Created 2024-02-20
262 commits to main branch, last one a day ago
109
1.9k
apache-2.0
18
data load tool (dlt) is an open source Python library that makes data loading easy 🛠️
Created 2022-01-26
3,037 commits to devel branch, last one 8 hours ago
145
1.6k
mit
13
Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to writing, maintaining, and scaling your own API integrations.
Created 2021-06-21
11,377 commits to main branch, last one a day ago
116
1.4k
apache-2.0
18
Efficient data transformation and modeling framework that is backwards compatible with dbt.
Created 2022-09-23
2,501 commits to main branch, last one a day ago
148
799
apache-2.0
20
Dataform is a framework for managing SQL based data operations in BigQuery
Created 2018-09-03
1,676 commits to main branch, last one 20 days ago
52
774
apache-2.0
13
Kuwala is the no-code data platform for BI analysts and engineers enabling you to build powerful analytics workflows. We are set out to bring state-of-the-art data engineering tools you love, such as ...
Created 2021-04-08
416 commits to master branch, last one about a year ago
153
741
apache-2.0
18
Optimus is an easy-to-use, reliable, and performant workflow orchestrator for data transformation, data modeling, pipelines, and data quality management.
Created 2021-03-22
487 commits to main branch, last one 10 months ago
Database replication platform that leverages change data capture. Stream production data from databases to your data warehouse (Snowflake, BigQuery, Redshift) in real-time.
Created 2022-11-06
621 commits to master branch, last one 7 hours ago
113
473
apache-2.0
26
A free to use dbt package for creating and loading Data Vault 2.0 compliant Data Warehouses (powered by dbt, an open source data engineering tool, registered trademark of dbt Labs)
Created 2019-09-27
4,037 commits to master branch, last one 5 days ago
dbt + Metabase integration
Created 2019-12-12
156 commits to master branch, last one 24 hours ago
54
414
apache-2.0
16
One framework to develop, deploy and operate data workflows with Python and SQL.
Created 2021-07-20
2,133 commits to main branch, last one 8 days ago
94
375
apache-2.0
24
ReplicaDB is open source tool for database replication, designed for efficiently transferring bulk data between relational and non-relational databases
Created 2018-12-05
442 commits to master branch, last one about a month ago
39
327
apache-2.0
12
Astro SDK allows rapid and clean development of {Extract, Load, Transform} workflows using Python and SQL, powered by Apache Airflow.
Created 2021-12-06
1,160 commits to main branch, last one 27 days ago
A serverless architecture for orchestrating ETL jobs in arbitrarily-complex workflows using AWS Step Functions and AWS Lambda.
Created 2018-05-08
14 commits to master branch, last one 4 years ago
Sling is a CLI tool that extracts data from a source storage/database and loads it in a target storage/database.
Created 2020-10-15
1,365 commits to main branch, last one 8 days ago
28
283
apache-2.0
12
Use SQL to build ELT pipelines on a data lakehouse.
Created 2021-03-11
481 commits to main branch, last one 2 years ago
14
223
apache-2.0
10
CLI tool for dbt users to simplify creation of staging models (yml and sql) files
Created 2021-06-28
859 commits to main branch, last one 5 days ago
Play detective on Reddit: Discover political disinformation campaigns, secret influencers and more
Created 2020-10-20
102 commits to main branch, last one 2 years ago
3
193
apache-2.0
7
Data Reconnaissance - pull request review tool for dbt projects
Created 2023-10-06
1,111 commits to main branch, last one 21 hours ago
PyAirbyte brings the power of Airbyte to every Python developer.
Created 2024-02-04
153 commits to main branch, last one 9 days ago