33 results found Sort:

1.0k
11.5k
other
98
Chat with your database (SQL, CSV, pandas, polars, mongodb, noSQL, etc). PandasAI makes data analysis conversational using LLMs (GPT 3.5 / 4, Anthropic, VertexAI) and RAG.
Created 2023-04-22
985 commits to main branch, last one a day ago
2.8k
9.7k
apache-2.0
167
Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)
Created 2019-01-19
38,206 commits to master branch, last one 23 hours ago
1.7k
8.1k
apache-2.0
208
StarRocks, a Linux Foundation project, is a next-generation sub-second MPP OLAP database for full analytics scenarios, including multi-dimensional analytics, real-time analytics, and ad-hoc queries.
Created 2021-09-04
17,264 commits to main branch, last one a day ago
599
7.8k
mpl-2.0
87
Database for AI. Store Vectors, Images, Texts, Videos, etc. Use with LLMs/LangChain. Store, query, version, & visualize any AI data. Stream data in real-time to PyTorch/TensorFlow. https://activeloop....
Created 2019-08-09
8,938 commits to main branch, last one a day ago
2.4k
5.2k
apache-2.0
1.2k
Upserts, Deletes And Incremental Processing on Big Data.
Created 2016-12-14
5,485 commits to master branch, last one 6 hours ago
331
4.1k
apache-2.0
40
lakeFS - Data version control for your data lake | Git for data
Created 2019-09-12
5,197 commits to master branch, last one 2 days ago
1.1k
2.9k
apache-2.0
37
Dinky is a real-time data development platform based on Apache Flink, enabling agile data development, deployment and operation.
Created 2021-06-09
2,420 commits to dev branch, last one 6 days ago
419
2.3k
apache-2.0
245
LakeSoul is an end-to-end, realtime and cloud native Lakehouse framework with fast data ingestion, concurrent update and incremental data analytics on cloud storages for both BI and AI applications.
Created 2021-12-28
1,085 commits to main branch, last one 9 days ago
154
1.5k
apache-2.0
86
The LeoFS Storage System
Created 2012-06-06
1,664 commits to v1 branch, last one 4 years ago
109
907
agpl-3.0
18
Scalable identity resolution, entity resolution, data mastering and deduplication using ML
Created 2021-08-25
1,819 commits to main branch, last one 10 days ago
254
730
apache-2.0
36
Apache Amoro (incubating) is a Lakehouse management system built on open data lake formats.
Created 2022-07-14
1,283 commits to master branch, last one a day ago
157
526
unknown
38
汇总Apache Hudi相关资料
Created 2019-12-11
236 commits to master branch, last one 4 days ago
176
483
apache-2.0
21
World's most powerful open data catalog for building a high-performance, geo-distributed and federated metadata lake.
Created 2023-04-23
1,333 commits to main branch, last one 23 hours ago
113
473
apache-2.0
26
A free to use dbt package for creating and loading Data Vault 2.0 compliant Data Warehouses (powered by dbt, an open source data engineering tool, registered trademark of dbt Labs)
Created 2019-09-27
4,037 commits to master branch, last one 6 days ago
28
283
apache-2.0
12
Use SQL to build ELT pipelines on a data lakehouse.
Created 2021-03-11
481 commits to main branch, last one 2 years ago
40
267
bsd-2-clause
17
Open Control Plane for Tables in Data Lakehouse
Created 2024-02-13
251 commits to main branch, last one 2 days ago
The Internals of Delta Lake
Created 2019-10-30
659 commits to main branch, last one 2 days ago
26
128
apache-2.0
13
A Data Platform built for AWS, powered by Kubernetes.
This repository has been archived (exclude archived)
Created 2020-10-08
894 commits to main branch, last one 10 months ago
An IDE and translation engine for detection engineers and threat hunters. Be faster, write smarter, keep 100% privacy.
Created 2023-11-01
388 commits to main branch, last one a day ago
6
105
other
8
Roota is a public-domain language of threat detection and response that combines native queries from a SIEM, EDR, XDR, or Data Lake with standardized metadata and threat intelligence to enable automat...
Created 2023-11-01
82 commits to main branch, last one about a month ago
Real-time Data Warehouse with Apache Flink & Apache Kafka & Apache Hudi
Created 2021-06-27
18 commits to hudi branch, last one 2 years ago
42
98
apache-2.0
20
Streaming application development and management system, based on Linkis and DSS, planning to provide the workflow-like graphical drag-and-drop development capability.
Created 2021-03-25
1,128 commits to main branch, last one 2 months ago
This repository will help you to learn about databricks concept with the help of examples. It will include all the important topics which we need in our real life experience as a data engineer. We wil...
Created 2022-05-10
45 commits to master branch, last one about a year ago
Apache Spark Course Material
Created 2020-05-05
34 commits to master branch, last one 3 years ago
A curated list of open source tools used in analytical stacks and data engineering ecosystem
Created 2024-02-22
8 commits to main branch, last one 3 months ago
145
71
unknown
32
Apache Doris Website
Created 2018-09-21
1,042 commits to master branch, last one 12 hours ago
Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validation, Column extensions, SQL functions, and DataFrame transformati...
Created 2019-11-16
15 commits to master branch, last one about a year ago
3
47
apache-2.0
2
A library to accelerate ML and ETL pipeline by connecting all data sources
Created 2023-03-19
217 commits to main branch, last one about a year ago