Statistics for topic bigdata

RepositoryStats tracks 635,091 Github repositories, of these 179 are tagged with the bigdata topic. The most common primary language for repositories using this topic is Java (50). Other languages include: Python (21),  Scala (15),  Go (12)

Stargazers over time for topic bigdata

300300250250200200150150100100505000202020202021202120222022202320232024202420252025

Most starred repositories for topic bigdata (view more)

DataExpert-io
data-engineer-handbook DataExpert-io
5.6k
27.3k
unknown
364
This is a repo with links to everything you'd ever want to learn about data engineering
sql data awesome bigdata apachespark dataengineering
Created 2023-11-19
402 commits to main branch, last one about a month ago
taosdata
TDengine taosdata
4.9k
23.7k
agpl-3.0
683
High-performance, scalable time-series database designed for Industrial IoT (IIoT) scenarios
iot sql tsdb bigdata cluster metrics database tdengine monitoring distributed scalability time-series cloud-native industrial-iot connected-vehicles financial-analysis time-series-database
Created 2019-07-11
77,762 commits to main branch, last one 15 hours ago
apache
shardingsphere apache
6.8k
20.1k
apache-2.0
984
Empowering Data Intelligence with Distributed SQL for Sharding, Scalability, and Security Across All Databases.
sql mysql shard bigdata encrypt database postgresql data-pipeline data-encryption database-cluster database-gateway database-middleware distributed-database read-write-splitting distributed-transaction distributed-sql-database
Created 2016-01-18
45,545 commits to master branch, last one 15 hours ago
heibaiying
BigData-Notes heibaiying
4.3k
16.3k
unknown
448
大数据入门指南 :star:
hdfs hive yarn flume hbase kafka scala spark sqoop storm hadoop azkaban bigdata phoenix big-data mapreduce zookeeper
Created 2019-03-10
607 commits to master branch, last one 2 years ago
oxnr
awesome-bigdata oxnr
2.6k
13.5k
mit
846
A curated list of awesome big data frameworks, ressources and other awesomeness.
data awesome bigdata database data-stream awesome-list data-science data-analytics data-warehouse streaming-data visualize-data series-database stream-processing data-visualization distributed-database
Created 2014-07-04
586 commits to master branch, last one about a month ago
juicedata
juicefs juicedata
1.0k
11.4k
apache-2.0
110
JuiceFS is a distributed POSIX file system built on top of Redis and S3.
go s3 hdfs posix redis golang bigdata storage filesystem cloud-native object-storage distributed-systems
Created 2021-01-08
3,726 commits to main branch, last one a day ago

Trending repositories for topic bigdata (view more)

Last 3 days (new repositories)
no newly created repositories trending in the last 3 days
Last 3 days (absolute gain)
DataExpert-io
DataExpert-io/data-engineer-handbook

This is a repo with links to everything you'd ever want to learn about data engineering

27,313 (+59)
iGaoWei
iGaoWei/BigDataView

100+套大数据可视化炫酷大屏Html5模板；包含行业：社区、物业、政务、交通、金融银行等，全网最新、最多，最全、最酷、最炫大数据可视化模板。陆续更新中

3,862 (+12)
taosdata
taosdata/TDengine

High-performance, scalable time-series database designed for Industrial IoT (IIoT) scenarios

23,726 (+10)
agpl-3.0
volcano-sh
volcano-sh/volcano

A Cloud Native Batch System (Project under CNCF)

4,558 (+8)
apache-2.0
heibaiying
heibaiying/BigData-Notes

大数据入门指南 :star:

16,310 (+8)
Last 3 days (relative gain)
apconw
apconw/sanic-web

一个轻量级、支持全链路且易于二次开发的大模型应用项目(Large Model Data Assistant) 支持DeepSeek/Qwen2.5等大模型 基于 Dify 、Ollama&Vllm、Sanic 和 Text2SQL 📊 等技术构建的一站式大模型应用开发项目，采用 Vue3、TypeScript 和 Vite 5 打造现代UI。它支持通过 ECharts 📈 实现基于大模型的数据...

317 (+2%)
DragonKingpin
DragonKingpin/Hydra

Hydra九头龙，面向PB级别知识库取数、情报系统、数据平台、大规模控制调度系统。建设云计算资源管理、任务/服务统一调度、数仓、微服务化、中台基建系统化能力。——以实现大规模分布式爬虫搜索引擎为例。

218 (+0.9%)
mit
datawhalechina
datawhalechina/juicy-bigdata

🎉🎉🐳 Datawhale大数据处理导论教程 | 大数据技术方向的开篇课程🎉🎉

312 (+0.6%)
NationalSecurityAgency
NationalSecurityAgency/datawave

DataWave is an ingest/query framework that leverages Apache Accumulo to provide fast, secure data access.

600 (+0.5%)
apache-2.0
tensorbase
tensorbase/tensorbase

TensorBase is a new big data warehousing with modern efforts.

1,447 (+0.3%)
apache-2.0
Last week (new repositories)
no newly created repositories trending in the last week
Last week (absolute gain)
DataExpert-io
DataExpert-io/data-engineer-handbook

This is a repo with links to everything you'd ever want to learn about data engineering

27,313 (+97)
apconw
apconw/sanic-web

一个轻量级、支持全链路且易于二次开发的大模型应用项目(Large Model Data Assistant) 支持DeepSeek/Qwen2.5等大模型 基于 Dify 、Ollama&Vllm、Sanic 和 Text2SQL 📊 等技术构建的一站式大模型应用开发项目，采用 Vue3、TypeScript 和 Vite 5 打造现代UI。它支持通过 ECharts 📈 实现基于大模型的数据...

317 (+32)
taosdata
taosdata/TDengine

High-performance, scalable time-series database designed for Industrial IoT (IIoT) scenarios

23,726 (+29)
agpl-3.0
iGaoWei
iGaoWei/BigDataView

100+套大数据可视化炫酷大屏Html5模板；包含行业：社区、物业、政务、交通、金融银行等，全网最新、最多，最全、最酷、最炫大数据可视化模板。陆续更新中

3,862 (+29)
databendlabs
databendlabs/databend

𝗗𝗮𝘁𝗮, 𝗔𝗻𝗮𝗹𝘆𝘁𝗶𝗰𝘀 & 𝗔𝗜. Modern alternative to Snowflake. Cost-effective and simple for massive-scale analytics. https://databend.com

8,315 (+25)
Last week (relative gain)
apconw
apconw/sanic-web

一个轻量级、支持全链路且易于二次开发的大模型应用项目(Large Model Data Assistant) 支持DeepSeek/Qwen2.5等大模型 基于 Dify 、Ollama&Vllm、Sanic 和 Text2SQL 📊 等技术构建的一站式大模型应用开发项目，采用 Vue3、TypeScript 和 Vite 5 打造现代UI。它支持通过 ECharts 📈 实现基于大模型的数据...

317 (+11%)
anqorithm
anqorithm/RealTime-StockStream

RealTime StockStream is a streamlined, simulation system for processing live stock market data. It uses Apache Kafka for data input, Apache Spark for data handling, and Apache Cassandra for data stora...

25 (+9%)
transferia
transferia/transferia

Open Source Cloud Native Ingestion engine

105 (+2%)
apache-2.0
MrXujiang
MrXujiang/v6.dooring.public

可视化大屏解决方案, 提供一套可视化编辑引擎, 助力个人或企业轻松定制自己的可视化大屏应用.

632 (+1.0%)
gpl-3.0
DragonKingpin
DragonKingpin/Hydra

Hydra九头龙，面向PB级别知识库取数、情报系统、数据平台、大规模控制调度系统。建设云计算资源管理、任务/服务统一调度、数仓、微服务化、中台基建系统化能力。——以实现大规模分布式爬虫搜索引擎为例。

218 (+0.9%)
mit
Last month (new repositories)
no newly created repositories trending in the last month
Last month (absolute gain)
DataExpert-io
DataExpert-io/data-engineer-handbook

This is a repo with links to everything you'd ever want to learn about data engineering

27,313 (+420)
iGaoWei
iGaoWei/BigDataView

100+套大数据可视化炫酷大屏Html5模板；包含行业：社区、物业、政务、交通、金融银行等，全网最新、最多，最全、最酷、最炫大数据可视化模板。陆续更新中

3,862 (+131)
apconw
apconw/sanic-web

一个轻量级、支持全链路且易于二次开发的大模型应用项目(Large Model Data Assistant) 支持DeepSeek/Qwen2.5等大模型 基于 Dify 、Ollama&Vllm、Sanic 和 Text2SQL 📊 等技术构建的一站式大模型应用开发项目，采用 Vue3、TypeScript 和 Vite 5 打造现代UI。它支持通过 ECharts 📈 实现基于大模型的数据...

317 (+113)
juicedata
juicedata/juicefs

JuiceFS is a distributed POSIX file system built on top of Redis and S3.

11,422 (+112)
apache-2.0
taosdata
taosdata/TDengine

High-performance, scalable time-series database designed for Industrial IoT (IIoT) scenarios

23,726 (+105)
agpl-3.0
Last month (relative gain)
apconw
apconw/sanic-web

一个轻量级、支持全链路且易于二次开发的大模型应用项目(Large Model Data Assistant) 支持DeepSeek/Qwen2.5等大模型 基于 Dify 、Ollama&Vllm、Sanic 和 Text2SQL 📊 等技术构建的一站式大模型应用开发项目，采用 Vue3、TypeScript 和 Vite 5 打造现代UI。它支持通过 ECharts 📈 实现基于大模型的数据...

317 (+55%)
transferia
transferia/transferia

Open Source Cloud Native Ingestion engine

105 (+44%)
apache-2.0
DragonKingpin
DragonKingpin/Hydra

Hydra九头龙，面向PB级别知识库取数、情报系统、数据平台、大规模控制调度系统。建设云计算资源管理、任务/服务统一调度、数仓、微服务化、中台基建系统化能力。——以实现大规模分布式爬虫搜索引擎为例。

218 (+15%)
mit
anqorithm
anqorithm/RealTime-StockStream

RealTime StockStream is a streamlined, simulation system for processing live stock market data. It uses Apache Kafka for data input, Apache Spark for data handling, and Apache Cassandra for data stora...

25 (+14%)
rustfs
rustfs/rustfs

🚀 High-performance distributed object storage for MinIO's Apache License alternative.

76 (+10%)
apache-2.0
Last 12-months (new repositories)
apconw
apconw/sanic-web

一个轻量级、支持全链路且易于二次开发的大模型应用项目(Large Model Data Assistant) 支持DeepSeek/Qwen2.5等大模型 基于 Dify 、Ollama&Vllm、Sanic 和 Text2SQL 📊 等技术构建的一站式大模型应用开发项目，采用 Vue3、TypeScript 和 Vite 5 打造现代UI。它支持通过 ECharts 📈 实现基于大模型的数据...

317
DragonKingpin
DragonKingpin/Hydra

Hydra九头龙，面向PB级别知识库取数、情报系统、数据平台、大规模控制调度系统。建设云计算资源管理、任务/服务统一调度、数仓、微服务化、中台基建系统化能力。——以实现大规模分布式爬虫搜索引擎为例。

218
mit
transferia
transferia/transferia

Open Source Cloud Native Ingestion engine

105
apache-2.0
TAHIR0110
TAHIR0110/ThereForYou

ThereForYou: Your mental health ally. Kai, our AI assistant, offers compassionate support. Track your mood trends, find solace in a secure community, and access crisis resources swiftly. We're here to...

91
mit
apache
apache/avro-rs

Rust SDK for Apache Avro - a data serialization system.

51
apache-2.0
Last 12-months (absolute gain)
DataExpert-io
DataExpert-io/data-engineer-handbook

This is a repo with links to everything you'd ever want to learn about data engineering

27,313 (+18,914)
iGaoWei
iGaoWei/BigDataView

100+套大数据可视化炫酷大屏Html5模板；包含行业：社区、物业、政务、交通、金融银行等，全网最新、最多，最全、最酷、最炫大数据可视化模板。陆续更新中

3,862 (+2,258)
juicedata
juicedata/juicefs

JuiceFS is a distributed POSIX file system built on top of Redis and S3.

11,422 (+1,676)
apache-2.0
databendlabs
databendlabs/databend

𝗗𝗮𝘁𝗮, 𝗔𝗻𝗮𝗹𝘆𝘁𝗶𝗰𝘀 & 𝗔𝗜. Modern alternative to Snowflake. Cost-effective and simple for massive-scale analytics. https://databend.com

8,315 (+1,188)
heibaiying
heibaiying/BigData-Notes

大数据入门指南 :star:

16,310 (+1,114)
Last 12-months (relative gain)
linktimecloud
linktimecloud/kubernetes-data-platform

KDP(Kubernetes Data Platform) delivers a modern, hybrid and cloud-native data platform based on Kubernetes.

191 (+1,369%)
apache-2.0
HariSekhon
HariSekhon/Knowledge-Base

Large Tech Knowledge Base from 20 years in DevOps, Linux, Cloud, Big Data, AWS, GCP etc - gradually porting my large private knowledge base to public

161 (+847%)
mit
apache
apache/avro-rs

Rust SDK for Apache Avro - a data serialization system.

51 (+467%)
apache-2.0
anqorithm
anqorithm/RealTime-StockStream

RealTime StockStream is a streamlined, simulation system for processing live stock market data. It uses Apache Kafka for data input, Apache Spark for data handling, and Apache Cassandra for data stora...

25 (+257%)
DataExpert-io
DataExpert-io/data-engineer-handbook

This is a repo with links to everything you'd ever want to learn about data engineering

27,313 (+225%)