Statistics for topic big-data

RepositoryStats tracks 518,986 Github repositories, of these 342 are tagged with the big-data topic. The most common primary language for repositories using this topic is Java (91). Other languages include: Python (55),  Scala (29),  Jupyter Notebook (24),  C++ (21),  JavaScript (16),  Go (13),  Rust (11),  TypeScript (11)

Stargazers over time for topic big-data

Most starred repositories for topic big-data (view more)

binhnguyennus
awesome-scalability binhnguyennus
5.6k
53.5k
mit
1.8k
The Patterns of Scalable, Reliable, and Performant Large-Scale Systems
lists devops system awesome backend big-data interview resources programming scalability architecture awesome-list system-design design-patterns web-development computer-science machine-learning interview-practice distributed-systems interview-questions
Created 2017-12-27
1,182 commits to master branch, last one 3 days ago
apache
spark apache
28.0k
38.5k
apache-2.0
2.0k
Apache Spark - A unified analytics engine for large-scale data processing
r sql java jdbc scala spark python big-data
Created 2014-02-25
41,039 commits to master branch, last one 16 hours ago
ClickHouse
ClickHouse ClickHouse
6.5k
34.6k
apache-2.0
684
ClickHouse® is a free analytics DBMS for big data
mpp sql dbms olap big-data analytics clickhouse hacktoberfest distributed-database
Created 2016-06-02
141,862 commits to master branch, last one 15 hours ago
donnemartin
data-science-ipython-notebooks donnemartin
7.7k
26.5k
other
1.6k
Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark, Hadoop MapReduce, HDFS), matplotlib, pandas, NumPy, SciPy, Python essentials, AW...
aws caffe keras numpy scipy spark hadoop kaggle pandas python theano big-data mapreduce matplotlib tensorflow data-science scikit-learn deep-learning machine-learning
Created 2015-01-23
543 commits to master branch, last one 5 years ago
apache
flink apache
13.0k
23.2k
apache-2.0
945
Apache Flink
sql java flink scala python big-data
Created 2014-06-07
35,303 commits to master branch, last one 17 hours ago
amark
gun amark
1.1k
17.8k
other
320
An open source cybersecurity protocol for syncing decentralized graph data.
p2p crdt dapp dweb web3 graph crypto big-data database protocol realtime metaverse blockchain encryption end-to-end cryptography decentralized offline-first machine-learning artificial-intelligence
Created 2014-07-31
2,498 commits to master branch, last one about a month ago

Trending repositories for topic big-data (view more)

Last 3 days (new repositories)
no newly created repositories trending in the last 3 days
Last 3 days (absolute gain)
quarylabs
quarylabs/quary

Open-source BI for engineers

1,258 (+669)
apache-2.0
paradedb
paradedb/paradedb

Postgres for Search and Analytics

4,220 (+134)
agpl-3.0
ClickHouse
ClickHouse/ClickHouse

ClickHouse® is a free analytics DBMS for big data

34,646 (+60)
apache-2.0
StarRocks
StarRocks/starrocks

StarRocks, a Linux Foundation project, is a next-generation sub-second MPP OLAP database for full analytics scenarios, including multi-dimensional analytics, real-time analytics, and ad-hoc queries. ...

7,988 (+55)
apache-2.0
binhnguyennus
binhnguyennus/awesome-scalability

The Patterns of Scalable, Reliable, and Performant Large-Scale Systems

53,546 (+31)
mit
Last 3 days (relative gain)
quarylabs
quarylabs/quary

Open-source BI for engineers

1,258 (+114%)
apache-2.0
paradedb
paradedb/paradedb

Postgres for Search and Analytics

4,220 (+3%)
agpl-3.0
apache
apache/doris-website

Apache Doris Website

69 (+1%)
adidas
adidas/lakehouse-engine

The Lakehouse Engine is a configuration driven Spark framework, written in Python, serving as a scalable and distributed engine for several lakehouse algorithms, data flows and utilities for Data Prod...

187 (+1%)
apache-2.0
airscholar
airscholar/e2e-data-engineering

An end-to-end data engineering pipeline that orchestrates data ingestion, processing, and storage using Apache Airflow, Python, Apache Kafka, Apache Zookeeper, Apache Spark, and Cassandra. All compone...

110 (+0.9%)
Last week (new repositories)
no newly created repositories trending in the last week
Last week (absolute gain)
quarylabs
quarylabs/quary

Open-source BI for engineers

1,258 (+675)
apache-2.0
paradedb
paradedb/paradedb

Postgres for Search and Analytics

4,220 (+215)
agpl-3.0
ClickHouse
ClickHouse/ClickHouse

ClickHouse® is a free analytics DBMS for big data

34,646 (+183)
apache-2.0
binhnguyennus
binhnguyennus/awesome-scalability

The Patterns of Scalable, Reliable, and Performant Large-Scale Systems

53,546 (+90)
mit
StarRocks
StarRocks/starrocks

StarRocks, a Linux Foundation project, is a next-generation sub-second MPP OLAP database for full analytics scenarios, including multi-dimensional analytics, real-time analytics, and ad-hoc queries. ...

7,988 (+68)
apache-2.0
Last week (relative gain)
quarylabs
quarylabs/quary

Open-source BI for engineers

1,258 (+116%)
apache-2.0
paradedb
paradedb/paradedb

Postgres for Search and Analytics

4,220 (+5%)
agpl-3.0
kafbat
kafbat/kafka-ui

Open-Source Web UI for managing Apache Kafka clusters

332 (+3%)
apache-2.0
Eventual-Inc
Eventual-Inc/Daft

Distributed DataFrame for Python designed for the cloud, powered by Rust

1,759 (+2%)
apache-2.0
myscale
myscale/MyScaleDB

An open-source, high-performance SQL vector database built on ClickHouse.

675 (+2%)
apache-2.0
Last month (new repositories)
no newly created repositories trending in the last month
Last month (absolute gain)
quarylabs
quarylabs/quary

Open-source BI for engineers

1,258 (+692)
apache-2.0
binhnguyennus
binhnguyennus/awesome-scalability

The Patterns of Scalable, Reliable, and Performant Large-Scale Systems

53,546 (+634)
mit
ClickHouse
ClickHouse/ClickHouse

ClickHouse® is a free analytics DBMS for big data

34,646 (+630)
apache-2.0
paradedb
paradedb/paradedb

Postgres for Search and Analytics

4,220 (+449)
agpl-3.0
apache
apache/datafusion

Apache DataFusion SQL Query Engine

5,199 (+286)
apache-2.0
Last month (relative gain)
quarylabs
quarylabs/quary

Open-source BI for engineers

1,258 (+122%)
apache-2.0
airscholar
airscholar/e2e-data-engineering

An end-to-end data engineering pipeline that orchestrates data ingestion, processing, and storage using Apache Airflow, Python, Apache Kafka, Apache Zookeeper, Apache Spark, and Cassandra. All compone...

110 (+21%)
kafbat
kafbat/kafka-ui

Open-Source Web UI for managing Apache Kafka clusters

332 (+16%)
apache-2.0
myscale
myscale/MyScaleDB

An open-source, high-performance SQL vector database built on ClickHouse.

675 (+14%)
apache-2.0
xl-xueling
xl-xueling/xl-lighthouse

XL-LightHouse是一套支持超大数据量、支持超高并发的通用型流式大数据统计系统。常见的应用场景包括：PV、UV统计；电商销售额、下单用户数统计；日志量统计；接口调用量、异常量、耗时情况统计；服务器运维指标监控等功能。系统支持多维度统计，支持各种复杂的条件筛选和逻辑判断，一键部署，一行代码接入，轻松实现各种海量数据实时统计，帮助企业以更低的成本快速搭建起数据指标体系，是企业降本增效的好帮手！

72 (+13%)
apache-2.0
Last 12-months (new repositories)
paradedb
paradedb/paradedb

Postgres for Search and Analytics

4,220
agpl-3.0
quarylabs
quarylabs/quary

Open-source BI for engineers

1,258
apache-2.0
myscale
myscale/MyScaleDB

An open-source, high-performance SQL vector database built on ClickHouse.

675
apache-2.0
TuGraph-family
TuGraph-family/tugraph-analytics

TuGraph Analytics is the fastest OLAP graph database.

605
apache-2.0
natayadev
natayadev/dataengineering-roadmap

Un repositorio más con conceptos básicos, desafíos técnicos y recursos sobre ingeniería de datos en español 🧙✨

422
mit
Last 12-months (absolute gain)
binhnguyennus
binhnguyennus/awesome-scalability

The Patterns of Scalable, Reliable, and Performant Large-Scale Systems

53,546 (+8,405)
mit
ClickHouse
ClickHouse/ClickHouse

ClickHouse® is a free analytics DBMS for big data

34,646 (+5,879)
apache-2.0
paradedb
paradedb/paradedb

Postgres for Search and Analytics

4,220 (+4,219)
agpl-3.0
StarRocks
StarRocks/starrocks

StarRocks, a Linux Foundation project, is a next-generation sub-second MPP OLAP database for full analytics scenarios, including multi-dimensional analytics, real-time analytics, and ad-hoc queries. ...

7,988 (+3,475)
apache-2.0
provectus
provectus/kafka-ui

Open-Source Web UI for Apache Kafka Management

8,646 (+2,901)
apache-2.0
Last 12-months (relative gain)
myscale
myscale/MyScaleDB

An open-source, high-performance SQL vector database built on ClickHouse.

675 (+13,400%)
apache-2.0
dataflint
dataflint/spark

Performance Observability for Apache Spark

127 (+2,440%)
apache-2.0
quarylabs
quarylabs/quary

Open-source BI for engineers

1,258 (+846%)
apache-2.0
xl-xueling
xl-xueling/xl-lighthouse

XL-LightHouse是一套支持超大数据量、支持超高并发的通用型流式大数据统计系统。常见的应用场景包括：PV、UV统计；电商销售额、下单用户数统计；日志量统计；接口调用量、异常量、耗时情况统计；服务器运维指标监控等功能。系统支持多维度统计，支持各种复杂的条件筛选和逻辑判断，一键部署，一行代码接入，轻松实现各种海量数据实时统计，帮助企业以更低的成本快速搭建起数据指标体系，是企业降本增效的好帮手！

72 (+800%)
apache-2.0
jay86cn
jay86cn/techui-react-lite

A free, simple, and easy-to-use technology-style UI component, developed based on React

45 (+650%)
apache-2.0