Search Results - RepositoryStats

data-science-ipython-notebooks donnemartin

8.0k

28.1k

other

1.6k

Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark, Hadoop MapReduce, HDFS), matplotlib, pandas, NumPy, SciPy, Python essentials, AW...

aws caffe keras numpy scipy spark hadoop kaggle pandas python theano big-data mapreduce matplotlib tensorflow data-science scikit-learn deep-learning machine-learning

Created 2015-01-23

543 commits to master branch, last one 6 years ago

BigData-Notes heibaiying

4.3k

16.3k

unknown

448

大数据入门指南 :star:

hdfs hive yarn flume hbase kafka scala spark sqoop storm hadoop azkaban bigdata phoenix big-data mapreduce zookeeper

Created 2019-03-10

607 commits to master branch, last one 2 years ago

PowerJob PowerJob

1.3k

7.4k

apache-2.0

124

Enterprise job scheduling middleware with distributed computing ability.

job cron java workflow mapreduce scheduler distributed job-scheduler

Created 2020-03-16

1,267 commits to master branch, last one 4 months ago

dpark douban

530

2.7k

bsd-3-clause

266

Python clone of Spark, a MapReduce alike framework in Python

dpark spark python bigdata mapreduce stream-processing

This repository has been archived (exclude archived)

Created 2012-04-11

1,467 commits to master branch, last one 4 years ago

BigData-Interview water8394

445

1.6k

unknown

52

:dart: :star2:[大数据面试题]分享自己在网络上收集的大数据相关的面试题以及自己的答案总结.目前包含Hadoop/Hive/Spark/Flink/Hbase/Kafka/Zookeeper框架的面试题知识总结

hdfs yarn flink hbase kafka spark hadoop bigdata interview mapreduce interview-questions

Created 2019-08-12

80 commits to master branch, last one 4 years ago

bigdata-growth collabH

377

1.6k

mit

34

大数据知识仓库涉及到数据仓库建模、实时计算、大数据、数据中台、系统设计、Java、算法等。

hdfs hive hudi kudu olap flink hbase kafka spark hadoop bigdata debezium mapreduce bigdatalearning

Created 2020-06-10

1,088 commits to master branch, last one 5 months ago

data-algorithms-book mahmoudparsian

663

1.1k

other

129

MapReduce, Spark, Java, and Scala for Data Algorithms Book

java scala python mappers pyspark reducers mapreduce apache-spark partitioning apache-hadoop data-algorithms design-patterns hadoop-mapreduce machine-learning distributed-computing distributed-algorithms

Created 2014-08-06

787 commits to master branch, last one 6 months ago

Mobius microsoft

211

940

mit

141

C# and F# language binding and extensions to Apache Spark

rdd spark csharp fsharp mobius bigdata dataset dstream dataframe eventhubs mapreduce streaming apache-spark near-real-time kafka-streaming spark-streaming

Created 2015-10-27

1,083 commits to master branch, last one about a year ago

distributed-computing happyer

214

837

mit

27

distributed_computing include mapreduce kvstore etc.

raft mapreduce consistency

Created 2017-01-16

43 commits to master branch, last one 4 years ago

cdap cdapio

345

768

other

95

An open source framework for building data analytic applications.

cdap java spark java-8 python dataset unified platform mapreduce middleware integration spark-streaming

Created 2014-08-02

53,042 commits to develop branch, last one 5 days ago

corral bcongdon

40

693

mit

21

🐎 A serverless MapReduce framework written for AWS Lambda

mapreduce aws-lambda serverless mapreduce-framework

Created 2018-04-02

88 commits to master branch, last one 3 years ago

bigslice grailbio

34

553

apache-2.0

25

A serverless cluster computing system for the Go programming language

go etl golang bigdata cluster computing mapreduce machinelearning

Created 2019-09-10

340 commits to master branch, last one about a year ago

uniffle apache

155

414

apache-2.0

20

Uniffle is a high performance, general purpose Remote Shuffle Service.

rss tez spark shuffle mapreduce remote-shuffle-service

Created 2022-06-17

1,334 commits to master branch, last one 3 days ago

tdigest CamDavidsonPilon

54

393

mit

11

t-Digest data structure in Python. Useful for percentiles and quantiles, including distributed enviroments like PySpark

python pyspark estimate quantile mapreduce percentile distributed-computing

Created 2015-03-16

124 commits to master branch, last one 2 years ago

compass cubefs

137

380

apache-2.0

18

Compass is a task diagnosis platform for bigdata

sql flink spark hadoop airflow bigdata diagnose mapreduce scheduler dolphinscheduler

Created 2023-03-29

489 commits to main branch, last one 4 months ago

RedisGears RedisGears

67

376

other

21

Dynamic execution framework for your Redis data

redis analytics mapreduce redisgears stream-processing

Created 2018-10-21

1,131 commits to master branch, last one 11 months ago

cascading cwensel

221

349

other

33

Cascading is a feature rich API for defining and executing complex and fault tolerant data processing flows locally or on a cluster.

tez java hadoop mapreduce

Created 2009-02-04

2,544 commits to wip-4.6 branch, last one 5 days ago

juicy-bigdata datawhalechina

43

312

unknown

4

🎉🎉🐳 Datawhale大数据处理导论教程 | 大数据技术方向的开篇课程🎉🎉

hdfs hive hbase spark hadoop bigdata mapreduce

Created 2021-11-18

322 commits to master branch, last one about a year ago

Firestorm Tencent

72

255

other

10

Firestorm is a Remote Shuffle Service, and provides the capability for Apache Spark and Apache Hadoop MapReduce applications to store shuffle data on remote servers

spark shuffle mapreduce remoteshuffle

Created 2021-10-29

142 commits to master branch, last one 2 years ago

MapReduce BWbwchen

13

223

mit

7

An easy-to-use Map Reduce Go parallel-computing framework inspired by 2021 6.824 lab1. It supports multiple workers threads on a single machine and multiple processes on a single machine right now.

golang mapreduce mapreduce-go parallel-computing

Created 2021-11-17

43 commits to master branch, last one about a year ago

data-algorithms-with-spark mahmoudparsian

93

213

unknown

13

O'Reilly Book: [Data Algorithms with Spark] by Mahmoud Parsian

Created 2019-12-10

479 commits to master branch, last one about a year ago

learning-hadoop-and-spark lynnlangit

166

194

apache-2.0

16

Companion to Learning Hadoop and Learning Spark courses on Linked In Learning

emr spark hadoop dataproc mapreduce wordcount apache-spark learning-hadoop

Created 2019-06-22

219 commits to master branch, last one 4 months ago

mapreduce kevwan

24

172

mit

3

A in-process MapReduce library to help you optimizing service response time or concurrent task processing.

go golang mapreduce concurrent mapreduce-go concurrent-programming

Created 2021-12-31

29 commits to main branch, last one 2 years ago

big-data-mapreduce-course mahmoudparsian

142

155

unknown

28

Big Data Modeling, MapReduce, Spark, PySpark @ Santa Clara University

Created 2014-12-04

920 commits to master branch, last one 4 months ago

MIT6.824-Java razertory

27

144

mit

2

Java 实现的分布式系统课程(MIT6.824)

java raft mapreduce

Created 2020-12-31

34 commits to main branch, last one 2 years ago

ctenopharyngodon-idella touero

0

140

apache-2.0

1

Use the MapReduce's Java interface to distributed crawle the data of Chinese universities and learn basic knowledge of hdfs.

java maven hadoop fastapi scraping mapreduce hadoop-mapreduce

Created 2023-04-10

77 commits to master branch, last one 6 months ago

dtail mimecast

10

128

apache-2.0

8

DTail is a distributed DevOps tool for tailing, grepping, catting logs and other text files on many remote machines at once.

log adhoc devops golang mimecast mapreduce distributed devops-tools log-management troubleshooting

Created 2019-08-24

469 commits to master branch, last one 7 months ago

tangseng CocaineCong

35

122

apache-2.0

1

Tangseng search engine including full text search and vector search base on golang. 基于go语言的搜索引擎，信息检索系统

gin etcd grpc kafka boltdb docker segment lsm-tree losertree mapreduce search-engine vector-search inverted-index dockcer-compose full-text-search distributed-systems

Created 2023-05-20

359 commits to main branch, last one 3 months ago