Search Results - RepositoryStats

angel Angel-ML

1.6k

6.7k

other

449

A Flexible and Powerful Parameter Server for large-scale machine learning

model scala spark online-learning spark-streaming high-dimensional machine-learning parameter-server

Created 2017-04-25

2,963 commits to master branch, last one about a year ago

risingwave risingwavelabs

524

6.4k

apache-2.0

79

SQL stream processing, analytics, and management. We decouple storage and compute to offer instant failover, dynamic scaling, speedy bootstrapping, and efficient joins.

Created 2022-01-28

10,598 commits to main branch, last one 16 hours ago

CoolplaySpark lw-lin

1.4k

3.4k

unknown

443

酷玩 Spark: Spark 源代码解析、Spark 类库等

spark sparkcore apache-spark spark-streaming structured-streaming

Created 2015-12-03

138 commits to master branch, last one 2 years ago

Movie_Recommend LuckyZXL2016

1.0k

2.7k

mit

108

基于Spark的电影推荐系统，包含爬虫项目、web网站、后台管理系统以及spark推荐系统

hive mysql nginx scala hadoop scrapy ssm-maven spark-mllib spark-streaming

Created 2018-04-18

27 commits to master branch, last one 5 years ago

spark dotnet

310

2.0k

mit

92

.NET for Apache® Spark™ makes Apache Spark™ easily accessible to .NET developers.

Created 2019-04-22

372 commits to main branch, last one about a year ago

utils4s jacksu

437

1.1k

unknown

130

scala、spark使用过程中，各种测试用例以及相关资料整理

akka scala spark breeze json4s scala-demo scala-spark spark-streaming

Created 2015-09-24

226 commits to master branch, last one 5 years ago

wormhole edp963

481

977

apache-2.0

103

Wormhole is a SPaaS (Stream Processing as a Service) Platform

wormhole spark-streaming stream-processing

Created 2017-09-05

6,922 commits to master branch, last one 3 years ago

Mobius microsoft

212

940

mit

145

C# and F# language binding and extensions to Apache Spark

rdd spark csharp fsharp mobius bigdata dataset dstream dataframe eventhubs mapreduce streaming apache-spark near-real-time kafka-streaming spark-streaming

Created 2015-10-27

1,083 commits to master branch, last one 4 months ago

cdap cdapio

338

743

other

97

An open source framework for building data analytic applications.

cdap java spark java-8 python dataset unified platform mapreduce middleware integration spark-streaming

Created 2014-08-02

52,744 commits to develop branch, last one 16 days ago

streaming-readings lw-lin

154

720

unknown

50

Streaming System 相关的论文读物

s4 spe flink heron storm drizzle dataflow millwheel streaming apache-spark spark-streaming streaming-engine stream-processing stream-processing-engine

Created 2017-01-24

3 commits to master branch, last one 7 years ago

sylph harbby

175

403

apache-2.0

46

Stream computing platform for bigdata

sql java flink sylph big-data streamsql spark-streaming

Created 2018-06-19

625 commits to main branch, last one 2 years ago

data-accelerator microsoft

89

295

mit

31

Data Accelerator for Apache Spark simplifies onboarding to Streaming of Big Data. It offers a rich, easy to use experience to help with creation, editing and management of Spark jobs on Azure HDInsigh...

Created 2019-03-14

942 commits to master branch, last one 21 days ago

dbldatagen databrickslabs

53

272

other

13

Generate relevant synthetic data quickly for your projects. The Databricks Labs synthetic data generator (aka `dbldatagen`) may be used to generate large simulated / synthetic data sets for test, POC...

faker spark python datagen pyspark deltalake databricks datagenerator datageneration synthetic-data data-generation spark-streaming delta-live-tables

Created 2019-07-23

290 commits to master branch, last one 9 hours ago

gimel paypal

97

243

apache-2.0

36

Big Data Processing Framework - Unified Data API or SQL on Any Storage

jdbc gimel hbase kafka scala spark paypal python pyspark restapi big-data data-api teradata aerospike cassandra elasticsearch streaming-sql spark-streaming

Created 2018-04-04

167 commits to master branch, last one about a year ago

azure-event-hubs-spark Azure

173

232

apache-2.0

48

Enabling Continuous Data Processing with Apache Spark and Azure Event Hubs

azure kafka scala spark apache stream bigdata connector eventhubs ingestion microsoft real-time streaming continuous databricks event-hubs apache-spark spark-streaming structured-streaming

Created 2015-09-04

377 commits to master branch, last one about a year ago

streamline hortonworks

97

163

apache-2.0

684

StreamLine - Streaming Analytics

flink kafka storm real-time streaming kafka-streams spark-streaming

Created 2015-05-14

2,413 commits to master branch, last one 4 years ago

pyspark-learning awantik

125

157

unknown

19

Updated repository

spark pyspark spark-streaming

Created 2017-03-15

23 commits to master branch, last one 5 years ago

kinesis-sql qubole

79

137

apache-2.0

13

Kinesis Connector for Structured Streaming

spark kinesis spark-streaming real-time-processing structured-streaming spark-structured-streaming

Created 2018-03-01

90 commits to master branch, last one about a year ago

Spark-MLlib-Twitter-Sentiment-Analysis P7h

67

135

apache-2.0

11

:star2: :sparkles: Analyze and visualize Twitter Sentiment on a world map using Spark MLlib

scala spark spark-mllib visualization spark-streaming machine-learning naive-bayes-classification twitter-sentiment-analysis

Created 2016-08-18

14 commits to master branch, last one 7 years ago

Spark-Streaming-In-Python LearningJournal

148

113

mit

7

Apache Spark 3 - Structured Streaming Course Material

python bigdata pyspark big-data data-lake spark-sql apache-spark spark-streaming

Created 2020-07-21

29 commits to master branch, last one 3 years ago

movie-recommender-demo snowch

57

100

apache-2.0

11

This project walks through how you can create recommendations using Apache Spark machine learning. There are a number of jupyter notebooks that you can run on IBM Data Science Experience, and there a ...

Created 2017-01-13

245 commits to master branch, last one about a year ago

pyspark-examples abulbasar

87

98

apache-2.0

6

Code examples on Apache Spark using python

spark apache python spark-streaming

Created 2017-08-09

138 commits to master branch, last one about a year ago

spark-states chermenin

26

93

apache-2.0

8

Custom state store providers for Apache Spark

spark state apache stateful state-store apache-spark spark-streaming structured-streaming spark-structured-streaming

Created 2018-08-13

43 commits to master branch, last one 2 years ago

ApacheSpark martandsingh

59

82

unknown

12

This repository will help you to learn about databricks concept with the help of examples. It will include all the important topics which we need in our real life experience as a data engineer. We wil...

etl sql hive spark hadoop pyspark database datalake deltalake spark-sql databricks timetravel apachespark etl-pipeline data-analysis spark-streaming data-engineering

Created 2022-05-10

45 commits to master branch, last one about a year ago

spark_app_twitter jmcmt87

10

64

unknown

3

A data engineering project (Twitter monitor app)

s3 kafka altair pandas python mongodb pyspark spark-streaming

Created 2022-04-14

83 commits to main branch, last one about a year ago

kafka-connect-msk-demo garystafford

28

62

mit

4

For a series of posts on Amazon MSK, Amazon EKS, and Amazon EMR

aws kafka spark kubernetes kafka-connect spark-streaming

Created 2021-08-10

88 commits to main branch, last one 2 years ago

spark-training dimajix

67

53

unknown

5

Repository used for Spark Trainings

hive scala spark sqoop hadoop python pyspark spark-ml spark-training hadoop-training spark-streaming

Created 2015-12-28

358 commits to master branch, last one 2 years ago

Projects zhonghuasheng

6

52

unknown

4

秒杀，音乐商店项目实战，Redis源码，推荐系统

jdbc mysql redis jquery springcloud spark-streaming jsp-servlet-mysql springcloudalibaba

Created 2019-05-22

583 commits to master branch, last one 2 years ago

streaming_data_processing dogukannulu

22

49

unknown

2

Create a streaming data, transfer it to Kafka, modify it with PySpark, take it to ElasticSearch and MinIO

hdfs kafka minio spark docker hadoop kibana python airflow pyspark zookeeper elasticsearch spark-streaming

Created 2022-11-12

27 commits to main branch, last one 10 months ago

open-stream-processing-benchmark Klarrio

13

45

apache-2.0

4

This repository contains the code base for the Open Stream Processing Benchmark.

flink kafka spark benchmark real-time kafka-streams benchmark-suite spark-streaming stream-processing distributed-systems real-time-processing structured-streaming distributed-computing

Created 2019-07-26

27 commits to master branch, last one 2 years ago