Search Results - RepositoryStats

2.6k

13.3k

mit

847

A curated list of awesome big data frameworks, ressources and other awesomeness.

data awesome bigdata database data-stream awesome-list data-science data-analytics data-warehouse streaming-data visualize-data series-database stream-processing data-visualization distributed-database

Created 2014-07-04

577 commits to master branch, last one about a year ago

kafka-ui provectus

1.2k

9.8k

apache-2.0

68

Open-Source Web UI for Apache Kafka Management

kafka web-ui streams big-data kafka-ui opensource apache-kafka kafka-client hacktoberfest kafka-brokers kafka-cluster kafka-connect kafka-manager kafka-streams kafka-producer streaming-data event-streaming cluster-management

Created 2019-11-26

1,918 commits to master branch, last one 7 months ago

miller johnkerl

217

9.0k

other

71

Miller is like awk, sed, cut, join, and sort for name-indexed data such as CSV, TSV, and tabular JSON

Created 2015-05-03

8,946 commits to main branch, last one a day ago

connect redpanda-data

840

8.1k

unknown

120

Fancy stream processing made operationally mundane

go etl amqp cqrs logs nats kafka golang data-ops rabbitmq message-bus message-queue event-sourcing streaming-data data-engineering stream-processor stream-processing

Created 2016-03-22

5,651 commits to main branch, last one 23 hours ago

materialize MaterializeInc

468

5.8k

other

73

The Cloud Operational Data Store: use SQL to transform, deliver, and act on fast-changing data.

sql rust kafka database streaming data-store postgresql streaming-data materialized-view stream-processing postgresql-dialect distributed-systems operational-data-store

Created 2019-02-22

40,526 commits to main branch, last one 18 hours ago

river online-ml

552

5.1k

bsd-3-clause

83

🌊 Online machine learning in Python

python streaming data-science concept-drift streaming-data online-learning machine-learning online-statistics stream-processing incremental-learning real-time-processing online-machine-learning

Created 2019-01-24

3,917 commits to main branch, last one 2 days ago

readyset readysettech

125

4.5k

other

25

Readyset is a MySQL and Postgres wire-compatible caching layer that sits in front of existing databases to speed up queries and horizontally scale read throughput. Under the hood, ReadySet caches the ...

sql rust cache mysql backend caching postgres databases rust-lang postgresql caching-proxy mysql-database streaming-data postgresql-database

Created 2022-05-24

10,246 commits to main branch, last one 16 hours ago

fluvio infinyon

489

3.9k

apache-2.0

42

Lean and mean distributed stream processing system written in rust and web assembly. Alternative to Kafka + Flink in one.

rust stateful data-flow real-time streaming serverless webassembly cloud-native data-analytics data-pipelines streaming-data data-integration stream-processing distributed-systems streaming-analytics stream-processing-engine streaming-data-pipelines event-driven-architecture streaming-data-processing

Created 2019-08-31

2,371 commits to master branch, last one a day ago

smart_open piskvorky

383

3.2k

mit

47

Utils for streaming large files (S3, HDFS, gzip, bz2...)

s3 bz2 boto file hdfs python webhdfs streaming gzip-stream hacktoberfest streaming-data

Created 2015-01-02

1,091 commits to develop branch, last one 21 days ago

memgraph memgraph

121

2.4k

other

21

Open-source graph database, tuned for dynamic analytics environments. Easy to adopt, scale and own.

graph kafka nosql cypher opencypher kafka-streams graph-analysis graph-database streaming-data graph-algorithms stream-processing

Created 2020-09-21

4,081 commits to master branch, last one a day ago

pravega pravega

407

2.0k

apache-2.0

106

Pravega - Streaming as a new software defined storage primitive

streaming data-ingestion real-time-data streaming-data distributed-storage

Created 2016-07-11

3,295 commits to master branch, last one 3 months ago

go-streams reugn

157

1.9k

mit

28

A lightweight stream processing library for Go

Created 2019-04-30

191 commits to master branch, last one 11 days ago

bytewax bytewax

64

1.6k

apache-2.0

18

Python Stream Processing

rust python dataflow data-science streaming-data data-processing data-engineering machine-learning stream-processing

Created 2022-02-04

2,548 commits to main branch, last one 5 days ago

Trill microsoft

132

1.2k

mit

63

Trill is a single-node query processor for temporal or streaming data.

temporal-data streaming-data

Created 2018-09-26

232 commits to master branch, last one 10 months ago

streamz python-streamz

148

1.2k

bsd-3-clause

35

Real-time stream processing for python

async python real-time streaming-data

Created 2017-04-04

805 commits to master branch, last one about a year ago

quix-streams quixio

69

1.2k

apache-2.0

19

Python stream processing for Kafka

kafka python data-science streaming-data data-engineering machine-learning stream-processor time-series-data stream-processing streaming-data-pipelines event-driven-architecture real-time-data-processing streaming-data-processing data-intensive-applications

Created 2022-11-17

483 commits to main branch, last one 19 hours ago

zpl zpl-c

41

993

other

21

📐 Pushing the boundaries of simplicity

Created 2017-07-10

1,409 commits to master branch, last one 3 months ago

OnlineStats.jl joshday

64

836

mit

24

⚡ Single-pass algorithms for statistics

julia big-data julialang statistics onlinestats julia-language streaming-data online-algorithms stochastic-approximation

Created 2015-02-04

2,527 commits to master branch, last one about a month ago

scikit-multiflow scikit-multiflow

185

766

bsd-3-clause

28

A machine learning package for streaming data in Python. The other ancestor of River.

moa meka scikit stream scikit-learn streaming-data machine-learning

Created 2017-11-14

1,088 commits to master branch, last one 4 years ago

hstream hstreamdb

55

708

bsd-3-clause

25

HStreamDB is an open-source, cloud-native streaming database for IoT and beyond. Modernize your data stack for real-time applications.

iot sql kafka scale haskell database hstreamdb real-time streaming iot-database streaming-data data-processing materialized-view realtime-database stream-processing financial-analysis streaming-database distributed-systems distributed-database

Created 2020-08-31

1,725 commits to main branch, last one about a month ago

superdiff DoneDeal0

5

697

unknown

3

Superdiff provides a complete and readable diff for both arrays and objects. Plus, it supports stream and file inputs for handling large datasets efficiently, is battle-tested, has zero dependencies, ...

diff react nodejs deep-diff json-diff streaming comparison objectdiff typescript object-diff streaming-data comparison-tool array-comparison objectdifference object-comparison

Created 2022-12-23

59 commits to master branch, last one 17 days ago

kafka-ui kafbat

80

622

apache-2.0

8

Open-Source Web UI for managing Apache Kafka clusters

foss kafka web-ui streams big-data kafka-ui opensource apache-kafka kafka-client hacktoberfest kafka-brokers kafka-cluster kafka-connect kafka-manager kafka-streams kafka-producer streaming-data event-streaming cluster-management

Created 2024-01-22

2,087 commits to main branch, last one 3 days ago

streamdal streamdal

16

584

apache-2.0

6

Code-Native Data Privacy

go deno rust wasi wasm docker nodejs python tail-f astrojs reactjs javascript event-driven observability data-contracts message-queues streaming-data

Created 2023-08-04

4,559 commits to main branch, last one 5 days ago

awesome-kafka infoslack

163

579

unknown

31

A list about Apache Kafka

kafka apache-kafka apache-spark data-pipeline kafka-streams infrastructure streaming-data data-processing stream-processing

Created 2016-04-29

82 commits to master branch, last one 9 months ago

rrcf kLabUM

112

497

mit

19

🌲 Implementation of the Robust Random Cut Forest algorithm for anomaly detection on streams

tree python outliers random-forest streaming-data detect-outliers machine-learning anomaly-detection robust-random-cut-forest

Created 2018-10-20

266 commits to master branch, last one about a year ago

swim swimos

39

489

apache-2.0

30

Full stack application platform for building stateful microservices, streaming APIs, and real-time UIs

stateful real-time web-agent serverless websockets actor-model streaming-api streaming-data non-blocking-io distributed-systems serverless-framework asynchronous-programming decentralized-applications microservices-architecture

Created 2019-02-19

618 commits to main branch, last one 5 months ago

optbinning guillermo-navas-palencia

100

458

apache-2.0

18

Optimal binning: monotonic binning with constraints. Support batch & stream optimal binning. Scorecard modelling and counterfactual explanations.

woe mdlp python stream binning scorecard woebinning optimization credit-scoring streaming-data batch-processing counterfactual-explanations

Created 2019-12-31

917 commits to master branch, last one 23 days ago

you-cant-download-this-image radiantly

23

343

mit

5

Downloading images from the web is as easy as right clicking them and selecting "Save image as..", right? Well, not anymore xD

http rust streaming-data

Created 2021-05-04

14 commits to main branch, last one 9 months ago

cloudflow lightbend

90

321

apache-2.0

15

Cloudflow enables users to quickly develop, orchestrate, and operate distributed streaming applications on Kubernetes.

akka flink spark cloudflow kubernetes streaming-data streaming-runtimes streaming-applications microservices-architectures

Created 2019-11-08

1,204 commits to main branch, last one 3 months ago

data-accelerator microsoft

91

299

mit

30

Data Accelerator for Apache Spark simplifies onboarding to Streaming of Big Data. It offers a rich, easy to use experience to help with creation, editing and management of Spark jobs on Azure HDInsigh...

Created 2019-03-14

960 commits to master branch, last one about a month ago