Search Results - RepositoryStats

2.6k

13.5k

mit

846

A curated list of awesome big data frameworks, ressources and other awesomeness.

data awesome bigdata database data-stream awesome-list data-science data-analytics data-warehouse streaming-data visualize-data series-database stream-processing data-visualization distributed-database

Created 2014-07-04

586 commits to master branch, last one about a month ago

kafka-ui provectus

1.3k

10.5k

apache-2.0

70

Open-Source Web UI for Apache Kafka Management

kafka web-ui streams big-data kafka-ui opensource apache-kafka kafka-client hacktoberfest kafka-brokers kafka-cluster kafka-connect kafka-manager kafka-streams kafka-producer streaming-data event-streaming cluster-management

Created 2019-11-26

1,918 commits to master branch, last one 12 months ago

miller johnkerl

222

9.2k

other

69

Miller is like awk, sed, cut, join, and sort for name-indexed data such as CSV, TSV, and tabular JSON

Created 2015-05-03

8,991 commits to main branch, last one 5 days ago

connect redpanda-data

859

8.3k

unknown

119

Fancy stream processing made operationally mundane

go etl amqp cqrs logs nats kafka golang data-ops rabbitmq message-bus message-queue event-sourcing streaming-data data-engineering stream-processor stream-processing

Created 2016-03-22

6,269 commits to main branch, last one 7 hours ago

materialize MaterializeInc

469

5.9k

other

71

Real-time Data Integration and Transformation: use SQL to transform, deliver, and act on fast-changing data.

sql rust kafka database streaming data-store postgresql streaming-data materialized-view stream-processing postgresql-dialect distributed-systems operational-data-store

Created 2019-02-22

43,001 commits to main branch, last one 2 hours ago

river online-ml

562

5.3k

bsd-3-clause

84

🌊 Online machine learning in Python

python streaming data-science concept-drift streaming-data online-learning machine-learning online-statistics stream-processing incremental-learning real-time-processing online-machine-learning

Created 2019-01-24

3,949 commits to main branch, last one about a month ago

readyset readysettech

138

4.9k

other

29

Readyset is a MySQL and Postgres wire-compatible caching layer that sits in front of existing databases to speed up queries and horizontally scale read throughput. Under the hood, ReadySet caches the ...

sql rust cache mysql backend caching postgres databases rust-lang postgresql caching-proxy mysql-database streaming-data postgresql-database

Created 2022-05-24

10,600 commits to main branch, last one a day ago

fluvio infinyon

503

4.4k

apache-2.0

46

Lean and mean distributed stream processing system written in rust and web assembly. Alternative to Kafka + Flink in one.

rust stateful data-flow real-time streaming serverless webassembly cloud-native data-analytics data-pipelines streaming-data data-integration stream-processing distributed-systems streaming-analytics stream-processing-engine streaming-data-pipelines event-driven-architecture streaming-data-processing

Created 2019-08-31

2,486 commits to master branch, last one a day ago

smart_open piskvorky

382

3.3k

mit

46

Utils for streaming large files (S3, HDFS, gzip, bz2...)

s3 bz2 boto file hdfs python webhdfs streaming gzip-stream hacktoberfest streaming-data

Created 2015-01-02

1,105 commits to develop branch, last one 8 days ago

memgraph memgraph

140

2.7k

other

21

Open-source graph database, tuned for dynamic analytics environments. Easy to adopt, scale and own.

graph kafka nosql cypher opencypher kafka-streams graph-analysis graph-database streaming-data graph-algorithms stream-processing

Created 2020-09-21

4,247 commits to master branch, last one a day ago

go-streams reugn

165

2.0k

mit

28

A lightweight stream processing library for Go

Created 2019-04-30

202 commits to master branch, last one 14 days ago

pravega pravega

408

2.0k

apache-2.0

106

Pravega - Streaming as a new software defined storage primitive

streaming data-ingestion real-time-data streaming-data distributed-storage

Created 2016-07-11

3,297 commits to master branch, last one about a month ago

bytewax bytewax

77

1.7k

apache-2.0

19

Python Stream Processing

rust python dataflow data-science streaming-data data-processing data-engineering machine-learning stream-processing

Created 2022-02-04

2,575 commits to main branch, last one 14 days ago

quix-streams quixio

75

1.3k

apache-2.0

18

Python Streaming DataFrames for Kafka

kafka python data-science streaming-data data-engineering machine-learning stream-processor time-series-data stream-processing streaming-data-pipelines event-driven-architecture real-time-data-processing streaming-data-processing data-intensive-applications

Created 2022-11-17

625 commits to main branch, last one 23 hours ago

streamz python-streamz

150

1.3k

bsd-3-clause

37

Real-time stream processing for python

async python real-time streaming-data

Created 2017-04-04

811 commits to master branch, last one 4 months ago

Trill microsoft

131

1.3k

mit

62

Trill is a single-node query processor for temporal or streaming data.

temporal-data streaming-data

Created 2018-09-26

232 commits to master branch, last one about a year ago

zpl zpl-c

46

1.0k

other

20

📐 Pushing the boundaries of simplicity

Created 2017-07-10

1,409 commits to master branch, last one 7 months ago

kafka-ui kafbat

125

962

apache-2.0

13

Open-Source Web UI for managing Apache Kafka clusters

foss kafka web-ui streams big-data kafka-ui opensource apache-kafka kafka-client hacktoberfest kafka-brokers kafka-cluster kafka-connect kafka-manager kafka-streams kafka-producer streaming-data event-streaming cluster-management

Created 2024-01-22

2,192 commits to main branch, last one 3 days ago

superdiff DoneDeal0

8

913

unknown

3

Superdiff provides a complete and readable diff for both arrays and objects. Plus, it supports stream and file inputs for handling large datasets efficiently, is battle-tested, has zero dependencies, ...

diff react nodejs deep-diff json-diff streaming comparison objectdiff typescript object-diff streaming-data comparison-tool array-comparison objectdifference object-comparison

Created 2022-12-23

60 commits to master branch, last one about a month ago

OnlineStats.jl joshday

64

861

mit

23

⚡ Single-pass algorithms for statistics

julia big-data julialang statistics onlinestats julia-language streaming-data online-algorithms stochastic-approximation

Created 2015-02-04

2,527 commits to master branch, last one 6 months ago

scikit-multiflow scikit-multiflow

188

774

bsd-3-clause

27

A machine learning package for streaming data in Python. The other ancestor of River.

moa meka scikit stream scikit-learn streaming-data machine-learning

Created 2017-11-14

1,088 commits to master branch, last one 4 years ago

hstream hstreamdb

55

722

bsd-3-clause

23

HStreamDB is an open-source, cloud-native streaming database for IoT and beyond. Modernize your data stack for real-time applications.

iot sql kafka scale haskell database hstreamdb real-time streaming iot-database streaming-data data-processing materialized-view realtime-database stream-processing financial-analysis streaming-database distributed-systems distributed-database

Created 2020-08-31

1,726 commits to main branch, last one 3 months ago

streamdal streamdal

15

593

apache-2.0

6

Code-Native Data Privacy

go deno rust wasi wasm docker nodejs python tail-f astrojs reactjs javascript event-driven observability data-contracts message-queues streaming-data

Created 2023-08-04

4,559 commits to main branch, last one 4 months ago

awesome-kafka infoslack

163

580

unknown

30

A list about Apache Kafka

kafka apache-kafka apache-spark data-pipeline kafka-streams infrastructure streaming-data data-processing stream-processing

Created 2016-04-29

85 commits to master branch, last one 23 days ago

rrcf kLabUM

113

507

mit

18

🌲 Implementation of the Robust Random Cut Forest algorithm for anomaly detection on streams

tree python outliers random-forest streaming-data detect-outliers machine-learning anomaly-detection robust-random-cut-forest

Created 2018-10-20

266 commits to master branch, last one about a year ago

swim swimos

41

492

apache-2.0

30

Full stack application platform for building stateful microservices, streaming APIs, and real-time UIs

stateful real-time web-agent serverless websockets actor-model streaming-api streaming-data non-blocking-io distributed-systems serverless-framework asynchronous-programming decentralized-applications microservices-architecture

Created 2019-02-19

618 commits to main branch, last one 9 months ago

optbinning guillermo-navas-palencia

101

467

apache-2.0

17

Optimal binning: monotonic binning with constraints. Support batch & stream optimal binning. Scorecard modelling and counterfactual explanations.

woe mdlp python stream binning scorecard woebinning optimization credit-scoring streaming-data batch-processing counterfactual-explanations

Created 2019-12-31

921 commits to master branch, last one about a month ago

you-cant-download-this-image radiantly

23

341

mit

4

Downloading images from the web is as easy as right clicking them and selecting "Save image as..", right? Well, not anymore xD

http rust streaming-data

Created 2021-05-04

14 commits to main branch, last one about a year ago

cloudflow lightbend

90

319

apache-2.0

13

Cloudflow enables users to quickly develop, orchestrate, and operate distributed streaming applications on Kubernetes.

akka flink spark cloudflow kubernetes streaming-data streaming-runtimes streaming-applications microservices-architectures

This repository has been archived (exclude archived)

Created 2019-11-08

1,204 commits to main branch, last one 7 months ago

data-accelerator microsoft

91

301

mit

29

Data Accelerator for Apache Spark simplifies onboarding to Streaming of Big Data. It offers a rich, easy to use experience to help with creation, editing and management of Spark jobs on Azure HDInsigh...

Created 2019-03-14

961 commits to master branch, last one 2 months ago