dogukannulu / streaming_data_processing

Create a streaming data, transfer it to Kafka, modify it with PySpark, take it to ElasticSearch and MinIO

Date Created 2022-11-12 (about a year ago)

Commits 27 (last one 10 months ago)

Stargazers 49 (0 this week)

Watchers 2 (0 this week)

Forks 22

License unknown

Ranking

RepositoryStats indexes 523,840 repositories, of these dogukannulu/streaming_data_processing is ranked #430,466 (18th percentile) for total stargazers, and #442,567 for total watchers. Github reports the primary language for this repository as Python, for repositories using this language it is ranked #79,712/100,813.

dogukannulu/streaming_data_processing is also tagged with popular topics, for these it's ranked: python (#17,409/20132), docker (#4,916/5687), kafka (#680/769), elasticsearch (#668/714), spark (#447/498), hadoop (#163/167), airflow (#104/131)

All Topics

hdfs kafka minio spark docker hadoop kibana python airflow pyspark zookeeper elasticsearch spark-streaming

Star History

Github stargazers over time

Watcher History

Github watchers over time, collection started in '23

Recent Commit History

27 commits on the default branch (main) since jan '22

Yearly Commits

Commits to the default branch (main) per year

Issue History

No issues have been posted

Languages

The primary language is Python but there's also others...

updated: 2024-05-22 @ 02:53pm, id: 565269880 / R_kgDOIbFVeA