Joshua-omolewa / Stock_streaming_pipeline_project

Built a real-time streaming pipeline to extract stock data, using Apache Nifi, Debezium, Kafka, and Spark Streaming. Loaded the transformed data into Glue database and created real-time dashboards using Power BI and Tableau with Athena. The pipeline is orchestrated using Airflow.

Date Created 2023-04-05 (about a year ago)
Commits 56 (last one about a year ago)
Stargazers 25 (0 this week)
Watchers 3 (0 this week)
Forks 5
License unknown
Ranking

RepositoryStats indexes 619,742 repositories, of these Joshua-omolewa/Stock_streaming_pipeline_project is ranked #612,210 (1st percentile) for total stargazers, and #434,461 for total watchers. Github reports the primary language for this repository as Python, for repositories using this language it is ranked #123,776/125,409.

Joshua-omolewa/Stock_streaming_pipeline_project is also tagged with popular topics, for these it's ranked: docker (#6,461/6515),  etl (#279/279),  stream-processing (#151/154),  airflow (#150/150),  apache-spark (#113/113)

Star History

Github stargazers over time

303025252020151510105500May '23May '23Jun '23Jun '23Jul '23Jul '23Aug '23Aug '23Sep '23Sep '23Oct '23Oct '23Nov '23Nov '23Dec '23Dec '2320242024Feb '24Feb '24Mar '24Mar '24Apr '24Apr '24May '24May '24Jun '24Jun '24Jul '24Jul '24Aug '24Aug '24Sep '24Sep '24Oct '24Oct '24Nov '24Nov '24Dec '24Dec '2420252025Feb '25Feb '25

Watcher History

Github watchers over time, collection started in '23

4444443.53.5333333Dec '24Dec '2415 Dec15 DecJan '25Jan '2515 Jan15 JanFeb '25Feb '2515 Feb15 Feb

Recent Commit History

56 commits on the default branch (main) since jan '22

60605050404030302020101000May '23May '23Jun '23Jun '23Jul '23Jul '23Aug '23Aug '23Sep '23Sep '23Oct '23Oct '23Nov '23Nov '2320242024Feb '24Feb '24Mar '24Mar '24Apr '24Apr '24May '24May '24Jun '24Jun '24Jul '24Jul '24Aug '24Aug '24Sep '24Sep '24Oct '24Oct '24Nov '24Nov '2420252025Feb '25Feb '25

Yearly Commits

Commits to the default branch (main) per year

2222111111000020242024

Issue History

No issues have been posted

Languages

The primary language is Python but there's also others...

PythonPythonCSSCSS

updated: 2025-01-31 @ 08:52am, id: 623801940 / R_kgDOJS52VA