Statistics for topic spark

RepositoryStats tracks 663,734 Github repositories, of these 563 are tagged with the spark topic. The most common primary language for repositories using this topic is Scala (145). Other languages include: Python (107),  Java (104),  Jupyter Notebook (67),  JavaScript (18),  Shell (12),  Go (11)

Stargazers over time for topic spark

Most starred repositories for topic spark (view more)

apache
spark apache
28.6k
41.3k
apache-2.0
2.0k
Apache Spark - A unified analytics engine for large-scale data processing
r sql java jdbc scala spark python big-data
Created 2014-02-25
44,616 commits to master branch, last one 4 hours ago
DataTalksClub
data-engineering-zoomcamp DataTalksClub
6.6k
31.0k
unknown
506
Data Engineering Zoomcamp is a free nine-week course that covers the fundamentals of data engineering.
dbt kafka spark docker kestra data-engineering
Created 2021-10-21
1,036 commits to main branch, last one about a month ago
donnemartin
data-science-ipython-notebooks donnemartin
8.0k
28.3k
other
1.6k
Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark, Hadoop MapReduce, HDFS), matplotlib, pandas, NumPy, SciPy, Python essentials, AW...
aws caffe keras numpy scipy spark hadoop kaggle pandas python theano big-data mapreduce matplotlib tensorflow data-science scikit-learn deep-learning machine-learning
Created 2015-01-23
543 commits to master branch, last one 6 years ago
getredash
redash getredash
4.5k
27.4k
bsd-2-clause
568
Make Your Company Data Driven. Connect to any data source, easily visualize, dashboard and share your data.
bi mysql spark athena python redash bigquery redshift analytics dashboard spark-sql databricks javascript postgresql hacktoberfest visualization business-intelligence
Created 2013-10-28
7,879 commits to master branch, last one 16 days ago
yeasy
docker_practice yeasy
5.8k
25.5k
unknown
840
Learn and understand Docker&Container technologies, with real DevOps practice!
book linux mesos spark swarm devops docker container kubernetes cloud-computing
Created 2014-09-05
1,235 commits to master branch, last one 5 months ago
heibaiying
BigData-Notes heibaiying
4.3k
16.5k
unknown
447
大数据入门指南 :star:
hdfs hive yarn flume hbase kafka scala spark sqoop storm hadoop azkaban bigdata phoenix big-data mapreduce zookeeper
Created 2019-03-10
607 commits to master branch, last one 2 years ago

Trending repositories for topic spark (view more)

Last 3 days (new repositories)
no newly created repositories trending in the last 3 days
Last 3 days (absolute gain)
DataTalksClub
DataTalksClub/data-engineering-zoomcamp

Data Engineering Zoomcamp is a free nine-week course that covers the fundamentals of data engineering.

31,044 (+53)
apache
apache/spark

Apache Spark - A unified analytics engine for large-scale data processing

41,320 (+21)
apache-2.0
tobymao
tobymao/sqlglot

Python SQL Parser and Transpiler

7,870 (+15)
mit
getredash
getredash/redash

Make Your Company Data Driven. Connect to any data source, easily visualize, dashboard and share your data.

27,422 (+12)
bsd-2-clause
donnemartin
donnemartin/data-science-ipython-notebooks

Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark, Hadoop MapReduce, HDFS), matplotlib, pandas, NumPy, SciPy, Python essentials, AW...

28,284 (+11)
Last 3 days (relative gain)
drisskhattabi6
drisskhattabi6/Real-Time-Twitter-Sentiment-Analysis

This repo contains Big Data Project, its about "Real Time Twitter Sentiment Analysis via Kafka, Spark Streaming, MongoDB and Django Dashboard".

25 (+4%)
pdsuwwz
pdsuwwz/chatgpt-vue3-light-mvp

💭 一个可二次开发 Chat Bot 单轮对话 Web 端 MVP 原型模板, 基于 Vue 3, Vite 6, TypeScript, Naive UI, Pinia(v3), UnoCSS 等主流技术构建, 🧤简单集成大模型 API, 采用单轮 AI 问答对话模式, 每次提问独立响应, 无需上下文, 支持打字机效果流式输出, 集成 markdown-it Mermaid/KaTex/L...

379 (+0.8%)
mit
data-prep-kit
data-prep-kit/data-prep-kit

Open source project for data preparation for GenAI applications

707 (+0.6%)
apache-2.0
apache
apache/datafusion-comet

Apache DataFusion Comet Spark Accelerator

970 (+0.3%)
apache-2.0
WeBankFinTech
WeBankFinTech/WeDataSphere

WeDataSphere is a financial grade, one-stop big data platform suite.

668 (+0.1%)
Last week (new repositories)
no newly created repositories trending in the last week
Last week (absolute gain)
DataTalksClub
DataTalksClub/data-engineering-zoomcamp

Data Engineering Zoomcamp is a free nine-week course that covers the fundamentals of data engineering.

31,044 (+130)
apache
apache/spark

Apache Spark - A unified analytics engine for large-scale data processing

41,320 (+50)
apache-2.0
donnemartin
donnemartin/data-science-ipython-notebooks

Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark, Hadoop MapReduce, HDFS), matplotlib, pandas, NumPy, SciPy, Python essentials, AW...

28,284 (+38)
FavioVazquez
FavioVazquez/ds-cheatsheets

List of Data Science Cheatsheets to rule the world

15,441 (+33)
mit
tobymao
tobymao/sqlglot

Python SQL Parser and Transpiler

7,870 (+29)
mit
Last week (relative gain)
drisskhattabi6
drisskhattabi6/Real-Time-Twitter-Sentiment-Analysis

This repo contains Big Data Project, its about "Real Time Twitter Sentiment Analysis via Kafka, Spark Streaming, MongoDB and Django Dashboard".

25 (+9%)
pdsuwwz
pdsuwwz/chatgpt-vue3-light-mvp

💭 一个可二次开发 Chat Bot 单轮对话 Web 端 MVP 原型模板, 基于 Vue 3, Vite 6, TypeScript, Naive UI, Pinia(v3), UnoCSS 等主流技术构建, 🧤简单集成大模型 API, 采用单轮 AI 问答对话模式, 每次提问独立响应, 无需上下文, 支持打字机效果流式输出, 集成 markdown-it Mermaid/KaTex/L...

379 (+3%)
mit
apache
apache/spark-kubernetes-operator

Apache Spark Kubernetes Operator

176 (+3%)
apache-2.0
DataEval
DataEval/dingo

Dingo: A Comprehensive Data Quality Evaluation Tool

176 (+2%)
apache-2.0
dogukannulu
dogukannulu/streaming_data_processing

Create a streaming data, transfer it to Kafka, modify it with PySpark, take it to ElasticSearch and MinIO

62 (+2%)
Last month (new repositories)
no newly created repositories trending in the last month
Last month (absolute gain)
DataTalksClub
DataTalksClub/data-engineering-zoomcamp

Data Engineering Zoomcamp is a free nine-week course that covers the fundamentals of data engineering.

31,044 (+427)
apache
apache/spark

Apache Spark - A unified analytics engine for large-scale data processing

41,320 (+203)
apache-2.0
tobymao
tobymao/sqlglot

Python SQL Parser and Transpiler

7,870 (+152)
mit
apache
apache/doris

Apache Doris is an easy-to-use, high performance and unified analytics database.

13,812 (+150)
apache-2.0
donnemartin
donnemartin/data-science-ipython-notebooks

Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark, Hadoop MapReduce, HDFS), matplotlib, pandas, NumPy, SciPy, Python essentials, AW...

28,284 (+116)
Last month (relative gain)
hoangsonww
hoangsonww/End-to-End-Data-Pipeline

📈 A scalable, production-ready data pipeline for real-time streaming & batch processing, integrating Kafka, Spark, Airflow, AWS, Kubernetes, and MLflow. Supports end-to-end data ingestion, transforma...

40 (+25%)
mit
apache
apache/spark-kubernetes-operator

Apache Spark Kubernetes Operator

176 (+21%)
apache-2.0
zuston
zuston/riffle

Rust based high-performance Apache Uniffle shuffle-server

35 (+17%)
DataEval
DataEval/dingo

Dingo: A Comprehensive Data Quality Evaluation Tool

176 (+16%)
apache-2.0
pdsuwwz
pdsuwwz/chatgpt-vue3-light-mvp

💭 一个可二次开发 Chat Bot 单轮对话 Web 端 MVP 原型模板, 基于 Vue 3, Vite 6, TypeScript, Naive UI, Pinia(v3), UnoCSS 等主流技术构建, 🧤简单集成大模型 API, 采用单轮 AI 问答对话模式, 每次提问独立响应, 无需上下文, 支持打字机效果流式输出, 集成 markdown-it Mermaid/KaTex/L...

379 (+10%)
mit
Last 12-months (new repositories)
pdsuwwz
pdsuwwz/chatgpt-vue3-light-mvp

💭 一个可二次开发 Chat Bot 单轮对话 Web 端 MVP 原型模板, 基于 Vue 3, Vite 6, TypeScript, Naive UI, Pinia(v3), UnoCSS 等主流技术构建, 🧤简单集成大模型 API, 采用单轮 AI 问答对话模式, 每次提问独立响应, 无需上下文, 支持打字机效果流式输出, 集成 markdown-it Mermaid/KaTex/L...

379
mit
davidzajac1
davidzajac1/zillacode

Open Source LeetCode for PySpark, Spark, Pandas and DBT/Snowflake

187
apache-2.0
DataEval
DataEval/dingo

Dingo: A Comprehensive Data Quality Evaluation Tool

176
apache-2.0
trannhatnguyen2
trannhatnguyen2/NYC_Taxi_Data_Pipeline

Nyc_Taxi_Data_Pipeline - DE Project

108
StabRise
StabRise/spark-pdf

PDF DataSource for Apache Spark, allow to read PDF files directly to the DataFrame and ocr it

69
agpl-3.0
Last 12-months (absolute gain)
DataTalksClub
DataTalksClub/data-engineering-zoomcamp

Data Engineering Zoomcamp is a free nine-week course that covers the fundamentals of data engineering.

31,044 (+7,594)
apache
apache/spark

Apache Spark - A unified analytics engine for large-scale data processing

41,320 (+2,605)
apache-2.0
getredash
getredash/redash

Make Your Company Data Driven. Connect to any data source, easily visualize, dashboard and share your data.

27,422 (+2,159)
bsd-2-clause
apache
apache/doris

Apache Doris is an easy-to-use, high performance and unified analytics database.

13,812 (+2,115)
apache-2.0
tobymao
tobymao/sqlglot

Python SQL Parser and Transpiler

7,870 (+1,984)
mit
Last 12-months (relative gain)
iimeta
iimeta/fastapi

企业级 LLM API 快速集成系统，支持OpenAI、Azure、文心一言、讯飞星火、通义千问、智谱GLM、Gemini、DeepSeek、Anthropic Claude以及OpenAI格式的模型等，简洁的页面风格，轻量高效且稳定，支持Docker一键部署。

259 (+1,750%)
mit
data-prep-kit
data-prep-kit/data-prep-kit

Open source project for data preparation for GenAI applications

707 (+1,624%)
apache-2.0
tuanx18
tuanx18/data-engineer-portfolio

This is a repository to demonstrate my details, skills, projects and to keep track of my progression in Data Analytics and Data Science topics.

123 (+1,018%)
apache
apache/spark-kubernetes-operator

Apache Spark Kubernetes Operator

176 (+577%)
apache-2.0
isxcode
isxcode/spark-yun

Big data computing platform based on Spark <至轻云-超轻量级大数据计算平台/数据中心/主数据>

207 (+527%)
apache-2.0