4 results found Sort:

mahmoudparsian
data-algorithms-book mahmoudparsian
662
1.1k
other
131
MapReduce, Spark, Java, and Scala for Data Algorithms Book
java scala python mappers pyspark reducers mapreduce apache-spark partitioning apache-hadoop data-algorithms design-patterns hadoop-mapreduce machine-learning distributed-computing distributed-algorithms
Created 2014-08-06
785 commits to master branch, last one 2 years ago
bytedance
CloudShuffleService bytedance
56
239
apache-2.0
10
Cloud Shuffle Service(CSS) is a general purpose remote shuffle solution for compute engines, including Spark/Flink/MapReduce.
flink spark hadoop-mapreduce
Created 2022-08-17
1 commits to main branch, last one about a year ago
touero
ctenopharyngodon-idella touero
0
142
apache-2.0
2
Hadoop, MapReduce Distributed Crawling of Data Information from All Chinese Universities.
java maven hadoop fastapi scraping mapreduce hadoop-mapreduce
Created 2023-04-10
76 commits to master branch, last one 7 months ago
vim89
datapipelines-essentials-python vim89
35
53
apache-2.0
6
Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validation, Column extensions, SQL functions, and DataFrame transformati...
etl xml spark hadoop python pyspark python3 big-data datalake spark-sql hadoop-hdfs xml-parsing apache-spark etl-pipeline data-pipeline etl-framework etl-components hadoop-mapreduce
Created 2019-11-16
15 commits to master branch, last one about a year ago