6 results found Sort:

seaweedfs
seaweedfs seaweedfs
2.2k
21.4k
apache-2.0
535
SeaweedFS is a fast distributed storage system for blobs, objects, files, and data lake, for billions of files! Blob store has O(1) disk seek, cloud tiering. Filer supports Cloud Drive, cross-DC activ...
s3 fuse hdfs posix seaweedfs kubernetes s3-storage cloud-drive hadoop-hdfs replication blob-storage erasure-coding object-storage tiered-file-system distributed-storage distributed-systems distributed-file-system
Created 2014-07-14
10,586 commits to master branch, last one 2 days ago
OBenner
data-engineering-interview-questions OBenner
330
899
unknown
17
More than 2000+ Data engineer interview questions.
aws sql avro hive nifi azure flink flume hbase kafka spark hadoop impala airflow cassandra interview hadoop-hdfs data-structures data-engineering interview-questions
Created 2021-08-08
16 commits to master branch, last one 12 days ago
linkedin
dynamometer linkedin
36
129
bsd-2-clause
18
A tool for scale and performance testing of HDFS with a specific focus on the NameNode.
hdfs scale hadoop testing hdfs-dfs scale-up hadoop-hdfs testing-tools hadoop-framework performance-test hadoop-filesystem performance-metrics performance-testing performance-analysis
Created 2017-11-06
60 commits to master branch, last one 4 years ago
IBM
sparksql-for-hbase IBM
27
68
apache-2.0
31
Learn how to use Spark SQL and HSpark connector package to create / query data tables that reside in HBase region servers
sql hbase nosql spark ibmcode hadoop-hdfs apache-spark
Created 2017-08-31
107 commits to master branch, last one 5 years ago
groda
big_data groda
23
59
mit
4
Tutorials on Big Data essentials: Hadoop, MapReduce, Spark.
mrjob spark docker hadoop bigdata pyspark big-data mapreduce spark-sql testdfsio hadoop-hdfs apache-sedona hadoop-cluster mapreduce-bash gutenberg-ebooks jupyter-notebook
Created 2019-08-27
290 commits to master branch, last one 5 days ago
vim89
datapipelines-essentials-python vim89
35
53
apache-2.0
6
Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validation, Column extensions, SQL functions, and DataFrame transformati...
etl xml spark hadoop python pyspark python3 big-data datalake spark-sql hadoop-hdfs xml-parsing apache-spark etl-pipeline data-pipeline etl-framework etl-components hadoop-mapreduce
Created 2019-11-16
15 commits to master branch, last one about a year ago