7 results found Sort:

treeverse
lakeFS treeverse
369
4.6k
apache-2.0
42
lakeFS - Data version control for your data lake | Git for data
go aws-s3 golang lakefs datalake data-lake datalakes apache-spark data-quality git-for-data azure-storage object-storage apache-sparksql data-versioning data-engineering hadoop-filesystem azure-blob-storage data-version-control google-cloud-storage
Created 2019-09-12
5,698 commits to master branch, last one a day ago
GoogleCloudDataproc
hadoop-connectors GoogleCloudDataproc
247
283
apache-2.0
96
Libraries and tools for interoperability between Hadoop-related open-source software and Google Cloud Platform.
hadoop bigquery hadoop-hcfs hadoop-filesystem google-cloud-dataproc
Created 2014-05-12
1,468 commits to master branch, last one a day ago
linkedin
dynamometer linkedin
34
131
bsd-2-clause
17
A tool for scale and performance testing of HDFS with a specific focus on the NameNode.
hdfs scale hadoop testing hdfs-dfs scale-up hadoop-hdfs testing-tools hadoop-framework performance-test hadoop-filesystem performance-metrics performance-testing performance-analysis
Created 2017-11-06
60 commits to master branch, last one 5 years ago
mmolimar
kafka-connect-fs mmolimar
77
111
apache-2.0
10
Kafka Connect FileSystem Connector
s3 ftp gcp hdfs files kafka hadoop confluent filesystem apache-kafka azure-storage kafka-connect kafka-connector kafka-connect-fs hadoop-filesystem
Created 2017-03-13
204 commits to master branch, last one 3 years ago
jingw
pyhdfs jingw
22
93
mit
6
Python HDFS client
hdfs hadoop python webhdfs hadoop-filesystem
Created 2015-03-02
84 commits to master branch, last one 16 days ago
AhmetFurkanDEMIR
Data-Engineering-Project-with-HDFS-and-Kafka AhmetFurkanDEMIR
21
85
mit
3
Data Engineering Project with Hadoop HDFS and Kafka
data hdfs kafka docker hadoop python kafkaui pipline hdfs-dfs kafka-ui hadoop-hdfs hdfs-client data-engineer docker-compose kafka-consumer kafka-producer data-engineering hadoop-filesystem python-hdfs-client data-engineering-pipeline
Created 2023-11-04
3 commits to main branch, last one about a year ago
longshilin
HDFS-Netdisc longshilin
20
71
mit
4
基于Hadoop的分布式云存储系统 :palm_tree:
hdfs hadoop bigdata netdisk filesystem hdfs-client hdfs-netdisc hadoop-filesystem
Created 2017-12-01
42 commits to master branch, last one 2 months ago