5 results found Sort:

kubeflow
spark-operator kubeflow
1.3k
2.7k
apache-2.0
91
Kubernetes operator for managing the lifecycle of Apache Spark applications on Kubernetes.
spark kubernetes apache-spark kubernetes-crd kubernetes-operator google-cloud-dataproc kubernetes-controller
Created 2018-01-03
917 commits to master branch, last one 8 days ago
GoogleCloudDataproc
initialization-actions GoogleCloudDataproc
515
584
apache-2.0
67
Run in all nodes of your cluster before the cluster starts - lets you customize your cluster
google-cloud-dataproc
Created 2015-10-12
784 commits to master branch, last one 22 days ago
GoogleCloudDataproc
spark-bigquery-connector GoogleCloudDataproc
190
353
apache-2.0
45
BigQuery data source for Apache Spark: Read data from BigQuery into DataFrames, write DataFrames into BigQuery tables.
spark bigquery google-cloud google-bigquery bigquery-storage-api google-cloud-dataproc
Created 2019-02-26
794 commits to master branch, last one 2 days ago
GoogleCloudDataproc
hadoop-connectors GoogleCloudDataproc
231
275
apache-2.0
100
Libraries and tools for interoperability between Hadoop-related open-source software and Google Cloud Platform.
hadoop bigquery hadoop-hcfs hadoop-filesystem google-cloud-dataproc
Created 2014-05-12
1,447 commits to master branch, last one a day ago
GoogleCloudDataproc
cloud-dataproc GoogleCloudDataproc
122
192
apache-2.0
38
Cloud Dataproc: Samples and Utils
google-cloud-dataproc
Created 2016-11-02
180 commits to master branch, last one about a year ago