e04ed9c211
CF: Deploy Dev Docs / deploy (push) Has been cancelled
Sync Labels / build (push) Has been cancelled
tests / unit tests (macos-latest) (push) Has been cancelled
tests / unit tests (windows-latest) (push) Has been cancelled
tests / unit tests (ubuntu-latest) (push) Has been cancelled
1.8 KiB
1.8 KiB
title, linkTitle, type, weight, description, no_list
| title | linkTitle | type | weight | description | no_list |
|---|---|---|---|---|---|
| Dataproc Clusters Source | Source | docs | 1 | Google Cloud Dataproc Clusters lets you provision and manage Apache Spark and Hadoop clusters. | true |
About
The Dataproc Clusters source allows Toolbox to interact with Dataproc Clusters hosted on Google Cloud.
Available Tools
{{< list-tools >}}
Requirements
IAM Permissions
Dataproc uses Identity and Access Management (IAM) to control user and group access to Dataproc resources.
Toolbox will use your Application Default Credentials
(ADC) to authorize and
authenticate when interacting with Dataproc. When using this method, you need to
ensure the IAM identity associated with your ADC has the correct
permissions
for the actions you intend to perform. Common roles include
roles/dataproc.editor or roles/dataproc.viewer. Follow this
guide to
set up your ADC.
Example
kind: source
name: my-dataproc-source
type: dataproc
project: my-project
region: us-central1
Reference
| field | type | required | description |
|---|---|---|---|
| type | string | true | Must be "dataproc". |
| project | string | true | ID of the GCP project with Dataproc resources. |
| region | string | true | Region containing Dataproc resources. |