wehub-resource-sync
e04ed9c211
CF: Deploy Dev Docs / deploy (push) Has been cancelled
Sync Labels / build (push) Has been cancelled
tests / unit tests (macos-latest) (push) Has been cancelled
tests / unit tests (windows-latest) (push) Has been cancelled
tests / unit tests (ubuntu-latest) (push) Has been cancelled
55 lines
1.8 KiB
Markdown
55 lines
1.8 KiB
Markdown
---
|
|
title: "Dataproc Clusters Source"
|
|
linkTitle: "Source"
|
|
type: docs
|
|
weight: 1
|
|
description: >
|
|
Google Cloud Dataproc Clusters lets you provision and manage Apache Spark and Hadoop clusters.
|
|
no_list: true
|
|
---
|
|
|
|
## About
|
|
|
|
The [Dataproc
|
|
Clusters](https://cloud.google.com/dataproc/docs/concepts/overview) source
|
|
allows Toolbox to interact with Dataproc Clusters hosted on Google Cloud.
|
|
|
|
## Available Tools
|
|
|
|
{{< list-tools >}}
|
|
|
|
## Requirements
|
|
|
|
### IAM Permissions
|
|
|
|
Dataproc uses [Identity and Access Management
|
|
(IAM)](https://cloud.google.com/dataproc/docs/concepts/iam/iam) to control user
|
|
and group access to Dataproc resources.
|
|
|
|
Toolbox will use your [Application Default Credentials
|
|
(ADC)](https://cloud.google.com/docs/authentication#adc) to authorize and
|
|
authenticate when interacting with Dataproc. When using this method, you need to
|
|
ensure the IAM identity associated with your ADC has the correct
|
|
[permissions](https://cloud.google.com/dataproc/docs/concepts/iam/iam)
|
|
for the actions you intend to perform. Common roles include
|
|
`roles/dataproc.editor` or `roles/dataproc.viewer`. Follow this
|
|
[guide](https://cloud.google.com/docs/authentication/provide-credentials-adc) to
|
|
set up your ADC.
|
|
|
|
## Example
|
|
|
|
```yaml
|
|
kind: source
|
|
name: my-dataproc-source
|
|
type: dataproc
|
|
project: my-project
|
|
region: us-central1
|
|
```
|
|
|
|
## Reference
|
|
|
|
| **field** | **type** | **required** | **description** |
|
|
| --------- | :------: | :----------: | -------------------------------------------------- |
|
|
| type | string | true | Must be "dataproc". |
|
|
| project | string | true | ID of the GCP project with Dataproc resources. |
|
|
| region | string | true | Region containing Dataproc resources. | |