chore: import upstream snapshot with attribution
CF: Deploy Dev Docs / deploy (push) Has been cancelled
Sync Labels / build (push) Has been cancelled
tests / unit tests (macos-latest) (push) Has been cancelled
tests / unit tests (windows-latest) (push) Has been cancelled
tests / unit tests (ubuntu-latest) (push) Has been cancelled
CF: Deploy Dev Docs / deploy (push) Has been cancelled
Sync Labels / build (push) Has been cancelled
tests / unit tests (macos-latest) (push) Has been cancelled
tests / unit tests (windows-latest) (push) Has been cancelled
tests / unit tests (ubuntu-latest) (push) Has been cancelled
This commit is contained in:
@@ -0,0 +1,55 @@
|
||||
---
|
||||
title: "Dataproc Clusters Source"
|
||||
linkTitle: "Source"
|
||||
type: docs
|
||||
weight: 1
|
||||
description: >
|
||||
Google Cloud Dataproc Clusters lets you provision and manage Apache Spark and Hadoop clusters.
|
||||
no_list: true
|
||||
---
|
||||
|
||||
## About
|
||||
|
||||
The [Dataproc
|
||||
Clusters](https://cloud.google.com/dataproc/docs/concepts/overview) source
|
||||
allows Toolbox to interact with Dataproc Clusters hosted on Google Cloud.
|
||||
|
||||
## Available Tools
|
||||
|
||||
{{< list-tools >}}
|
||||
|
||||
## Requirements
|
||||
|
||||
### IAM Permissions
|
||||
|
||||
Dataproc uses [Identity and Access Management
|
||||
(IAM)](https://cloud.google.com/dataproc/docs/concepts/iam/iam) to control user
|
||||
and group access to Dataproc resources.
|
||||
|
||||
Toolbox will use your [Application Default Credentials
|
||||
(ADC)](https://cloud.google.com/docs/authentication#adc) to authorize and
|
||||
authenticate when interacting with Dataproc. When using this method, you need to
|
||||
ensure the IAM identity associated with your ADC has the correct
|
||||
[permissions](https://cloud.google.com/dataproc/docs/concepts/iam/iam)
|
||||
for the actions you intend to perform. Common roles include
|
||||
`roles/dataproc.editor` or `roles/dataproc.viewer`. Follow this
|
||||
[guide](https://cloud.google.com/docs/authentication/provide-credentials-adc) to
|
||||
set up your ADC.
|
||||
|
||||
## Example
|
||||
|
||||
```yaml
|
||||
kind: source
|
||||
name: my-dataproc-source
|
||||
type: dataproc
|
||||
project: my-project
|
||||
region: us-central1
|
||||
```
|
||||
|
||||
## Reference
|
||||
|
||||
| **field** | **type** | **required** | **description** |
|
||||
| --------- | :------: | :----------: | -------------------------------------------------- |
|
||||
| type | string | true | Must be "dataproc". |
|
||||
| project | string | true | ID of the GCP project with Dataproc resources. |
|
||||
| region | string | true | Region containing Dataproc resources. |
|
||||
Reference in New Issue
Block a user