gcloud alpha dataproc clusters - create and manage Dataproc clusters
gcloud alpha dataproc clusters GROUP | COMMAND [GCLOUD_WIDE_FLAG ...]
(ALPHA) Create and manage Dataproc clusters.
To create a cluster, run:
$ gcloud alpha dataproc clusters create my-cluster \ --region=us-central1
To resize a cluster, run:
$ gcloud alpha dataproc clusters update my-cluster \ --region=us-central1 --num_workers 5
To delete a cluster, run:
$ gcloud alpha dataproc clusters delete my-cluster \ --region=us-central1
To view the details of a cluster, run:
$ gcloud alpha dataproc clusters describe my-cluster \ --region=us-central1
To see the list of all clusters, run:
$ gcloud alpha dataproc clusters list
These flags are available to all commands: --help.
Run $ gcloud help for details.
GROUP is one of the following:
- gke
(ALPHA) Create Dataproc GKE-based virtual clusters.
COMMAND is one of the following:
- create
(ALPHA) Create a cluster.
- create-from-file
(ALPHA) Create a cluster from a file.
- delete
(ALPHA) Delete a cluster.
- describe
(ALPHA) View the details of a cluster.
- diagnose
(ALPHA) Run a detailed diagnostic on a cluster.
- export
(ALPHA) Export a cluster.
- get-iam-policy
(ALPHA) Get IAM policy for a cluster.
- import
(ALPHA) Import a cluster.
- list
(ALPHA) View a list of clusters in a project.
- set-iam-policy
(ALPHA) Set IAM policy for a cluster.
- start
(ALPHA) Start a cluster.
- stop
(ALPHA) Stop a cluster.
- update
(ALPHA) Update labels and/or the number of worker nodes in a cluster.
This command is currently in alpha and might change without notice. If this command fails with API permission errors despite specifying the correct project, you might be trying to access an API with an invitation-only early access allowlist. These variants are also available:
$ gcloud dataproc clusters
$ gcloud beta dataproc clusters