NAME

gcloud alpha dataproc workflow-templates - create and manage Dataproc workflow templates

SYNOPSIS

gcloud alpha dataproc workflow-templates GROUP | COMMAND [GCLOUD_WIDE_FLAG ...]

DESCRIPTION

(ALPHA) Create and manage Dataproc workflow templates.

EXAMPLES

To create a workflow template, run:

$ gcloud alpha dataproc workflow-templates create my_template

To instantiate a workflow template, run:

$ gcloud alpha dataproc workflow-templates instantiate my_template

To instantiate a workflow template from a file, run:

$ gcloud alpha dataproc workflow-templates instantiate-from-file \ --file template.yaml

To delete a workflow template, run:

$ gcloud alpha dataproc workflow-templates delete my_template

To view the details of a workflow template, run:

$ gcloud alpha dataproc workflow-templates describe my_template

To see the list of all workflow templates, run:

$ gcloud alpha dataproc workflow-templates list

To remove a job from a workflow template, run:

$ gcloud alpha dataproc workflow-templates remove-job my_template \ --step-id id

To update managed cluster in a workflow template, run:

$ gcloud alpha dataproc workflow-templates set-managed-cluster \ my_template --num-masters 5

To update cluster selector in a workflow template, run:

$ gcloud alpha dataproc workflow-templates set-cluster-selector \ my_template --cluster-labels environment=prod

GCLOUD WIDE FLAGS

These flags are available to all commands: --help.

Run $ gcloud help for details.

GROUPS

GROUP is one of the following:

add-job

(ALPHA) Add Dataproc jobs to workflow template.

COMMANDS

COMMAND is one of the following:

create

(ALPHA) Create a workflow template.

delete

(ALPHA) Delete a workflow template.

describe

(ALPHA) Describe a workflow template.

export

(ALPHA) Export a workflow template.

get-iam-policy

(ALPHA) Get IAM policy for a workflow template.

import

(ALPHA) Import a workflow template.

instantiate

(ALPHA) Instantiate a workflow template.

instantiate-from-file

(ALPHA) Instantiate a workflow template from a file.

list

(ALPHA) List workflow templates.

remove-dag-timeout

(ALPHA) Remove DAG timeout from a workflow template.

remove-job

(ALPHA) Remove a job from workflow template.

run

(ALPHA) (DEPRECATED) Run a workflow template.

set-cluster-selector

(ALPHA) Set cluster selector for the workflow template.

set-dag-timeout

(ALPHA) Set DAG timeout on a workflow template.

set-iam-policy

(ALPHA) Set IAM policy for a template.

set-managed-cluster

(ALPHA) Set a managed cluster for the workflow template.

NOTES

This command is currently in alpha and might change without notice. If this command fails with API permission errors despite specifying the correct project, you might be trying to access an API with an invitation-only early access allowlist. These variants are also available:

$ gcloud dataproc workflow-templates

$ gcloud beta dataproc workflow-templates