NAME

gcloud beta dataproc workflow-templates - create and manage Dataproc workflow templates

SYNOPSIS

gcloud beta dataproc workflow-templates GROUP | COMMAND [GCLOUD_WIDE_FLAG ...]

DESCRIPTION

(BETA) Create and manage Dataproc workflow templates.

EXAMPLES

To create a workflow template, run:

$ gcloud beta dataproc workflow-templates create my_template

To instantiate a workflow template, run:

$ gcloud beta dataproc workflow-templates instantiate my_template

To instantiate a workflow template from a file, run:

$ gcloud beta dataproc workflow-templates instantiate-from-file \ --file template.yaml

To delete a workflow template, run:

$ gcloud beta dataproc workflow-templates delete my_template

To view the details of a workflow template, run:

$ gcloud beta dataproc workflow-templates describe my_template

To see the list of all workflow templates, run:

$ gcloud beta dataproc workflow-templates list

To remove a job from a workflow template, run:

$ gcloud beta dataproc workflow-templates remove-job my_template \ --step-id id

To update managed cluster in a workflow template, run:

$ gcloud beta dataproc workflow-templates set-managed-cluster \ my_template --num-masters 5

To update cluster selector in a workflow template, run:

$ gcloud beta dataproc workflow-templates set-cluster-selector \ my_template --cluster-labels environment=prod

GCLOUD WIDE FLAGS

These flags are available to all commands: --help.

Run $ gcloud help for details.

GROUPS

GROUP is one of the following:

add-job

(BETA) Add Dataproc jobs to workflow template.

COMMANDS

COMMAND is one of the following:

create

(BETA) Create a workflow template.

delete

(BETA) Delete a workflow template.

describe

(BETA) Describe a workflow template.

export

(BETA) Export a workflow template.

get-iam-policy

(BETA) Get IAM policy for a workflow template.

import

(BETA) Import a workflow template.

instantiate

(BETA) Instantiate a workflow template.

instantiate-from-file

(BETA) Instantiate a workflow template from a file.

list

(BETA) List workflow templates.

remove-dag-timeout

(BETA) Remove DAG timeout from a workflow template.

remove-job

(BETA) Remove a job from workflow template.

run

(BETA) (DEPRECATED) Run a workflow template.

set-cluster-selector

(BETA) Set cluster selector for the workflow template.

set-dag-timeout

(BETA) Set DAG timeout on a workflow template.

set-iam-policy

(BETA) Set IAM policy for a template.

set-managed-cluster

(BETA) Set a managed cluster for the workflow template.

NOTES

This command is currently in beta and might change without notice. These variants are also available:

$ gcloud dataproc workflow-templates

$ gcloud alpha dataproc workflow-templates