gcloud beta metastore services update - update a Dataproc Metastore service
gcloud beta metastore services update (SERVICE : --location=LOCATION) [--async] [--data-catalog-sync] [--endpoint-protocol=ENDPOINT_PROTOCOL] [--port=PORT] [--tier=TIER] [--update-labels=[KEY=VALUE,...]] [--clear-labels | --remove-labels=[KEY,...]] [--kerberos-principal=KERBEROS_PRINCIPAL --keytab=KEYTAB --krb5-config=KRB5_CONFIG] [--maintenance-window-day=MAINTENANCE_WINDOW_DAY --maintenance-window-hour=MAINTENANCE_WINDOW_HOUR] [--update-auxiliary-versions-from-file=UPDATE_AUXILIARY_VERSIONS_FROM_FILE | --add-auxiliary-versions=[ADD_AUXILIARY_VERSIONS,...] --clear-auxiliary-versions] [--update-hive-metastore-configs-from-file=UPDATE_HIVE_METASTORE_CONFIGS_FROM_FILE | --update-hive-metastore-configs=[UPDATE_HIVE_METASTORE_CONFIGS,...] --clear-hive-metastore-configs | --remove-hive-metastore-configs=[REMOVE_HIVE_METASTORE_CONFIGS,...]] [GCLOUD_WIDE_FLAG ...]
(BETA) Update the metadata and/or configuration parameters of a Dataproc Metastore service.
If run asynchronously with --async, exits after printing one operation name that can be used to poll the status of the update via:
gcloud metastore operations describe
To update a Dataproc Metastore service with the name my-metastore-service to have the port number 8080, and add the two labels, env and foo, run:
$ gcloud beta metastore services update my-metastore-service \ --port=8080 --update-labels=env=test,foo=bar
- Service resource - Arguments and flags that specify the Dataproc Metastore
service you want to update. The arguments in this group can be used to specify the attributes of this resource. (NOTE) Some attributes are not given arguments in this group but can be set in other ways. To set the project attribute:
- —
provide the argument service on the command line with a fully specified name;
- —
set the property core/project;
- —
provide the argument --project on the command line.
This must be specified.
- SERVICE
ID of the service or fully qualified identifier for the service. To set the service attribute:
provide the argument service on the command line.
This positional argument must be specified if any of the other arguments in this group are specified.
- --location=LOCATION
The location of the Dataproc Metastore service.
If not specified, will use default metastore/location.
To set the location attribute:
provide the argument service on the command line with a fully specified name;
provide the argument --location on the command line;
set the property metastore/location.
- --async
Return immediately, without waiting for the operation in progress to complete.
- --data-catalog-sync
A boolean flag to determine whether Dataproc Metastore metadata sync to Data Catalog should be enabled. Cannot be updated if the service uses customer-managed encryption keys.
- --endpoint-protocol=ENDPOINT_PROTOCOL
The protocol to use for the metastore service endpoint. ENDPOINT_PROTOCOL must be one of:
- grpc
The modernized GRPC protocol.
- thrift
The legacy Apache THRIFT protocol.
- --port=PORT
The TCP port on which the Metastore service will listen.
- --tier=TIER
The tier of the service. TIER must be one of:
- developer
The developer tier provides limited scalability and no fault tolerance. Good for low-cost proof-of-concept.
- enterprise
The enterprise tier provides multi-zone high availability, and sufficient scalability for enterprise-level Dataproc Metastore workloads.
- --update-labels=[KEY=VALUE,...]
List of label KEY=VALUE pairs to update. If a label exists, its value is modified. Otherwise, a new label is created.
Keys must start with a lowercase character and contain only hyphens (-), underscores (_), lowercase characters, and numbers. Values must contain only hyphens (-), underscores (_), lowercase characters, and numbers.
- At most one of these can be specified:
- --clear-labels
Remove all labels. If --update-labels is also specified then --clear-labels is applied first.
For example, to remove all labels:
$ gcloud beta metastore services update --clear-labels
To remove all existing labels and create two new labels, foo and baz:
$ gcloud beta metastore services update --clear-labels \ --update-labels foo=bar,baz=qux
- --remove-labels=[KEY,...]
List of label keys to remove. If a label does not exist it is silently ignored. If --update-labels is also specified then --update-labels is applied first.
- Information used to configure the Hive metastore service as a service principal
in a Kerberos realm.
- --kerberos-principal=KERBEROS_PRINCIPAL
A Kerberos principal that exists in the KDC to authenticate as. A typical principal is of the form "primary/instance@REALM", but there is no exact format.
- --keytab=KEYTAB
A Kerberos keytab file that can be used to authenticate a service principal with a Kerberos Key Distribution Center. This is a Secret Manager secret version, and can be fully-qualified URL, or relative name in the form projects/{project_id}/secrets/{secret_id}/versions/{version_id}.
- --krb5-config=KRB5_CONFIG
A Cloud Storage URI that specifies the path to a krb5.conf file. It is of the form gs://{bucket_name}/path/krb5.conf, although the file does not need to be named krb5.conf explicitly.
- The one hour maintenance window that specifies when Dataproc Metastore may
perform system maintenance operation to the service, in UTC time.
- --maintenance-window-day=MAINTENANCE_WINDOW_DAY
The day of week when the window starts, e.g., sun. MAINTENANCE_WINDOW_DAY must be one of: fri, mon, sat, sun, thu, tue, wed.
This flag argument must be specified if any of the other arguments in this group are specified.
- --maintenance-window-hour=MAINTENANCE_WINDOW_HOUR
The hour of day (0-23) when the window starts.
This flag argument must be specified if any of the other arguments in this group are specified.
- Auxiliary versions configuration for the Dataproc Metastore service. When
specified, a secondary Hive metastore service is created along with the primary service.
At most one of these can be specified:
- --update-auxiliary-versions-from-file=UPDATE_AUXILIARY_VERSIONS_FROM_FILE
Path to a YAML file containing the auxiliary versions configuration for Dataproc Metastore instance. The file should contain a unique auxiliary service name and auxiliary version that is lower than the primary service version. The primary version's Hive metastore configs are applied to the auxiliary version. Additional Hive metastore configs can be specified for the auxiliary version using "config_overrides". If a specified config property has already been overridden in the primary Hive metastore version's configs, the auxiliary version's override takes precedence. The contents of the file should be structured as follows:
YAML:
- name: aux-service1 version: x.y.z config_overrides: key1: value1 key2: value2 ... - name: aux-service2 version: x.y.z config_overrides: key1: value1 key2: value2 ... ...
- --add-auxiliary-versions=[ADD_AUXILIARY_VERSIONS,...]
Comma-separated list of auxiliary Hive metastore versions to deploy. Auxiliary Hive metastore versions must be less than the primary Hive metastore service's version.
- --clear-auxiliary-versions
Clears the existing auxiliary services attached to the primary Hive metastore services. If --add-auxiliary-versions is also specified, --clear-auxiliary-versions is applied first.
- Configuration properties specific to running Hive metastore software as the
metastore service.
At most one of these can be specified:
- --update-hive-metastore-configs-from-file=UPDATE_HIVE_METASTORE_CONFIGS_FROM_FILE
Path to a XML file containing a mapping of Hive metastore configuration key-value pairs to apply to the Hive metastore.
For example:
hive-site.xml <configuration> <property> <name>hive.metastore.warehouse.dir</name> <value>${test.warehouse.dir}</value> <description></description> </property> </configuration>
- Modify the Hive metastore configuration properties by passing key-value pairs
in through the flags.
- --update-hive-metastore-configs=[UPDATE_HIVE_METASTORE_CONFIGS,...]
Comma-separated list of Hive metastore configurations. Each configuration has the form "NAME=VALUE".
- At most one of these can be specified:
- --clear-hive-metastore-configs
clear existing Hive metastore configurations. If --update-hive-metastore-configs is also specified, then --clear-hive-metastore-configs is applied first.
- --remove-hive-metastore-configs=[REMOVE_HIVE_METASTORE_CONFIGS,...]
Comma-separated list of configuration keys to remove with the form "KEY1, KEY2". If a label does not exist it is silently ignored. If --update-hive-metastore-configs is also specified, then --remove-hive-metastore-configs is applied first.
These flags are available to all commands: --access-token-file, --account, --billing-project, --configuration, --flags-file, --flatten, --format, --help, --impersonate-service-account, --log-http, --project, --quiet, --trace-token, --user-output-enabled, --verbosity.
Run $ gcloud help for details.
This command uses the metastore/v1beta API. The full documentation for this API can be found at: https://cloud.google.com/dataproc-metastore/docs
This command is currently in beta and might change without notice. These variants are also available:
$ gcloud metastore services update
$ gcloud alpha metastore services update