Page tree

Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Published by Scroll Versions from space DEV and version r080

...

OptionDescription
Default

The default value is applied. This value may be inherited from higher level configuration.

Tip

Tip: You can review the default value as part of the help text.

Enabled

The setting is enabled.

Info

NOTE: If the setting applies to a feature, the feature is enabled. Additional configuration may be required. See below.

DisabledThe setting is disabled.
EditClick Edit to enter a specific value for the setting.

General

Allow listing users

When enabled, individual users review and select from a list of all users in the

D s webapp
.

Info

NOTE: When this feature is disabled, users can access other users by providing the login email address of other users' login in screens such as the sharing dialogs.

Locale

Set the locale to use for inferring or validating data in the application, such as numeric values or dates. The default is United States.

Info

NOTE: After saving changes to your locale, refresh your page. Subsequent executions of the data inference service use the new locale settings.

For more information, see Locale Settings.

Session duration

Specify the length of time in minutes before a session expires. Default is 10080 (one week).

API

Allow users to generate access tokens

...

When enabled, individual users can generate their own personal access tokens, which enable access to REST APIs. For more information, see Manage API Access Tokens.

Column from examples

When enabled, users can access a tool through the column menus that enables creation of new columns based on example mappings from the selected column. For more information, see Overview of TBE.

Maximum lifetime for user generated access tokens (days)

D s ed
rtrue
editionsgdppr

Defines the maximum number of days that a user-generated access token is permitted for use in the product.

Tip

Tip: To permit generation of access tokens that never expire, set this value to -1.

For more information, see Manage API Access Tokens.

Connectivity

Custom SQL query

When enabled, users can create custom SQL queries to import datasets from relational tables. For more information, see Create Dataset with SQL.

...

Detect maximum column count in XLSX sheet

When you have enabled

...

Info

NOTE: If Plans feature has been enabled in your workspace, enabling this flag applies to flows and plans.

...

Flow import

When enabled, project users are permitted to import exported flows from a ZIP file.

Info

NOTE: If Plans feature has been enabled in your workspace, enabling this flag applies to flows and plans.

See Import Flow.

Flow sharing

When enabled, project users are permitted to share flows with other users in the project.

See Share a Flow.

JSON output format

When enabled, members can generate outputs in JSON format.

Locale

Set the locale to use for inferring or validating data in the application, such as numeric values or dates. The default is United States.

Info

NOTE: After saving changes to your locale, refresh your page. Subsequent executions of the data inference service use the new locale settings.

For more information, see Locale Settings.

Logical and physical optimization of jobs

D s ed
editionsgdppr,gdpst

When enabled, the

D s webapp
 attempts to optimize job execution through logical optimizations of your recipe and physical optimizations of your recipes interactions with data.

...

the Apache POI method for converting Excel files, you can enable this feature to force the conversion service to detect the maximum number of columns in an Excel sheet before beginning the conversion. This feature can improve detection of the structure of the sheet. For more information, see Import Excel Data.

Enable Apache POI based converter for Excel data conversion

When this setting is enabled, the conversion service uses the Java-based Apache POI converter to convert Excel data for ingestion into the product. 

Tip

Tip: You should

...

enable this setting, unless you are experiencing problems during Excel conversion.


Info

NOTE: If the Java-based converter is enabled, you should enable Detect maximum column count in XLSX sheet.

When disabled, the conversion service uses the Python-based converter, which has been available in the product previously.

For more information,

...

see Import Excel Data.


Manage access to data using IAM permissions

D s ed
rtrue
editionsgdppr

When enabled, user access to data services in

D s platform
, such as
D s storage
and Bigquery, is determined by the permissions defined in a user's assigned IAM role.

Info

NOTE: When this feature is enabled, all

D s product
productgdppr
users that belong to the project are automatically logged out of all
D s webapp
sessions across all projects. For example, if a
D s product
productgdppr
user is logged into the product through another project, the user is logged out of their
D s webapp
session when this feature is enabled. When each user logs in to the
D s webapp
again, any changes to the user's permissions are applied. Since each each API request requires authentication in the header, API users are not automatically logged out.

For more information on IAM-based permissions, Required Dataprep User Permissions.

Maximum lifetime for user generated access tokens (days)

D s ed
rtrue
editionsgdppr

Defines the maximum number of days that a user-generated access token is permitted for use in the product.

...

...

Flows, recipes, and plans

Column from examples

When enabled, users can access a tool through the column menus that enables creation of new columns based on example mappings from the selected column. For more information, see Overview of TBE.

Export

When enabled, users are permitted to export their flows and plans. Exported flows can be imported into other work areas or product editions. 

Info

NOTE: If plans have been enabled in your project settings, enabling this flag applies to flows and plans.

For more information,

see Manage API Access Tokens

see Export Flow.

Plan feature

D s ed
editionsgdppr
For more information, see Export Plan.

Import

When enabled, users

can create plans to execute sequences of recipes across one or more flows.

are permitted to import exported flows and plans.

Info

NOTE: If plans have been enabled in your project settings, enabling this flag applies to flows and plans.

For more information,

see Plans Page

see Import Flow.

For more information on plans and orchestration, see Overview of Operationalization.

Scheduling feature

D s edrtrueeditionsgdppr, see Import Plan.

Schematized output

When enabled,

project users can schedule the execution of flows. See Add Schedule Dialog.

Schematized output

When enabled,

all output columns are typecast to their annotated types. This feature is enabled by default.

Session duration

Specify the length of time in minutes before a session expires. Default is 10080 (one week).

Webhooks

D s ed
editionsgdppr

When enabled, webhook notification tasks can be configured on a per-flow basis in Flow View page. Webhook notifications allow you to deliver messages to third-party applications based on the success or failure of your job executions. For more information, see Create Flow Webhook Task.

Job execution

Logical and physical optimization of jobs

D s ed
editionsgdppr,gdpst

When enabled, the

D s webapp
 attempts to optimize job execution through logical optimizations of your recipe and physical optimizations of your recipes interactions with data.

This workspace setting can be overridden for individual flows.

Tip

Tip: You should keep this feature enabled. Please enable it at the project level and disable it only if needed at the flow level.

For more information, see Flow Optimization Settings Dialog.

Require a companion service account for running jobs

D s ed
editionsgdppr

By default,

D s product
utilizes a default compute service account for running jobs on
D s dataflow
. Optionally, you can enable this feature, which requires each user in the project to provide their own companion service account to run jobs. This feature is disabled by default.

Pre-requisites:

  • Service accounts must be created in the Google Cloud platform.
  • Companion service accounts must have a minimum set of permissions.
  • For more information, see Google Service Account Management.

When this feature is enabled:

  • Project administrators can review and specify companion service accounts for individual users of the project. For more information, see Service Accounts Page.
  • Individual users can specify their companion service account. For more information see User Profile Page.
  • At runtime, an override service account can be applied if needed. See Run Job Page.

When this feature is disabled:

  • By default, all users of the project use the Compute Engine service account specified for the project.
  • If companion service accounts has been enabled, when it's disabled, the default service account for the project is used.
  • For more information, see Google Service Account Management.

Scheduling and parameterization

Plan feature

D s ed
editionsgdppr

When enabled, users can create plans to execute sequences of recipes across one or more flows. For more information, see Plans Page.

For more information on plans and orchestration, see Overview of Operationalization.

...

Scheduling feature

When enabled, project users can schedule the execution of flows. See Add Schedule Dialog.

Publishing

JSON output format

When enabled, members can generate outputs in JSON format.