- Properties whose values are not specified in the dataflow execution overrides use the values that you set in the Project Execution Settings page.
- See Project Execution Settings Page.
Dataflow Execution Properties
Tip: You can change the default values for the following in your project settingsExecution Settings. See Project Execution Settings Page.
Making changes to these settings can affect performance times for executing your job.
A regional endpoint handles execution details for your
A sub-section of region, a zone contains specific resources for a given region.
Choose the type of machine on which to run your job. The default is
Note: not all machine types supported directly through
|VPC Network mode|
If the network mode is set to
As needed, you can override the default settings configured for your project for this job. Set this value to
For more information:
|Network||To use a different VPC network, enter the name of the VPC network to use as an override for this job. Click Save to apply the override.|
To specify a different subnetwork, enter the URL of the subnetwork. The URL should be in the following format:
If you have access to another project within your organization, you can execute your
Click Save to apply the override.
For more information on these settings, see Project Execution Settings Page.
|D s ed|
|Worker IP address configuration|
If the VPC Network mode is set to
The type of algorithm to use to scale the number of Google Compute Engine instances to accommodate the size of your job. Possible values:
|Initial number of workers||Number of Google Compute Engine instances with which to launch the job. This number may be adjusted as part of job execution. This number must be an integer between 1 and |
|Maximum number of workers|
Maximum number of Google Compute Engine instances to use during execution. This value must be greater than the initial number of workers and must be an integer between
|Service accountEmail address of the service account under which to run the|
Optionally, you can specify a different service account under which to run your job.
For more information on service account usage and requirements, see Google Service Account Management
Create or assign labels to apply to the billing for the
For more information, see https://cloud.google.com/resource-manager/docs/creating-managing-labels.
Notes on behavior:
- Values specified here are applied to the current job or to all jobs executed using the output object.
- Properties not specified here are not submitted, and the default values for
D s dataflow
|D s also|