Page tree

Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Published by Scroll Versions from space DEV and version next

...

You can write datasets to BigQuery as part of your job definition.  

Info

NOTE: In some environments, users may not be permitted the bigquery.datasets.create permission, and

D s dataflow
jobs on BigQuery sources fail. As a workaround, an administrator can define a BigQuery dataset for use for these jobs. This dataset is used by
D s product
productdp
for storing temporary tables of intermediate query results when running
D s dataflow
jobs on BigQuery sources, which eliminates the need for the bigquery.datasets.create permission in the service account. For more information on defining this BigQuery query dataset, see Dataprep Project Settings Page.

Info

NOTE: Object and Array data types are written back to BigQuery as string values.

...

Create New Connection: n/a

D s also
inCQLtrue
label((label = "bigquery") OR (label = "connection"))