Page tree

Versions Compared


  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Published by Scroll Versions from space DEV and version next


You can write datasets to BigQuery as part of your job definition.  


NOTE: In some environments, users may not be permitted the bigquery.datasets.create permission, and

D s dataflow
jobs on BigQuery sources fail. As a workaround, an administrator can define a BigQuery dataset for use for these jobs. This dataset is used by
D s product
for storing temporary tables of intermediate query results when running
D s dataflow
jobs on BigQuery sources, which eliminates the need for the bigquery.datasets.create permission in the service account. For more information on defining this BigQuery query dataset, see Dataprep Project Settings Page.


NOTE: Object and Array data types are written back to BigQuery as string values.


Create New Connection: n/a

D s also
label((label = "bigquery") OR (label = "connection"))