Publishing Actions

You can add, remove, or edit the outputs generated from this job. By default, a CSV output for your home directory on the selected datastore is included in the list of destinations, which can be removed if needed. You must include at least one output destination. 

Columns:

• Actions: Lists the action and the format for the output.
• Location: The directory and filename or table information where the output is to be written.
• Settings: Identifies the output format and any compression, if applicable, for the publication.

Actions:

• To change format, location, and settings of an output, click the Edit icon.
• To delete an output, click the X icon.

Add Publishing Action

From the available datastores in the left column, select the target for your publication. 

New/Edit: You can create new or modify existing connections. By default, the displayed connections support publishing. See Create Connection Window.

Steps:

1. Select the publishing target. Click an icon in the left column.

   1. BigQuery: You can published your results to the current project or to a different one to which you have access.

      NOTE: You must have read and write access to any BigQuery database to which you are publishing.

      To publish to a different project, click the BigQuery link at the front of the breadcrumb trail. Then, enter the identifier for the project where you wish to publish your job results.

      Tip: Your projects and their identifiers are available for review through the Dataprep by Trifacta menu bar. See UI Reference.

      Click Go. Navigate to the database where you wish to write your BigQuery results.

      For more information, see BigQuery Connections.

2. Locate a publishing destination: Do one of the following.

   1. Explore: 

      NOTE: The publishing location must already exist before you can publish to it. The publishing user must have write permissions to the location.

      For Cloud Storage, you can create a new folder in an accessible location.

      Tip: To show hidden files and folders, select Show hidden. Overwriting hidden files and folders can result in unexpected behaviors in your Dataprep by Trifacta objects.

      1. To sort the listings in the current directory, click the carets next to any column name.
      2. For larger directories, browse using the paging controls.
      3. Use the breadcrumb trail to explore the target datastore. Navigate folders as needed.
   2. Search: Use the search bar to search for specific locations in the current folder only.
   3. Manual entry: Click the Edit icon to manually edit or paste in a destination.

3. Create Folder: Depending on the storage destination, you can click it to create a new folder for the job inside the currently selected one. Do not include spaces in your folder name.

   
   

4. Create a new file: Enter the filename under which to save the dataset.

   1. Select the Data Storage Format.

   2. For more information, see Output Settings below.

5. BigQuery: When publishing to BigQuery, you must specify the table to which to publish and related actions. See below.

6. As needed, you can parameterize the outputs that you are creating. Click Parameterize destination in the right panel. See Parameterize destination settings below.

7. To save the publishing destination, click Add.

To update a publishing action, hover over its entry. Then, click Edit.

To delete a publishing action, select Delete from its context menu.

Variables

If any variable parameters have been specified for the datasets or outputs of the flow, you can apply overrides to their default values. Click the listed default value and insert a new value. A variable can have an empty value.

For more information on variables, see Overview of Parameterization.

Output Settings

Depending on the type of output that you are generating, you must specify additional settings to define location, format, and other settings. 

• See File Settings.
• See Relational Table Settings.

• BigQuery Table Settings