Page tree

Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Published by Scroll Versions from space DEV and version r089

D toc

Excerpt

Associated with each recipe is one or more outputs. These publishing destinations can be configured through the context panel in Flow View. Through outputs, you can execute and track jobs for the related recipe.

D caption
Output icon


In the context panel, the following options are available:

Run: Click Run to queue for immediate execution a job for the manual destinations. You can track the progress and results of this task through the Jobs tab. 

In the context menu:

Delete Output: Remove this output from the flow. This operation cannot be undone. Removing an output does not remove the jobs associated with the output. You can continue working with those executed jobs. See Jobs Page.

Jobs tab

D caption
typefigure
Jobs tab

Each entry in the Jobs tab identifies a job that has been Queued, Completed, or In Progress for the selected output. You can track the progress, success, or failure of execution.  If you have executed no jobs yet, the Jobs tab is empty. 

Info

NOTE: Do not delete an output for a job that is currently running. The job will fail.

For the latest job:

  • You can preview the job results. Click the Preview pane to open the results in a separate window.

    Info

    NOTE: The Preview pane reflects the state of the data at the location specified for the output. If other jobs are also writing to this location, the state of the data may not reflect the output for this specific job.

    Info

    NOTE: This section is not displayed if the job fails. The Preview may not be available if errors occur.

  • To download the results from the output location, click the  Download  button. 

    Info

    NOTE: This button may not be available for some successful jobs.


  • To view job details, click View details. For more information, see Job Details Page.

You can also view the previous jobs that have been executed for the selected output.

Tip

Tip: When you hover the mouse over a job link, you can review details of the job in progress. For more information, see Overview of Job Monitoring.

When a job has finished execution, click the link to the job to view results. For more information, see Job Details Page.

Actions:

For a job, you can do the following:

Click the job link to view the results of your completed job. For more information, see Job Details Page.

View Dataflow Job: View the job on

D s dataflow
. If the job failed, you can review error information through
D s dataflow
.

View on BigQuery: This option is available if you executed the job on BigQuery.

Manual Settings tab

The Manual Settings tab contains configured outputs for manual execution of jobs through the application interface.

D caption
typefigure
Manual Settings tab

Options:

Environment: The running environment where the job is configured to be executed.

Profiling: If profiling is enabled for this destination, this value is set to yes.

Ignore recipe errors: When enabled, non-fatal errors encountered in a recipe during job execution are ignored. These errors are available for review in the Job Details page. See Job Details Page.

  • To create a new manual destination, click Add.
  • To edit the current manual setting, click Edit.

For more information on these settings, see  Run Job Page.

Publishing actions:

For the manual destination, this section outlines any additional publishing actions to be taken when generating the output.

Location: Full path to the target location.If output parameters have been created for the destination, you can review their names in the path. For more information, see Overview of Parameterization.For more information on these settings, see Run Job Page.

SQL scripts:

Info

NOTE: The SQL Scripts feature may need to be enabled in your environment by an administrator.

Before or after a job, you can specify one or more SQL scripts to execute. These scripts can be used for tasks like staging data for job execution or to updating an audit table on job execution. For more information, see SQL Scripts Panel.

Scheduled Settings tab

If a schedule has been defined for the flow, you can define a separate set of destinations, which are populated whenever the schedule is triggered and the associated recipe is successfully executed. If any input datasets are missing, the job is not run.

Info

NOTE: The Scheduling feature may need to be enabled in your environment by an administrator.

D caption
Scheduled Settings tab


Info

NOTE: Flow collaborators cannot modify publishing destinations.

See Add Schedule Dialog.

For more information, see Overview of Automator.