Page tree

Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Through the Flow View page, you can access and manage all objects in your flow. For each imported dataset, recipe, or other object in your flow, you can perform a variety of actions to effectively manage flow development and job execution through a single page in the

D s webapp
rtrue
.

Warning

If you have enabled Deployment Manager, avoid making changes in Flow View on a Production instance of the platform.

  • Scheduling executions through Flow View in a Prod environment is not supported. Job executions must be executed through the APIs. See API Reference.
  • Some Flow View options may not be available in a Prod environment.
  • You should apply changes to your flow in the Dev instance and then re-deploy to Production. For more information, see Overview of Deployment Manager.


Info

NOTE: If the displayed flow has been shared with you, some options are not available.


D caption
Flow View page

The imported datasets in the flow or reference datasets added to the flow are listed on the left side of the screen. Associated with each dataset can be one or more recipes, which are used to transform the source data.

...

  • To begin working with an imported dataset, select it and click Add new recipe. A new, empty recipe is associated with the dataset. To open in the Transformer page, click the recipe and select Edit Recipe. See Transformer Page.
  • When created, these objects are connected together by lines flowing between them, which show the relationships between the objects in the flow.
  • For any object, any objects on which it depends are displayed to the left of the object on one of the flowing lines leading from it. 

    Tip

    Tip: When you run a job for a recipe, all of the recipes steps for the preceding datasets are executed as part of the job, and only the results of the terminal dataset are generated.

     


    • In the above example, the POS-01 recipe is dependent on all of the objects in the flow. 

    • The other datasets have been integrated with the POS-01 dataset and have not yet had a recipe created for them. 

...

Manage parameters: Create and manage flow parameters, as well as specify overrides for them. See Manage Parameters Dialog.

Manage email notifications: Configure types of jobs that generate success or failure emails and who receives the messages. See Manage Flow Notifications Dialog.


Info

NOTE: This feature uses an SMTP email server to send messages. For more information on configuring the server, see Enable SMTP Email Server Integration.

...

Info

NOTE: This feature may need to be enabled in your environment. For more information, see Workspace Settings Page.

Make a copy: Create a copy of the flow.


  • The copied flow is independent of the source flow.
  • Optionally, you can duplicate the datasets from the original flow in the copy.


  • Duplicating datasets has some implications on shared flows. See Overview of Sharing.

    Info

    NOTE: For flows using parameterized datasets, you should duplicate the datasets, which creates separate copies of parameters and their values in the new flow. If datasets are not copied, then parameter changes in the copied flow modify the values in the source flow.


Export Flow: (Available to flow owner only)Export the flow for archive or transfer. For more information, see Export Flow.Move to: Move the flow to a new or existing folder. See Manage Flows with Folders.


Edit Flow name and description:  (Available to flow owner only) Change the name and description of the flow.

...

Warning

Deleting a flow removes all recipes that are contained in the flow. If copies of these objects exist in other flows, they are not touched. Imported datasets are not deleted by this action.

...

.

...

...

Add Datasets to Flow

From the Flow View page, you can add imported or reference datasets to your flow. These datasets are added as independent objects in the flow and can be joined, unioned, or referenced by other datasets in the flow.

...

When you select an imported dataset, you can preview the data contained in it, replace the source object, and more from the right-side panel.

D caption
Imported Dataset view

...

  • Click Edit all. Specify the values for each variable in the flow.
  • Hover over the entry for a specific variable. Click Edit and set the override value.

    Tip

    Tip: You can always revert to using the default value.


For more information on executing jobs via API, see API Workflow - Run Job on Dataset with Parameters.

Parameters tab

When you select a dataset with parameters in Flow View, you can review the parameters that have been specified for the selected dataset in the right panel.

...

  • Scheduled destinations are populated whenever the flow's schedule is triggered and the destination's recipe is successfully executed.


Image Modified




D caption
typefigure
Destinations tab

...

For more information, see Overview of Automator.

Actions:


  • Run Job: Click Run Job to queue for immediate execution a job for the manual destinations. You can track the progress and results of this task through the Jobs tab. 

...

Each entry in the Jobs tab identifies a job that has been queued for execution for the selected output. You can track the progress, success, or failure of execution.

Tip

Tip: When you hover the mouse over a job link, you can review details of the job in progress. For more information, see Overview of Job Monitoring.

When a job has finished execution you can review the results. Click the link to the job. For more information, see Job Details Page.

...

Edit name and description: (Available to flow owner only) Change the name and description for the object. 


Delete Reference Dataset: Remove the reference dataset from the flow.

...

D caption
typefigure
Connections view

Key Fields:

Connection Type: For more information, see Connection Types.

Owner: User that owns the connection. This user can modify connection properties.

...

Private - Connection is available for use only for specified users of the platform.

Public - Connection is available for all users.

For more information, see Share Connection Window.

...