...
Through the Flow View page, you can access and manage all objects in your flow. For each imported dataset, recipe, or other object in your flow, you can perform a variety of actions to effectively manage flow development and job execution through a single page in the
D s webapp | ||
---|---|---|
|
Warning |
---|
If you have enabled Deployment Manager, avoid making changes in Flow View on a Production instance of the platform.
|
Info |
---|
NOTE: If the displayed flow has been shared with you, some options are not available. |
D caption |
---|
Flow View page |
The imported datasets in the flow or reference datasets added to the flow are listed on the left side of the screen. Associated with each dataset can be one or more recipes, which are used to transform the source data.
...
- To begin working with an imported dataset, select it and click Add new recipe. A new, empty recipe is associated with the dataset. To open in the Transformer page, click the recipe and select Edit Recipe. See Transformer Page.
- When created, these objects are connected together by lines flowing between them, which show the relationships between the objects in the flow.
For any object, any objects on which it depends are displayed to the left of the object on one of the flowing lines leading from it.
Tip Tip: When you run a job for a recipe, all of the recipes steps for the preceding datasets are executed as part of the job, and only the results of the terminal dataset are generated.
In the above example, the
POS-01
recipe is dependent on all of the objects in the flow.The other datasets have been integrated with the
POS-01
dataset and have not yet had a recipe created for them.
...
When a user is given access to a flow, all of the following actions are available to that user, except for editing details and deleting the flow.
Make a copy: Create a copy of the flow.
Info |
---|
NOTE: The copied flow is independent of the source flow, but the original source datasets are connected. |
Export Flow: (Available to flow owner only)Export the flow for archive or transfer. For more information, see Export Flow.
...
- Click Edit all. Specify the values for each variable in the flow.
Hover over the entry for a specific variable. Click Edit and set the override value.
Tip Tip: You can always revert to using the default value.
For more information on executing jobs via API, see API Workflow - Run Job on Dataset with Parameters.
Parameters tab
When you select a dataset with parameters in Flow View, you can review the parameters that have been specified for the selected dataset in the right panel.
...
- Manual destinations are executed when the job is run through the application interface.
Scheduled destinations are populated whenever the flow's schedule is triggered and the destination's recipe is successfully executed.
D caption | ||
---|---|---|
| ||
Destinations tab |
Key Fields:
- (Action)-(Format):
- Field name describes the output action and the file format in which the results are written.
- Field value is the location where the results are written.
- Field name describes the output action and the file format in which the results are written.
Environment: The running environment where the job is configured to be executed.
- Profiling: If profiling is enabled for this destination, this value is set to
yes
.
...
Info | ||||
---|---|---|---|---|
NOTE: This feature may not be enabled in your instance of the platform. For more information, please contact your
|
Download logs: Download the logs for the job. If the job is in progress, log information is likely to be incomplete.
View for References
When you select a recipe, you can choose to create a reference dataset off of that recipe. A reference dataset is a dataset that is a reference to the output generated from a recipe contained in another flow. Whenever the upstream recipe and its output data are changed, the results are automatically inherited through the reference to the reference dataset.
...
Edit name and description: (Available to flow owner only) Change the name and description for the object.
Delete Reference Dataset: Remove the reference dataset from the flow.
...
Public
- Connection is available for all users.
For more information, see Share Connection Window.
Actions:
Edit Connection: Select to modify the connection.
...