Page tree

Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Excerpt

In Flow View, you can access and manage the objects that you have added to or created in the selected flow. You can perform a variety of actions to effectively manage flow development and job execution through a single page in the 

D s webapp
rtrue
.


D s roles

Warning

If you have enabled Deployment Manager, avoid making changes in Flow View on a Production instance of the platform.

  • Scheduling executions through Flow View in a Prod environment is not supported. Job executions must be executed through the APIs. See API Workflow - Deploy a Flow.
  • Some Flow View options may not be available in a Prod environment.
  • You should apply changes to your flow in the Dev instance and then re-deploy to Production. For more information, see Overview of Deployment Manager.


Info

NOTE: If the displayed flow has been shared with you, some options are not available.


D caption
Flow View page

Flow View Organization

Flow View is organized into the following basic areas:

AreaDescription
Top barAt the top of the screen, you can access a menu of options, which enable adding objects to your flow, configuring aspects of your flow, and and other flow management tasks. See "Top bar" below.
Flow canvasThe primary workspace of Flow View is the flow canvas, where you build and organize the objects in your flow. See "Flow Canvas" below.
Context panelWhen you select one or more objects in your flow, the object details and relevant context menu options are available in the right-hand panel. See "Context Panel" below.


Top Bar

From the bar at the top of Flow View, the following options are available:

...

  • Imported datasets - data sourced from outside the platform
  • Reference datasets - dataset objects that are created from the output of a recipe in the current flow or another flow


Info

NOTE: For long-loading relational sources, you can track progress of the load. While the data is loading, some recipe and flow options are disabled.

For more information on enabling long-loading, see Configure JDBC Ingestion.

These independent objects can be joined, unioned, or referenced by other datasets in the flow. For more information on these object types, see "View for Objects" below.

...

  • Imported datasets
    • Unstructured datasets
  • Recipes
  • Outputs
  • Notes
  • Reference datasets


  • Datasets with parameters


Datasets:


  • To begin working with data:

    • Click Add datasets. Locate your source data and import it into your flow.  See "Add Datasets to Flow" above.
    • In Flow View, select the imported dataset on the flow canvas. Then, in the context panel, click Add new recipe. A new, empty recipe is associated with the dataset. 

      Tip

      Tip: Double-click an imported dataset to see a preview of it. Some datasets cannot be previewed.


    • To open in the Transformer page, click the recipe and select Edit Recipe. See Transformer Page.
  • When created, these objects are connected together by lines flowing between them, which show the relationships between the objects in the flow.

...