Page tree

Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Published by Scroll Versions from space DEV and version r0710

D toc

Excerpt

An unstructured dataset is an imported dataset that does not contain any initial parsing steps. All parsing steps must be added through recipes that are applied to the dataset. During the import process, you disable the initial steps that are applied to imported datasets. Instead, these steps are added as the first steps of the auto-generated recipe that appears with the dataset in Flow View.

D caption
Unstructured Dataset icons

Menu Options:

  • Add:
    • Recipe: Add a recipe for this dataset.
    • Join: Join this dataset with another recipe or dataset. If this dataset does not have a recipe for it, a new recipe object is created to store this step.
    • Union: Union this dataset with one or more recipes or datasets. If this dataset does not have a recipe for it, a new recipe object is created to store this step.
  • View dataset details: Explore details of the dataset. See Dataset Details Page.
  • ReplaceReplace the dataset with a different dataset or reference dataset.

  • Replace with dataset with Parameters: For datasets that are not parameterized, you can choose to replace with datasets with parameters.

    Tip

    Tip: You may find it useful to create your recipes with a single static dataset and then later replace with a dataset with parameters.

  • Edit name and description: (Available to flow owner only) Change the name and description for the object.
  • Remove from Flow: Remove the dataset from the flow.
    • All dependent flows, outputs, and references are not removed from the flow. You can replace the source for these objects as needed.

      Info

      NOTE: References to the deleted dataset in other flows remain broken until the dataset is replaced.

D caption
Unstructured Dataset view

Key Fields:

Data Preview: In the Data Preview window, you can see a small section of the data that is contained in the imported dataset. This window can be useful for verifying that you are looking at the proper data.

Tip

Tip: Click the preview to open a larger dialog, where you can select and copy data.

Type: Indicates where the data is sourced or the type of file.

Location: Path to the location of the imported dataset.

File Size: Size of the file. Units may vary.