Page tree

Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  • Remove structure: (If applicable) Remove the initial parsing structure. When the structure is removed:
    • The dataset is converted to an unstructured dataset. An unstructured dataset is the source data converted into a flat file format.
    • All steps to shape the dataset are removed. You must break up columns in manual steps in any recipe created from the object.
    • See View for Unstructured Datasets.
  • Remove from Flow: Remove the dataset from the flow.
    • All dependent flows, outputs, and references are not removed from the flow. You can replace the source for these objects as needed.

      Info

      NOTE: References to the deleted dataset in other flows remain broken until the dataset is replaced.


  • Refresh Dataset: If available, this option refreshes the dataset's metadata with the latest source schema.

    Info

    NOTE: When a dataset is refreshed, all samples associated with the dataset are deleted, whether the dataset has changed. Samples must be recreated in their recipes.


    Info

    NOTE: If you attempt to refresh the schema of a parameterized dataset based on a set of files, only the schema for the first file is checked for changes. If changes are detected, the other files are contain those changes as well. This can lead to changes being assumed or undetected in later files and potential data corruption in the flow.


    For more information, see Overview of Schema Management.

...