Page tree

Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Published by Scroll Versions from space DEV and version next

...

  • Add:
    • Recipe: Add a recipe for this dataset.
    • Join: Join this dataset with another recipe or dataset. If this dataset does not have a recipe for it, a new recipe object is created to store this step. See Join Window.
    • Union: Union this dataset with one or more recipes or datasets. If this dataset does not have a recipe for it, a new recipe object is created to store this step. See Union Page. 
  • View dataset details: Explore details of the dataset. See Dataset Details Page.
  • ReplaceReplace the dataset with a different dataset or reference dataset.

...

  • Remove structure: (If applicable) Remove the initial parsing structure. When the structure is removed:
    • The dataset is converted to an unstructured dataset. An unstructured dataset is the source data converted into a flat file format.
    • All steps to shape the dataset are removed. You must break up columns in manual steps in any recipe created from the object.
    • See View for Unstructured Datasets.
  • Remove from Flow: Remove the dataset from the flow.
    • All dependent flows, outputs, and references are not removed from the flow. You can replace the source for these objects as needed.

      Info

      NOTE: References to the deleted dataset in other flows remain broken until the dataset is replaced.

  • Refresh Dataset: If available, this option refreshes the dataset's metadata with the latest source schema.

    Info

    NOTE: If you attempt to refresh the schema of a parameterized dataset based on a set of files, only the schema for the first file is checked for changes. If changes are detected, the other files are contain those changes as well. This can lead to changes being assumed or undetected in later files and potential data corruption in the flow.


    For more information, see Overview of Schema Management.

Tip

Tip: You can also right-click the imported dataset to view all the menu options.

When you select an imported dataset, you can preview the data contained in it, replace the source object, and more from the right-side panel.

D caption
Imported Dataset view

...

  • File Size: Size of the file. Units may vary.
  • Column Data Type Inference: 

    Info

    NOTE: This field is only applicable to datasets imported from relational sources.

    • enabled - Data types have been applied to the dataset during import.
    • disabled - Data types were not globally applied to the dataset during import. However, some columns may have had overrides applied to them during the import process. See Import Data Page.

  • ConnectionName: If the data is accessed through a connection, you can click this link to review connection details in the right-side panel. See View for Connections below.
  • More details: Review details on the flows where the dataset is used.

D s also
inCQLtrue
label((label = "flow_ui") OR (label = "import_ui") OR (label = "dataset_ui"))