Page tree

Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Published by Scroll Versions from space DEV and version r095

D toc

Excerpt

In Review the Library page, you can review your imported and imported datasets, reference datasets, and any macros that to which you may have created. You can also import new data from this have access in the Library page.

Infotip

NOTE: Youcan only see the imported datasets to which you have access in your currently selected project or workspace. If the data underlying the imported dataset is not available, the imported dataset is still listed in the Library page, since it is just a reference to the dataTip: If you land in an empty Library page, you can start adding datasets. Click Import Data. See Import Data Page.

D caption
typefigure
Library Page

To create a new imported dataset, click Import Data. See Import Data Page.
Filter by type:

Click one of the pre-defined filters to show datasets of the following typesTabs:

  • All Data:

...

  • You can view all the imported datasets or references available to

...

  • you.
  • Imported Datasets:

...

D s product
rtrue

...

  • Review your imported datasets from sources such as file-based storage, connected databases, or desktop. 

    • The Source column indicates where the original source data is located.
  • References:

...

  • Reference datasets are created from a recipe's output. 
  • Macros: Macros are sequence of steps that can be reused in other

...

  • 's recipe. 

Filter by type:

Click one of the pre-defined filters to show datasets of the following types:Columns:

  • Name: Name of the object.
  • Owner: Owner of the object.
  • In Flows: Count of flows in which the object is in use. 
  • Source: Flow or datastore where the object is located.
  • Last Updated: Timestamp of the last time that the object was modified.

...

  • Details: Review details about the dataset. See See Dataset Details Page.
  • Preview: Inspect a preview of the dataset.

    Info

    NOTE: Preview is not available for binary format sources.

  • Use in new Flow: (Imported dataset only) You can create a new flow and begin immediately wrangling the dataset. This step also creates a recipe in the flow.
  • Add to Flow: Add the dataset to a new or existing flow.
  • Make a copy: Create a copy of the imported dataset. This option is not available for reference datasets. 

  • Edit name Edit name and description: Change the name and description of the dataset.
  • Edit data settings: If the source of the imported dataset required conversion to an internally supported format, you can modify settings related to that conversion process. For more information, see File Import Settings.

    Tip

    Tip: This setting applies primarily to binary file formats, such as PDF and Excel, or file formats that may require additional steps to convert into tabular data, such as JSON.

  • Delete Dataset: Delete  Delete the dataset.

    Warning

    Deleting a dataset cannot be undone.

  • Refresh Dataset: If  If available, this option refreshes the dataset's metadata with the latest source schema.

    Info

    NOTE: If you attempt to refresh the schema of a parameterized dataset based on a set of files, only the schema for the first file is checked for changes. If changes are detected, the other files are contain those changes as well. This can lead to changes being assumed or undetected in later files and potential data corruption in the flow.

    For more information, see see Overview of Schema Management.

Imported Datasets

Info

NOTE: Youcan only see the imported datasets to which you have access in your currently selected project or workspace. If the data underlying the imported dataset is not available, the imported dataset is still listed in the Library page, since it is just a reference to the data.

To create a new imported dataset, click Import Data. For more information, see Import Data Page.

For more information, see Imported Datasets Page.

References

A reference dataset is a reference to a recipe's output. For more information, see References Page.

Info

NOTE:  A reference dataset is a read-only object in the flow where it is referenced. A reference dataset must be created in the source flow from the recipe to use.

A reference dataset is created from the context menu of a flow's recipe. See Flow View Page.

Macros

A macro is a saved sequence of one or more recipe steps that can be reused in other recipes. See Macros Page.

You can either import macros from your desktop or browse through the

D s product
community page for existing macros. For more information, see Import Macro.
D s also
inCQLtrue
label((label = "datasetlibrary_uipage") or (label = "imported_dataset") or (label = "macro") or (label = "reference_dataset"))