When you select an imported dataset in Flow View, you can review its details in the context panel and select options from its context menu. |
Imported Dataset icon |
The following menu options are available when you select the plus icon next to the imported dataset:
Add new recipe: Add a new recipe extending from the current recipe. This new recipe operates on the outputs of the original recipe.
Tip: You should rename your recipe as soon as you create it. |
The following options are available in the details context menu when you select an imported dataset.
Replace with dataset with Parameters: For datasets that are not parameterized, you can choose to replace with datasets with parameters.
Tip: You may find it useful to create your recipes with a single static dataset and then later replace with a dataset with parameters. |
All dependent flows, outputs, and references are not removed from the flow. You can replace the source for these objects as needed.
NOTE: References to the deleted dataset in other flows remain broken until the dataset is replaced. |
Refresh Dataset: If available, this option refreshes the dataset's metadata with the latest source schema.
NOTE: When a dataset is refreshed, all samples associated with the dataset are deleted, whether the dataset has changed. Samples must be recreated in their recipes. |
NOTE: If you attempt to refresh the schema of a parameterized dataset based on a set of files, only the schema for the first file is checked for changes. If changes are detected, the other files are contain those changes as well. This can lead to changes being assumed or undetected in later files and potential data corruption in the flow. |
For more information, see Overview of Schema Management.
Tip: You can also right-click the imported dataset to view all the menu options. |
When you select an imported dataset, you can preview the data contained in it, replace the source object, and more from the right-side panel.
Imported Dataset view |
Key Fields:
Data Preview: In the Data Preview window, you can see a small section of the data that is contained in the imported dataset. This window can be useful for verifying that you are looking at the proper data.
Tip: Click the preview to open a larger dialog, where you can select and copy data. |
Column Data Type Inference:
NOTE: This field is only applicable to datasets imported from relational sources. |
enabled
- Data types have been applied to the dataset during import.disabled
- Data types were not globally applied to the dataset during import. However, some columns may have had overrides applied to them during the import process. See Import Data Page.