Through the Import Data page, you can upload datasets or select datasets from sources that are stored on connected datastores. From the Library page, click Import Data.
Import Data page
NOTE: For file-based sources, expects that each row of data in the import file is terminated with a consistent newline character, including the last one in the file.
File and path limitations:
:) cannot appear in a filename or a file path.
.) or underscore(
NOTE: Compressed files are recognized and can be imported based on their file extensions.
Upload: can also load files from your local file system.
Tip: You can drag and drop files from your desktop to to upload them.
NOTE: You can upload a file up to 100 MB in size.
NOTE: When you upload an updated version of a previously uploaded file, the new file is stored as a separate upload altogether. In your flow, you must swap out the old dataset to point to the new one.
For more information on the supported input formats, see Supported File Formats.
When you have found your source directory or file:
You can hover over the name of a file to preview its contents.
NOTE: Preview may not be available for some sources, such as Parquet.
Click the Plus icon next to the directory or filename to add it as a dataset.
Tip: You can import multiple datasets at the same time. See below.
Excel files: Click the Plus icon next to the parent workbook to add all of the worksheets as a single dataset, or you can add individual sheets as individual datasets. See Import Excel Data.
When a dataset has been selected, the following fields appear on the right side of the screen. Modify as needed:
Dataset Description: You may add an optional description that provides additional detail about the dataset. This information is visible in some areas of the interface.
Tip: Click the Eye icon to inspect the contents of the dataset prior to importing.
You can select a single dataset or multiple datasets for import.
You can modify settings used during import for individual files. In the card for an individual dataset, click Edit Settings.
NOTE: In some cases, there may be discrepancies between row counts in the previewed data versus the data grid after the dataset has been imported, due to rounding in row counts performed in the preview.
Remove special characters from column names: When selected, characters that are not alphanumeric or underscores are stripped, and space characters are converted to underscores.
For more information, see Sanitize Column Names.
If you have selected a single dataset for import:
You can import multiple datasets from multiple sources at the same time. In the Import Data page, continue selecting sources, and additional dataset cards are added to the right panel.
NOTE: If you are importing from multiple files at the same time, the files are not necessarily read in a regular or predictable order.
NOTE: When you import a dataset with parameters from multiple files, only the first matching file is displayed in the right panel.
In the right panel, you can see a preview of each dataset and make changes as needed.
Import Multiple Datasets
If you have selected multiple datasets for import:
Create or select the flow to which to add them:
Add imported datasets to a flow