Through the Import Data page, you can upload datasets or select datasets from sources that are stored on connected datastores. From the Library page, click Import Data.




Import Data page

General Limitations

NOTE: For file-based sources, expects that each row of data in the import file is terminated with a consistent newline character, including the last one in the file.

  • For single files lacking this final newline character, the final record may be dropped.

  • For multi-file imports lacking a newline in the final record of a file, this final record may be merged with the first one in the next file and then dropped in the running environment.



File and path limitations:

Basic Task

1. Connect to sources

During import, the identifies file formats based on the extension of the filename.

Upload: can also load files from your local file system.

Tip: You can drag and drop files from your desktop to to upload them.


NOTE: You can upload a file up to 1 GB in size.


NOTE: When you upload an updated version of a previously uploaded file, the new file is stored as a separate upload altogether. In your flow, you must swap out the old dataset to point to the new one.








For more information on the supported input formats, see Supported File Formats.

2. Add datasets

When you have found your source directory or file:


3. Configure selections

When a dataset has been selected, the following fields appear on the right side of the screen. Modify as needed:

Tip: Click the Eye icon to inspect the contents of the dataset prior to importing.

Tip: You can select a single dataset or multiple datasets for import.


Edit settings 

You can edit any additional or optional settings for an individual dataset. Perform the following:

Steps:

  1. Click Edit Settings from the card for an individual dataset in the right panel. The dialog box is displayed. 
  2. In the dialog box, select the required options and modify the settings.

4. Import selections

Single dataset

If you have selected a single dataset for import:

Tip: If present, you can click the Add to new flow checkbox, which adds the imported datasets to an Untitled flow.

Multiple datasets

You can import multiple datasets from multiple sources at the same time. In the Import Data page, continue selecting sources, and additional dataset cards are added to the right panel.

NOTE: If you are importing from multiple files at the same time, the files are not necessarily read in a regular or predictable order.


NOTE: When you import a dataset with parameters from multiple files, only the first matching file is displayed in the right panel.

In the right panel, you can see a preview of each dataset and make changes as needed.

Import Multiple Datasets


If you have selected multiple datasets for import:

Tip: If present, you can click the Add to new flow checkbox, which adds the imported datasets to an Untitled flow. For more information, see Flow View Page.