Image RemovedImage Added

Import Data page

...

...

File and path limitations:

• The colon character  ( :)  cannot appear in a filename or a file path.
• Filenames cannot begin with special characters like dot ( .) or underscore( _).
• Input file or table paths can have a maximum length of 1024 characters. 

Basic Task

1. Connect to sources

...

During import, the

• Compressed files are recognized and can be imported based on their file extensions.
• Filenames that do not have an extension are treated as TXT files.

Upload: The

...

...

For more information on the supported input formats, see Supported File Formats.

...

• You can hover over the name of a file to preview its contents.

  Info
  NOTE: Preview may not be available for some sources, such as Parquet.

• Click the Plus icon next to the directory or filename to add it as a dataset.

  Tip
  Tip: You can import multiple datasets at the same time. See below.

• Excel files: Click the Plus icon next to the parent workbook to add all of the worksheets as a single dataset, or you can add individual sheets as individual datasets. See Import Excel Data 

To show hidden files or folders, select Show hidden.

3. Configure selections

When a dataset has been selected, the following fields appear on the right side of the screen. Modify as needed:

• Dataset Name: This name appears in the interface.
• Dataset Description: You may add an optional description that provides additional detail about the dataset. This information is visible in some areas of the interface.

Edit settings 

You can modify settings used during import for individual files. In the card for edit any additional or optional settings for an individual dataset, click Edit Settings.

• Per-file encoding: By default,

  D s product

  attempts to interpret the encoding used in the file. In some cases, the data preview panel may contain garbled data, due to a mismatch in encodings. In the Data Preview dialog, you can select a different encoding for the file. When the correct encoding is selected, the preview displays the data as expected. 

• Detect structure: By default,

  D s product

  attempts to interpret the structure of your data during import. This structuring attempts to apply an initial tabular structure to the dataset.
  • Unless you have specific problems with the initial structure, you should leave the Detect structure setting enabled. Recipes created from these imported datasets automatically include the structuring as the first, hidden steps. These steps are not available for editing, although you can remove them through the Recipe panel. See Recipe Panel.
  • When detecting structure is disabled, imported datasets whose schema has not been detected are labeled, unstructured datasets. When recipes are created for these unstructured datasets, the structuring steps are added into the recipe and can be edited as needed.
  • For more information, see Initial Parsing Steps.

• Remove special characters from column names: When selected, characters that are not alphanumeric or underscores are stripped, and space characters are converted to underscores.

  For more information, see Sanitize Column Names.

4. Import Selections

Single dataset

If you have selected a single dataset for import:

1. To immediately wrangle it, click Import & Wrangle. The dataset is imported. A recipe is created for it, added to a flow, and loaded in the Transformer page for wrangling. See Transformer Page.
2. To import the dataset, click Import. The imported dataset is created. You can add it to a flow and create a recipe for it later. See Library Page.

Multiple datasets

You can import multiple datasets from multiple sources at the same time. In the Import Data page, continue selecting . Perform the following:

Steps:

1. Click Edit Settings from the card for an individual dataset in the right panel. The dialog box is displayed. 
2. In the dialog box, select the required options and modify the settings.
   
   • File Import Settings: For more information, see File Import Settings.

4. Import selections

You can import one or more datasets. Continue selecting sources, and additional dataset cards are added to the right panel.

...

In the right panel, you can see a preview of each dataset and make changes as needed.

ImportImporting Multiple Datasets

...

• To import the selected datasets, click
Import Datasets. The imported datasets are created. You can begin working with these imported datasets now or at a later time. If you are not wrangling the datasets immediately, the datasets you just imported are listed at the top of the Library page. See Library Page.
• To import the selected datasets and add them to a flow:
  1. Click the Add Dataset to a Flow checkbox.
  2. Click the textbox to see the available flows, or start typing a new name.
  3. Click Import & Add to Flow.

  4. Create or select the flow to which to add them:
     Image Removed

     D caption
     Add imported datasets to a flow

     1. Filter by Type: Click one of the tabs in the dialog to display only the applicable flows. 
     2. Search: Start typing letters to filter the list of flows.
     3. Create new flow: Enter a name and description for the new flow to which to add the datasets.
     4. To add the datasets to the selected flow, click Add.
  5. The datasets are imported, and the associated recipes are created. These datasets and recipes are added to the selected flow.
  6. For any dataset that has been added to a flow, you can review and perform actions on it. See Flow View Page.
• Continue.  
• To remove a dataset from import, click the X in the dataset card.