...
| Excerpt |
|---|
Through the Import Data page, you can upload datasets or select datasets from sources that are stored on connected datastores. From the Library page, click Import Data. |
| D caption | ||
|---|---|---|
| ||
Import Data page |
...
| Info | |||||
|---|---|---|---|---|---|
NOTE: For file-based sources, the
|
| Info |
|---|
NOTE: For file-based external datastores, the following limitations apply:
|
| D s minrows |
|---|
File and path limitations:
...
1. Connect to sources
During import, the
identifies D s webapp type
identifies file formats based on the extension of the filename. Portal
- Compressed files are recognized and can be imported based on their file extensions.
- Filenames that do not have an extension are treated as TXT files.
Upload: The
| d-s-product | r | true
|---|
| platform |
...
| Info |
|---|
NOTE: When you upload an updated version of a previously uploaded file, the new file is stored as a separate upload altogether. In your flowWhere the imported dataset based on the previous version is used, you must swap out the old dataset to point to the new one. |
...
You can hover over the name of a file to preview its contents.
Info NOTE: Preview may not be available for some sources, such as Parquet.
Click the Plus icon next to the directory or filename to add it as a dataset.
Tip Tip: You can import multiple datasets at the same time. See below.
Excel files: Click the Plus icon next to the parent workbook to add all of the worksheets as a single dataset, or you can add individual sheets as individual datasets. See Import Excel Data.
If custom SQL query is enabled, you can click Create Dataset with SQL to enter a customized SQL statement to pre-filter the table within the database to include only the rows and columns of interest.
For more information, see Create Dataset with SQL.
...
| Info |
|---|
NOTE: Hidden folder names begin with a dot ( |
| Tip |
|---|
Tip: If you have run a job with profiling enabled, you can import your profile files as datasets and then publish them to other datastores, such as BigQuery, for additional analysis. These files are stored in the |
3. Configure selections
When a dataset has been selected, the following fields appear on the right side of the screen. Modify as needed:
...
- Table Import Settings: For more information, see Table Import Settings.
4. Import selections
Single dataset
If you have selected a single dataset for import:
| Tip |
|---|
Tip: If present, you can click the Add to new flow checkbox, which adds the imported datasets to an |
- Click Continue. The dataset is imported.
- A recipe is created for it, added to a new flow, and loaded in the Transformer page for wrangling. See Transformer Page.
...
You can import multiple datasets from multiple sources at the same time. In the Import Data page, continue selecting one or more datasets. Continue selecting sources, and additional dataset cards are added to the right panel.
...
In the right panel, you can see a preview of each dataset and make changes as needed.
| D caption | ||
|---|---|---|
| ||
ImportImporting Multiple Datasets |
...
Tip: If present, you can click the Add to new flow checkbox, which adds the imported datasets to an |
- To import the selected datasets, click Continue. To begin transforming one of these datasets in Flow View, select it. From its context menu, select Add new recipe. Select the recipe. In the context panel on the right, select Edit Recipe. See Transformer Page.
- To remove a dataset from import, click the X in the dataset card.
...
