Page tree

Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  • If loading your Excel-based dataset in the Transformer page results in a blank screen, please take a new sample. The file requires conversion again with each generated sampling.

    Info

    NOTE: When you share a flow that contains a dataset sourced from Microsoft Excel, the user with whom the flow is shared may receive a Could not parse error. In this case, the user does not have access to the original sample. The workaround is to take a new sample or to run a job on the full dataset.


  • Latest state of the Excel file may not be reflected in the Transformer page due to caching. When you run a job, the platform always collects the latest version of the data and converts it to CSV for execution.

...

  • Workbooks can be uploaded from your local file system.

...

Use

...

When Excel data is imported into 

D s product
, each sheet in an imported file must be converted to a CSV and then ingested for use. The product's conversion service supports two methods:

...

Tip

Tip: The Java-based Apache POI conversion method is recommended. However, if you encounter issues while using this method, you may choose to use the following settings to enable the Python method.

Settings:

Administrators can modify the following settings to enable either conversion method.

...

for

...

use

...

Set this value to Disabled to use the Python conversion method.

...

.

...

This setting does not apply to files in XLS format.

...

...

Steps:

  1. In the menu bar, click Library
  2. In the Library page, click Import Data. Select the connection to use. See Import Data Page.


    D caption
    typefigure
    Import Excel workbook


    Tip

    Tip: If you experience issues uploading large XLS/XLSX files, you can convert the files to CSV files and then upload them.


  3. After you select the workbook, it is uploaded and converted to CSV format and stored by the platform. Depending on the size of the workbook, this process may take a while.
  4. By default, all worksheets in the workbook are imported as individual datasets. To change how the data is imported, click Edit in the right panel.

    D caption
    Import settings for Excel datasets


  5. Dataset creation:
    1. 1 dataset per sheet: (Default) Each selected sheet in the workbook is imported as a separate dataset. 
      Specify the base name of the datasets that you are creating. If you are creating a single dataset, the name of the workbook is used. 
    2. Selected sheets into 1 dataset: All selected sheets in the workbook are combined and imported as a single dataset.

      Info

      NOTE: The schemas of each dataset must match. Columns must be listed in the same order in each dataset. The column headers are taken from the first selected dataset.



    3. All and future sheets into 1 dataset: If the workbook is updated periodically with new sheets that you would like to add in the future, select this option. After initial selection of sheets, all sheets that are added to the workbook in the future are automatically added as part of the imported dataset.

      Info

      NOTE: This option is available only if you are connected to a backend file storage system.


  6. Selected sheets: 
    1. You can select the sheets to import. 

      Info

      NOTE: If you are importing a folder of Excel files, data preview and initial sampling are executed against the first file found in the folder.


    2. To preview the data of an individual sheet, mouse over a dataset and click Jump to.

  7. Remove special characters from column names: Select this option to remove any special characters from the inferred column headers during import.
  8. From the drop-down, you can specify how you want the application to parse the data for column headers. 
  9. To save changes, click Save.
  10. After your datasets have been added, you can edit the name and description information for each in the right navigation panel.
  11. Optionally, you can assign the new dataset(s) to an existing flow or create a new one to contain them