Page tree

Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Published by Scroll Versions from space DEV and version r097

...

Per-file encoding

By default,  the

d-s-productplatform
rtrue
 applies a specified encoding type on the imported the file. In some cases, the data preview panel may contain garbled data, due to a mismatch in encodings. In the Data Preview dialog, you can select a different encoding for the file. When the correct encoding is selected, the preview displays the data as expected. 

Info

NOTE: Assessing the file encoding type based on parsing an input file is not an accurate method. Instead, the

d-s-productplatform
assumes  assumes that the file is encoded in the default encoding. If it is not, you should change the encoding type for the file.

...

Info

NOTE: In some cases, imported files are not properly parsed due to issues with encryption types or encryption keys in the source datastore. For more information, please contact your datastore administrator.

For a list of supported encoding types, see Supported File Encoding Types.

Detect structure

By default,  the

d-s-productplatform
 attempts to interpret the structure of your data during import. This structuring attempts to apply an initial tabular structure to the dataset.

  • Unless you have specific problems with the initial structure, you should leave the Detect structure setting enabled.

    Recipes created from these imported datasets automatically include the structuring as the first, hidden steps. These steps are not available for editing, although you can remove them through the Recipe panel. See Recipe Panel.

     

    Tip

    Tip: When Detect structure is enabled for an imported dataset, the structure of the file can be checked for changes during job execution. 

  • When detecting structure is disabled, imported datasets whose schema has not been detected are labeled, unstructured datasets. When recipes are created for these unstructured datasets, the structuring steps are added into the recipe and can be edited as needed.For more information, see Initial Parsing Steps. 

Remove special characters from column names

When selected, characters that are not alphanumeric or underscores are stripped, and space characters are converted to underscores. For more information, see Sanitize Column Names. 

Selecting column headers

You can apply the column headers to your datasets during import. Select the required option from the drop-down list:

  • Infer header:   (default) When selected, the the
    D s webapp
    typePortal
     infers the header based on the data in the import. 
  • Use first row as header: When selected, the first row is used as the column headers.

  • No header: When selected, the inference is ignored and column headers are defined using generic names with no headers.

If replacing a file: 

  • If you replace a dataset in a flow and dataset and select the Use first row as header option, then the existing header row labels are updated with the new headers.
  • Subsequent steps in a prePre-existing recipe may transformation steps may be broken if the headers are changed by a replaced file.

...

  • .

D s also
inCQLtrue
label((label = "import_ui") OR (label = "file"))