Page tree

Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Published by Scroll Versions from space DEV and version r0642

D toc

When 

D s product
rtrue
 creates an imported dataset from a schematized source, the product applies its own type inferencing to the columns of the imported data. Type inferencing may be reapplied during some operations, such as the creation of samples or when data reshaping transformations are applied in the Transformer page. 

If preferred, you can disable this type inferencing on the columns of your imported dataset. When the data is imported, the original types from the source system remain. Any types that do not have a corresponding match with the 

D s item
itemdata types
 must be manually typed in the application. 

Methods of disabling:

Column data typing is applied to schematized sources in one of three ways:

  1. Globally
  2. Per-connection type inference settings override the global setting.
  3. Per-file type inference settings override both global and per-connection settings.

For more information on applying global or per-connection type inference settings, see Configure Type Inference.

You can use the following steps to disable type inference applied to a specific file during the import process.


Tip

Tip: For imported datasets from relational sources, you can identify in Flow View whether type inferencing has been applied to the dataset. When the dataset is selected in Flow View, locate the Type Inference entry in the right panel.

Tip

Tip: If you have already imported the dataset and need to change this setting, you can re-import the source and change the settings. In any flows that use the previously imported version of this dataset, you can change the input for any recipe that uses the old version to use this newly imported version. See Flow View Page.

Steps:

  1. After you have selected or specified the relational table to import in the Import Data page, click Edit Settings for the dataset card in the right panel.
  2. Deselect the Column Data Type Inference checkbox.
  3. Continue the import process.
  4. When the dataset is loaded into the Transformer page, no new data typing is applied at all, unless you manually specify the
    D s item
    itemdata types
     for the column.