Page tree

Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Published by Scroll Versions from space DEV and version r0681

...

Source Data TypeSupported?
D s item
Data Type
Data Type
Notes
arrayYArray 
bigintYInteger
Info

NOTE: The

D s platform
may infer bigint columns containing very large or very small values as String data type.

binaryYString 
booleanYBool 
charYString 
dateYDatetime 
decimalYDecimal 
doubleYDecimal 
floatYDecimal
Info

NOTE: On import, some float columns may be interpreted as Integer data type in the

D s platform
. To fix, you can explicitly set the column's data type to Decimal in the Transformer page.

intYInteger 
mapYObject 
smallintYInteger 
stringYString 
structYObject 
timestampYDatetime 
tinyintYInteger 
uniontypeN  
varcharYString 

Notes: 

  • After a dataset has been imported using custom SQL from Hive, disabling type inference may not revert to the source data types for some columns. The workaround is to create a new imported dataset using the same custom SQL with type inference disabled before import. After the dataset is created, use it as a replacement for the corrupted instances of the previous Hive dataset.

Write/Publish

Create new table

...