NOTE: The listed in this page reflect the raw data type of the converted column. Depending on the contents of the column, the Transformer Page may re-infer a different data type, when a dataset using this type of source is loaded.

Access/Read

When a Hive data type is imported, its JDBC data type is remapped according to the following table.

Tip: Data precision may be lost during conversion. You may want to generate min and max values and compute significant digits for values in your Hive tables and then compute the same in the .


Source Data TypeSupported?
Notes
arrayYArray 
bigintYInteger


NOTE: The may infer bigint columns containing very large or very small values as String data type.If needed, you can disable type inference for individual schematized sources. For more information, see Import Data Page.


binaryYString 
booleanYBool 
charYString 
dateYDatetime 
decimalYDecimal 
doubleYDecimal 
floatYDecimal


NOTE: On import, some float columns may be interpreted as Integer data type in the . To fix, you can explicitly set the column's data type to Decimal in the Transformer page.


intYInteger 
mapYObject 
smallintYInteger 
stringYString 
structYObject 
timestampYDatetime 
tinyintYInteger 
uniontypeN  
varcharYString 

Notes: 

Write/Publish

Create new table

NOTE: By default, the maximum length of values published to VARCHAR columns is 256 characters. As needed, this limit can be changed for multiple publication targets. For more information, see Configure Application Limits.


Hive Data TypeNotes
Stringstring 
Integerbigint


NOTE: The may infer Integer columns containing very large or very small values as String data type. Before you publish, you should verify that your columns containing extreme values are interpreted as Integer type.You can import a target schema to assist in lining up your columns with the expected target. For more information, see Overview of RapidTarget.


Decimaldouble 
Boolboolean 
DatetimeTimestamp/string (see Notes on Datetime columns below)Target data type is based on the underlying data. Time zone information is retained.
Objectstring 
Arraystring 

Append to existing table

If you are publishing to a pre-existing table, the following data type conversions apply:

In any table cell, a Y indicates that the append operation for that data type mapping is supported.

NOTE: You cannot append to Hive map and array column types from of Map and Array type, even if you imported data from this source.


 StringIntegerDatetimeBoolFloatMapArrayOut of Range error
CHARYYYYYYY 
VARCHARYYYYYYY 
STRINGYYYYYYY 
INT Y     NULL
BIGINT Y     n/a
TINYINT       NULL
SMALLINT       NULL
DECIMAL Y  Y  NULL
DOUBLE Y  Y  n/a
FLOAT       NULL
TIMESTAMP  Y     
BOOLEAN   Y    

Notes on Datetime columns

Run Job

Columns in new tables created for output of Datetime columns are written with the Hive timestamp data type. These columns can be appended.

Ad-Hoc Publishing