Hive Data Type Conversions

Contents:

Expand all Collapse all

Contents:

NOTE: The Alteryx® data types listed in this page reflect the raw data type of the converted column. Depending on the contents of the column, the Transformer Page may re-infer a different data type, when a dataset using this type of source is loaded.

Access/Read

When a Hive data type is imported, its JDBC data type is remapped according to the following table.

Tip: Data precision may be lost during conversion. You may want to generate min and max values and compute significant digits for values in your Hive tables and then compute the same in the Designer Cloud application.

Source Data Type	Supported?	Alteryx Data Type	Notes
array	Y	Array
bigint	Y	Integer	NOTE: The Designer Cloud Powered by Trifacta platform may infer bigint columns containing very large or very small values as String data type.If needed, you can disable type inference for individual schematized sources. For more information, see Import Data Page.
binary	Y	String
boolean	Y	Bool
char	Y	String
date	Y	Datetime
decimal	Y	Decimal
double	Y	Decimal
float	Y	Decimal	NOTE: On import, some float columns may be interpreted as Integer data type in the Designer Cloud Powered by Trifacta platform. To fix, you can explicitly set the column's data type to Decimal in the Transformer page.
int	Y	Integer
map	Y	Object
smallint	Y	Integer
string	Y	String
struct	Y	Object
timestamp	Y	Datetime
tinyint	Y	Integer
uniontype	N
varchar	Y	String

Write/Publish

Create new table

NOTE: By default, the maximum length of values published to VARCHAR columns is 256 characters. As needed, this limit can be changed for multiple publication targets. For more information, see Configure Application Limits.

Alteryx Data Type	Hive Data Type	Notes
String	string
Integer	bigint	NOTE: The Designer Cloud Powered by Trifacta platform may infer Integer columns containing very large or very small values as String data type. Before you publish, you should verify that your columns containing extreme values are interpreted as Integer type.You can import a target schema to assist in lining up your columns with the expected target. For more information, see Overview of Target Matching.
Decimal	double
Bool	boolean
Datetime	Timestamp/string (see Notes below)	Target data type is based on the underlying data. Time zone information is retained.
Object	string
Array	string

Append to existing table

If you are publishing to a pre-existing table, the following data type conversions apply:

Columns: Alteryx data types
Rows: Target table data types

In any table cell, a Y indicates that the append operation for that data type mapping is supported.

NOTE: You cannot append to Hive map and array column types from Alteryx columns of Map and Array type, even if you imported data from this source.

	String	Integer	Datetime	Bool	Float	Map	Array	Out of Range error
CHAR	Y	Y	Y	Y	Y	Y	Y
VARCHAR	Y	Y	Y	Y	Y	Y	Y
STRING	Y	Y	Y	Y	Y	Y	Y
INT								NULL
BIGINT		Y						n/a
TINYINT								NULL
SMALLINT								NULL
DECIMAL		Y			Y			NULL
DOUBLE					Y			n/a
FLOAT								NULL
TIMESTAMP			Y
BOOLEAN				Y

Run Job

Columns in new tables created for output of Datetime columns are written with the Hive timestamp data type. These columns can be appended.
- Before Release 4.2.1 of the Designer Cloud Powered by Trifacta platform write Datetime columns as Hive string columns. Jobs that were first created in these releases and write to pre-existing tables continue to write Hive string columns.
- A single job cannot write Datetime values to one table as string type and to another table as timestamp type. This type of job should be split into multiple types. The table schemas may require modification.
  - The above issue may appear as the following error when executing the job:
    Unable to publish due to datetime data type conflict in column XXXX

Ad-Hoc Publishing

When you export pre-generated results to Hive, all new tables created for Datetime column values continue to store String data type in Hive for Release 4.2.1. These columns can be appended with new String data.
When you publish results from a job through the Export Results window to Hive, all Datetime column values are written as String type.
If you are appending to a timestamp column, the exported Datetime column must be in the following format: yyyy-MM-dd HH:mm:ss.xxxx

Send Feedback

Page tree

Hive Data Type Conversions

Access/Read

Write/Publish

Create new table

Append to existing table