This section covers key known limitations of

General Limitations

Sampling

• Sample sizes are 10 MB.

• All values displayed or generated in the application are based on the currently displayed sample. 
  • Transforms that generate new data may not factor values that are not present in the current sample.
  • When the job is executed, transforms are applied across all rows and values in the source data.
  • Transforms that make changes based on data values, such as header and valuestocols, will still be configured according to sample data at the time of that the step was added, instead at execution time. For example, all of the values detected in the sample are used to determine the columns of a valuestocols transform step based on the selected sample when the step was added.
• Random samples are derived from up to the first 1 GB of the source file. 
  • Data from later parts of a multi-part file may not be included in the sample.

Internationalization

• The product supports a variety of global file encoding types for import. 

• Within the application, UTF-8 encodings are displayed. 
  • Limited set of characters allowed in column names.
  • Header does not support all UTF-8 characters.
  • Emoji are not supported in data wrangling operations.
  • Umlauts and other international characters are not supported when filtering datasets in browsers of external datastores.
• States and Zip Code Column Types and the corresponding maps in visual profiling apply only to the United States.
• UTF-8 is generated in output.
• UTF-32 encoding is not supported

Size Limits

File Size Limits

• Maximum upload size for a file is 100MB.

Limitations for

D s product
product gdp

• Sort transform is not supported.
• User-defined functions are not supported.
• Custom dictionaries and custom data types are not supported.
• Integrations with datastores other than BigQuery,

  D s storage

  , and the local filesystem are not supported.
• User access to administrator functions is not supported.
• Sharing is not supported.

Limitations for

D s product
product gdpst

• Sort transform is not supported.
• User-defined functions are not supported.
• Custom dictionaries and custom data types are not supported.
• User access to administrator functions is not supported.

Limitations for

D s product
product gdppr

• Sort transform is not supported.
• User-defined functions are not supported.
• Custom dictionaries and custom data types are not supported.
• User access to administrator functions is not supported.
• Except for BigQuery, global connections available to all users is not supported.

Other Limitations

• File Formats: Limitations may apply to individual file formats. See Supported File Formats.
• Data Type Conversions: There are some limitations on how data types are converted during import or export/publication. See Type Conversions in the User Guide.