| D toc |
|---|
Release 8.2.1
August 13, 2021
What's New
Databricks:
- Support for Databricks 8.3.
- For more information, see Configure for Azure Databricks.
- For more information, see Configure for AWS Databricks.
- Support for per-user access to ADLS Gen2 for running Databricks jobs. For more information, see Enable ADLS Gen2 Access.
Changes in System Behavior
None.
Key Bug Fixes
| Ticket | Description | ||||
|---|---|---|---|---|---|
| TD-62689 | Nginx returns Bad Request Status: 400 error, due to duplicate entries in
|
New Known Issues
None.
Release 8.2
June 11, 2021
What's New
Preferences:
- Re-organized user account, preferences, and storage settings to streamline the setup process. See Preferences Page.
...
Support for Nginx 1.20.0 on the
| D s node |
|---|
Changes in System Behavior
Java service classpath changes:
...
These endpoints have little value for public use.
Key Fixes
| Ticket | Description |
|---|---|
| TD-59854 | Datetime column from Parquet file incorrectly inferred to the wrong data type on import. |
| TD-59658 | IAM roles passed through SAML does not update after Hotfix upgrade |
| TD-59633 | Enabled session tag feature but running into "The security token included in the request is invalid" error |
| TD-59331 | When include quotes option is disabled on an output, Databricks still places quotes around empty values. |
| TD-59128 | BOM characters at the beginning of a file causing multiple headers to appear in Transformer Page. |
| TD-58932 | Cannot read file paths with colons from EMR Spark jobs |
| TD-58694 | Very large number of files generated during Spark job execution |
| TD-58523 | Cannot import dataset with filename in Korean alphabet from HDFS. |
New Known Issues
| Ticket | Description |
|---|---|
| TD-60701 | Most non-ASCII characters incorrectly represented in visual profile downloaded in PDF format. |
Release 8.1
February 26, 2021
What's New
| Tip | |
|---|---|
In-app messaging: Be sure to check out the new in-app messaging feature, which allows us to share new features and relevant content to |
...
- The Secure Token Service is used for managing tokens for third-party systems, such as Azure Key Vault and OAuth 2.0 authentication. See Configure Secure Token Service.
- The Connector Configuration Service manages the storage and retrieval of connection type information for the workspace. See Configure Connector Configuration Service.
Changes in System Behavior
| Info |
|---|
NOTE: CDH 6.1 is no longer supported. Please upgrade to the latest supported version. For more information, see Product Support Matrix. |
| Info |
|---|
NOTE: HDP 2.6 is no longer supported. Please upgrade to the latest supported version. For more information, see Product Support Matrix. |
...
Integrations between
| D s product |
|---|
Key Bug Fixes
| Ticket | Description | ||
|---|---|---|---|
| TD-56170 | The Test Connection button for some relational connection types does not perform a test authentication of user credentials. | ||
| TD-54440 | Header sizes at intermediate nodes for JDBC queries cannot be larger than 16K. Previously, the column names for JDBC data sources were passed as part of a header in a GET request. For very wide datasets, these GET requests often exceeded 16K in size, which represented a security risk. The solution is to turn these GET requests into ingestion jobs.
|
New Known Issues
| Ticket | Description | ||||||
|---|---|---|---|---|---|---|---|
| TD-58818 | Cannot run jobs on some builds HDP 2.6.5 and later. There is a known incompatibility between HDP 2.6.5.307-2 and later and the Hadoop bundle JARs that are shipped with the
| ||||||
| TD-58523 | Cannot import dataset with filename in Korean alphabet from HDFS.
| ||||||
| TD-55299 | Imported datasets with encodings other than UTF-8 and line delimiters other than
| ||||||
| TD-51516 | Input data containing BOM (byte order mark) characters may cause Spark or
|
Release 8.0
January 26, 2021
What's New
APIs:
- Individual workspace users can be permitted to create and use their own access tokens for use with the REST APIs. For more information, see Workspace Settings Page.
...
- You can enable the
to apply SQL filter pushdowns to your relational datasources to remove unused rows before their data is imported for a job execution. This optimization can significantly improve performance as less data is transferred during the job run. For more information, see Flow Optimization Settings Dialog.D s webapp - Optimizations that were applied during the job run now appear in the Job Details Page. See Job Details Page.
Changes in System Behavior
None.
Key Bug Fixes
| Ticket | Description |
|---|---|
| TD-57354 | Cannot import data from Azure Databricks. This issue is caused by an incompatibility between TLS v1.3 and Java 8, to which it was backported. |
| TD-57180 | AWS jobs run on Photon to publish to HYPER format fail during file conversion or writing. |
New Known Issues
| Ticket | Description | ||||
|---|---|---|---|---|---|
| TD-56170 | The Test Connection button for some relational connection types does not perform a test authentication of user credentials.
|
Release 7.10
December 21, 2020
What's New
| Tip |
|---|
Tip: Check out the new in-app tours, which walk you through the steps of wrangling your datasets into clean, actionable data. |
...
- NOTE: This feature can be changed or removed from the platform at any time without notice. Do not deploy it in a production environment.
- For more information, see API Workflow - Wrangle Output to Python.
Changes in System Behavior
Rebuild custom UDF JARs for Databricks clusters
...
For more information, see Improvements to the Type System.
Key Bug Fixes
| Ticket | Description |
|---|---|
| TD-54742 | Access to S3 is disabled after upgrade. |
| TD-53527 | When importing a dataset via API that is sourced from a BZIP file stored on S3, the columns may not be properly split when the platform is permitted to detect the structure. |
New Known Issues
| Ticket | Description | ||
|---|---|---|---|
| TD-57180 | AWS jobs run on Photon to publish to HYPER format fail during file conversion or writing.
| ||
| TD-56830 | Receive
|
Release 7.9
November 16, 2020
What's New
Plan View:
- Execute Plan using status rules: Starting in Release 7.9, you can execute tasks based on the previous task execution result. For more information, see Create a Plan.
- Execute Parallel Plan tasks: In previous releases, plans were limited to a sequential order of task execution. Beginning in Release 7.9, you can create branches in the graph into separate parallel nodes, enabling the corresponding tasks to run in parallel. This feature enables you to have a greater level of control of your plans' workflows. For more information, see Create a Plan.
- Zoom options: Zoom control options and keyboard shortcuts have been introduced in the plan canvas. For more information, see Plan View Page.
- Filter Plan Runs: Filter your plan runs based on dates or plan types. For more information, see Plan Runs Page.
...
- An All option has been added for selecting columns in the Transform Builder. For more information, see Changes to the Language page.
Changes in System Behavior
Manage Users section has been deprecated:
...
- The dependencies tab is renamed as dependency graph tab.
- The old flow view in the dependency graph tab is replaced with the new flow view. For more information, see Job Details Page.
Key Bug Fixes
| Ticket | Description |
|---|---|
| TD-55125 | Cannot copy flow. However, export and import of the flow enables copying. |
| TD-53475 | Missing associated artifact error when importing a flow. |
New Known Issues
None.
Release 7.8
October 19, 2020
What's New
Plans:
Create HTTP tasks for your plans, which can be configured to issue a request to an API endpoint over HTTP.
- For more information, see Plan View for HTTP Tasks.
- For more information on plans, see Overview of Operationalization.
...
IAM support for Redshift connections.
Info NOTE: To enable use of an existing IAM role for Redshift, additional permissions must be added. For more information, see Required AWS Account Permissions.
For more information, see Create Redshift Connections.
Changes in System Behavior
JDBC connection pooling disabled:
...
- For more information, see Flows Page.
- For more information, see Flow View Page.
Key Bug Fixes
None.
New Known Issues
| Ticket | Description | ||
|---|---|---|---|
| TD-54030 | When creating custom datasets from Snowflake, columns containing time zone data are rendered as null values in visual profiles, and publishing back to Snowflake fails.
|
Release 7.7
September 21. 2020
What's New
Flow View:
- Automatically organize the nodes of your flow with a single click. See Flow View Page.
Changes in System Behavior
Deprecated Parameter History Panel Feature
...
For more information, see Flow View Page.
Key Bug Fixes
| Ticket | Description |
|---|---|
| TD-53318 | Cannot publish results to relational targets when flow name or output filename or table name contains a hyphen (e.g. my - filename.csv). |
New Known Issues
None.
