Page tree

Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Published by Scroll Versions from space DEV and version next

...

For the latest release notes, see Release Notes for Trifacta.

...

June 28, 2021

Release 8.15

What's New

Storage environmentParameterization:

  • Support for use of 

    D s tfs
     and S3 as storage environments at the same time. For more information, see Configure Storage Environment.

    Info

    NOTE: When new workspaces are created,

    D s tfs
    is set as the default storage environment. S3 can be added as another storage environment or set as the default storage environment as sign-up is complete. For more information, see Getting Started with Trifacta.

Connectivity:

  • Introducing Early Preview connections. In each release of cloud-based product editions, new connection types may be made available in read-only mode for users to begin exploring their datasets stored in the connected datastores.

    Info

    NOTE: Early Preview connection types are read-only and are subject to change before they may be made generally available.

    D s ed
    editionsawspr

  • Early Preview connections available with this release:

API:

Customize connection types (connectors) to ensure consistency across all connections of the same type and to meet your enterprise requirements. For more information, see Changes to the APIs.

Job results:

Results of data quality checks are now part of the visual profile PDF available with your job results. In the PDF, you can download the data quality results over the entire dataset .

  • Visual profiling must be enabled for the job.
  • For more information, see Job Details Page.

Specify column headers during import

You can specify the column headers for your dataset during import. For more information, see Import Data Page.

Changes in System Behavior

None.

Key Bug Fixes

...

Header sizes at intermediate nodes for JDBC queries cannot be larger than 16K.

Previously, the column names for JDBC data sources were passed as part of a header in a GET request. For very wide datasets, these GET requests often exceeded 16K in size, which represented a security risk.

New Known Issues

None.

March 9, 2021

Release 8.1, push 2

What's New

Macro updates:

You can replace an existing macro definition with a macro that you have exported to your local desktop.

Info

NOTE: Before you replace the existing macro, you must export a macro to your local desktop. For more information, see Export Macro.

For more information, see Macros Page.

Early Preview connections available with this release:

Changes in System Behavior

None.

Key Fixes

None.

New Known Issues

None.

January 26, 2021

Release 8.0

What's New

Connectivity:

  • Support for connections to SharePoint Lists. See SharePoint Connections.
  • Support for using OAuth2 authentication for Salesforce connections. See Salesforce Connections.

  • Support for re-authenticating through connections that were first authenticated using OAuth2.

Import:

  • Improved method for conversion and ingestion of XLS/XSLX files. For more information, see Import Excel Data.

Recipe development:

  • The Flag for Review feature enables you to set review checkpoints in your recipes. You can flag recipe steps for review by other collaborators for review and approval. For more information, see Flag for Review.

Metric-based data quality rules:

Update Macros:

  • Replace / overwrite an existing macro's steps and inputs with a newly created macro.
  • Map new macro parameters to the existing parameters before replacing.
  • Edit macro input names and default values as needed. 

Job execution:

  • You can enable the 
    D s webapp
     to apply SQL filter pushdowns to your relational datasources to remove unused rows before their data is imported for a job execution. This optimization can significantly improve performance as less data is transferred during the job run. For more information, see Flow Optimization Settings Dialog.
  • Optimizations that were applied during the job run now appear in the Job Details Page. See Job Details Page.

APIs:

  • Individual workspace users can be permitted to create and use their own access tokens for use with the REST APIs. For more information, see Workspace Settings Page.

Changes in System Behavior

None.

Key Bug Fixes

...

AWS jobs run on Photon to publish to HYPER format fail during file conversion or writing.

New Known Issues

...

The Test Connection button for some relational connection types does not perform a test authentication of user credentials.

Tip

Workaround: Append the following to your Connect String Options:

Code Block
;ConnectOnOpen=true

This option forces the connection to validate user credentials as part of the connection. There may be a performance penalty when this option is used.

December 21, 2020

Release 7.10

What's New

Tip

Tip: Check out the new in-app tours, which walk you through the steps of wrangling your datasets into clean, actionable data.

Import:

  • The maximum permitted size of a file uploaded through 
    D s webapp
     has been increased from 100 MB to 1 GB.

Plan View:

  • Import and Export Plans: You can import and export plans from one environment, workspace, or projects to others.

For more information, see Export Plan.

For more information, see Import Plan.

  • Share Plans: Share plans with one or more users to work together on the same plan. For more information, see Share a Plan.
  • Email notifications: Send email notifications to plan owners and collaborators based on the status of execution of plans. For more information, see Manage Plan Notifications Dialog.

Photon:

Introducing 

D s photon
, an in-memory running environment for running jobs. Embedded in the 
D s product
D s photon
 is fast and best-suited for small- to medium-sized jobs.

  • When you choose to run a job, you can now choose to run a job on 
    D s photon
    .
  • D s product
     specifies the most appropriate running environment as the default selection based on the size of your job.
  • For more information, see Run Job Page.

Sampling:

  • D s photon
     also enables quick scan sampling. A quick scan sample generates an appropriate selection of rows from the dataset from which to perform the sample. These samples are faster to generate. For more information, see Overview of Sampling.
  • For more information on generating samples, see Samples Panel.

Sharing:

  • Define permissions on individual objects when they are shared.

    Info

    NOTE: Fine-grained sharing permissions apply to flows and connections only.

    For more information, see Changes to User Management.

Authentication:

Connectivity:

  • Improved Salesforce connection type.

    D s ed
    editionsawspr
    oneLinetrue

    For more information, see Salesforce Connections.

API:

API:

  • Experimental feature: Export Python Pandas code to generate the transformation steps required to produce a defined output object.
  • D s ed
    editionsawspr,awsst
    oneLinetrue
  • NOTE: This feature can be changed or removed from the platform at any time without notice. Do not deploy it in a production environment.
  • For more information, see API Workflow - Wrangle Output to Python.

Changes in System Behavior

New public bucket for product assets

In prior releases, the product referenced the following S3 bucket, which contained demo assets:

Code Block
trifacta-public-datasets

Beginning in this release, please enable access through your IAM role to the following buckets:

Code Block
trifacta-public-datasets
3fac-data-public
aws-saas-datasets
Info

NOTE: These buckets are available for read access on the public Internet. However, if you are using IAM roles to enable access to AWS resources, you may need to review your policies to change the reference to the new bucket. If the bucket is not updated in the policy, users who are assigned the IAM role may not be able to access these product assets.

For more information, see Getting Started with Trifacta.

Key Bug Fixes

...

New Known Issues

...

AWS jobs run on Photon to publish to HYPER format fail during file conversion or writing.

Tip

Workaround: Run the job on the Spark running environment instead.

...

Receive malformed_query: enter a filter criterion when importing table from Salesforce.

D s ed
editionsawspr

Info

NOTE: Some Salesforce tables require mandatory filters when they are queried. Mandatory filters are not currently supported for Salesforce connections.

November 18, 2020

Release 7.9

What's New

Introducing 

D s tfs
:

D s ed
editionsawspr,awsst
oneLinetrue

D s tfs
typeformal
 is an S3-backed storage service provided by 
D s company
, which can be enabled for new workspaces. 
D s tfs
 manages the data storage for imported datasets, samples, metadata, and generated results for the product.

Info

NOTE:

D s tfs
is available only for new workspaces at this time. After choosing to use
D s tfs
, you cannot choose to switch to using your own S3 bucket.

To check out

D s tfs
, you can register for a new workspace. For more information, see Getting Started with Trifacta.

Plan View:

D s ed
editionsawspr
oneLinetrue
  • Execute Plan using status rules: Starting in Release 7.9, you can execute tasks based on the previous task execution result. For more information, see Create a Plan.
  • Execute Parallel Plan tasks: In previous releases, plans were limited to a sequential order of task execution. Beginning in Release 7.9, you can create branches in the graph into separate parallel nodes, enabling the corresponding tasks to run in parallel. This feature enables you to have a greater level of control of your plans' workflows. For more information, see Create a Plan.
  • Zoom options: Zoom control options and keyboard shortcuts have been introduced in the plan canvas. For more information, see Plan View Page.
  • Filter Plan Runs: Filter your plan runs based on dates or plan types. For more information, see Plan Runs Page

Transform Builder:

  • An All option has been added for selecting columns in the Transform Builder.  For more information, see Changes to the Language.

Changes in System Behavior

Flow optimizations re-enabled:

For 

D s product
, flow execution optimizations were disabled in an earlier release due to to technical issues. These optimizations are designed to improve query performance during job and sampling execution. 

Beginning in this release, flow optimizations are re-enabled for new flows. When you create a new flow now, flow optimizations are automatically enabled for it.

  • By default, flow optimizations are enabled for the entire workspace. They can be disabled if necessary. See Workspace Settings Page.
  • For flows created in a previous release, flow optimizations are disabled by default. You can choose to enable optimizations for an individual flow through Flow View page.

    Info

    NOTE: If a flow execution fails multiple consecutive times, flow optimizations are automatically skipped. If job execution then succeeds, optimizations are automatically disabled for the flow.

    For more information, see Flow Optimization Settings Dialog.

Better license management:

In prior releases, the 

D s webapp
 locked out all users if the number of active users exceeded the number permitted by the license. This situation could occur if users were being added via API, for example. 

Beginning in this release, the 

D s webapp
 does not block access when the number of licensed users is exceeded. 

Info

NOTE: If you see the notification banner about license key violations, please adjust your users until the banner is removed. If you need to adjust the number of users associated with your license key, please contact

D s support
.

Key Bug Fixes

...

New Known Issues

None.

October 19, 2020

Release 7.8

What's New

Plans:

Flow View:

  • Get started adding and building objects in your flows with new object placeholders. See Flow View Page.
  • The viewport position and zoom level are now preserved when returning to a given flow.

Publishing:

  • Improved performance when publishing to Tableau Server.

Language:

  • Rename columns now supports  uppercase or lowercase characters or shorten column names to a specified character length from the left or right. For more information, see Changes to the Language.

Data quality rules:

Improvements to suggestions for data quality rules:

  • Existing Data quality rules panel is updated with View suggestions button.
  • Data quality rules are now categorized by suggestions for individual columns.
  • Some rule types support the May be missing checkbox. When it is selected, the data quality rule allows missing values to be acceptable for a specified column. For more information on data quality rules, see Data Quality Rules Panel.

Connectivity:

Changes in System Behavior

Enhanced  Flow and Flow View menu options :

The context menu options for Flow View and Flow have been renamed and reorganized for a better user experience.

Salesforce connector disabled temporarily:

In this release, the Salesforce connector has been disabled temporarily. In a future release, it will be replaced with an improved version of the Salesforce connector.

D s ed
editionsawspr
oneLinetrue

Key Bug Fixes

None.

New Known Issues

...

When creating custom datasets from Snowflake, columns containing time zone data are rendered as null values in visual profiles, and publishing back to Snowflake fails.

Tip

Workaround: In your SELECT statement applied to a Snowflake database, references to time zone-based data must be wrapped in a function to convert it to UTC time zone. For more information, see Create Dataset with SQL.

October 2, 2020

Release 7.7

What's New

None.

Changes in System Behavior

Disabled Optimizer Service

In the September release, the Optimizer service was introduced, which enabled users to apply advanced physical and logical optimizations for flow and job executions. Recently, an issue was discovered, which has caused us to disable the service temporarily.

  • This issue affected a very small number of users who were using the new feature. Now that the feature is disabled, impacted users should experience impacts only to performance of flow and job executions. Performance should be similar to pre-release of the service.
  • The Optimizer service was disabled through a configuration change that did not require any service interruptions. Users should not experience any loss of functionality or availability due to the work to resolve this issue.
  • The 
    D s item
    itemEngineering team
     is actively working to resolve the issue. Thank you for patience. If you have further questions, please contact 
    D s support
    .

Key Bug Fixes

None.

New Known Issues

None.

September 21, 2020

Release 7.7

What's New

Manage workspace users:

Workspace administrators can:

Flow View:

  • Automatically organize the nodes of your flow with a single click. See Flow View Page.

Changes in System Behavior

Deprecated Parameter History Panel Feature 

As a part of collaborative suggestions enhancement, the support for Parameter History panel is deprecated from the software. For more information on collaborative suggestions feature, see Overview of Predictive Transformation.

Classic Flow View no longer available

In Release 7.6, an improved version of Flow View was released. At the time of release, users could switch back to using the classic version. 

Beginning in this release, the classic version of Flow View is no longer available. 

Tip

Tip: The objects in your flows that were created in classic Flow View may be misaligned in the new version of Flow View. You can use auto-arrange to re-align your flow objects.

For more information, see Flow View Page.

Key Bug Fixes

...

Cannot publish results to relational targets when flow name or output filename or table name contains a hyphen (e.g. my - filename.csv).

New Known Issues

None.

August 19, 2020

Release 7.6

What's New

Introducing 

D s product
productawspr
 and 
D s product
productawsst
:

  • These product editions remove the limitations on  Trifacta Free and deliver enhanced capabilities in connectivity, operationalization, and API access.
  • Product documentation for all three editions can be found in this same location with distinctions noted as needed. 
  • For more information, see  Product Editions .

Plan View:

  • Apply overrides to recipe parameters for your plans. See Plan View Page.

    D s ed
    editionsawspr
  • Download logs for plan runs and individual flow tasks in the run. See Plan Runs Page.

Flow View:

Data quality rules:

  • You can select data quality rules from a set of suggestions presented to you. 
  • D s ed
    editionsawspr
    oneLinetrue

Job Execution:

  • Support for job cancellation. See Jobs Page.

Documentation:

  • Additional connect string options and troubleshooting information has been included for specific relational connections.
  • D s ed
    editionsawspr,awsst
    oneLinetrue
  • For more information, see Connection Types.

Changes in System Behavior

IP addresses to whitelist have changed:

Please verify that the following range of IP addresses have been whitelisted for the 

D s item
itemservice
 for access to relational datasources in your enterprise:

Code Block
35.199.3.51/32
35.245.35.240/28

For more information, see Getting Started with Trifacta.

Key Fixes

...

Cannot publish results to relational targets when flow name or output filename or table name contains a hyphen (e.g. my - filename.csv).

D s ed
editionsawspr
Tip

Workaround: Remove the hyphen from the flow name or output target and re-publish the results.

July 20, 2020

Release 7.5

What's New

New Flow View is now generally available:

  • Drag and drop to reposition objects on the Flow View canvas, and zoom in and out to focus on areas of development.
  • Perform joins and unions between objects on the Flow View canvas. 
  • Search for flow objects by name or by type.
  • Annotate the canvas with notes.

    Tip

    Tip: The relative position of objects on the flow view canvas is preserved between screen updates. On refresh, the window on the canvas is repositioned based on the leftmost object on the canvas to focus on the flow to other objects from that one.

    Info

    NOTE: Classic Flow View is no longer available.

    See Flow View Page.

Import:

  • For long-loading relational datasets, you can monitor the ingest process through Flow View as you continue your work.

    For more information, see Flow View Page.

  • Improved performance when browsing databases for tables to import.

    Tip

    Tip: Performance improvements are due to limiting the volume of table metadata that is imported when paging through available tables. This metadata can be retrieved when you hover over a table in the database browser.

    For more information, see Database Browser.

  • Logical and physical optimizations when reading from relational sources during job execution, which includes column pruning push-down among other enhancements. 

    Info

    NOTE: This feature may need to be enabled in your workspace. See Workspace Settings Page.

    This feature applies to the following relational connections in this release:

Transformer Page:

  • Collaborative suggestions allow users within a workspace to receive suggestions based on the transformations that have been recently created by themselves or by all members of the workspace. As more users generate transformations, the relevance of these suggestions to the data in the workspace continues to improve.

  • Create and edit flow parameters and their overrides while editing your recipe. See Transformer Page.

Plans:

D s ed
editionsawspr
oneLinetrue
  • Monitor status of all of your plan runs and drill into details. See Plan Runs Page.

...

  • Workspace administrators can now create and assign roles to govern access to types of objects in the workspace. For more information, see Changes to User Management

Language:

Changes in System Behavior

Schema information is retained:

  • When schematized datasources are ingested, schema information is now retained for publication of job results.

    Info

    NOTE: In prior releases, you may have set column data types manually because this schema information was lost during the ingest process. You may need to remove these manual steps from your recipe. For more information, see Improvements to the Type System.

Enhanced PII masking:

  • For social security numbers and credit card numbers, the methods by which these values are determined for purposes of masking sensitive Personally Identifiable Information (PII) has been expanded and improved. For more information, see Improvements to the Type System.

IP addresses to whitelist have changed:

Please verify that the following range of IP addresses have been whitelisted for the 

D s item
itemservice
 for access to relational datasources in your enterprise:

Code Block
35.199.3.51/32
35.245.35.240/28

For more information, see Getting Started with Trifacta.

Key Fixes

None.

New Known Issues

...

If a flow is unshared with you, you cannot see or access the datasources for any jobs that you have already run on the flow. You can still access the job results.

June 22, 2020

Release 7.4

What's New

Language:

Changes in System Behavior

Info

NOTE: Beginning in this release, the set of IP addresses for the

D s item
itemService
has been changed. If you have connected to any relational sources from the product, please update all of your database services to which
D s product
connects to whitelist the new IP addresses.

Code Block
34.86.43.62/32
35.230.178.129/32
35.245.163.90/32
34.86.140.202/32

For more information, see Getting Started with Trifacta.

API:

  • Redshift connections now require a different credential type.
  • Snowflake connections now require a different credential type.
  • See Changes to the APIs.

Key Bug Fixes

None.

New Known Issues

None.

June 4, 2020

Release 7.3

This is the initial release of 

D s product
productawsst
rtrue
.

Info

NOTE: In this initial release, only the free tier of Trifacta Standard (known as Trifacta Free) is available. Some restrictions apply. See Product Limitations.

...

D s support
  • Create environment parameters to ensure that all users of the project or workspace use consistent references.

    Info

    NOTE: You must be a workspace administrator or project owner to create environment parameters.

    Info

    Tip: Environment parameters can be exported from one project or workspace and imported into another, so that these references are consistent across the enterprise.

  • Parameterize names of your storage buckets using environment parameters.

Flow View:

Job execution:

  • Define SQL scripts to execute before data ingestion or after publication for file-based or table-based jobs.

Connectivity:

Tip

Contribute to the future direction of connectivity: Click I'm interested on a connection card to upvote adding the connection type to the

D s webapp
. See Create Connection Window.

  • Early Preview (read-only) connections available with this release:

    D s ed
    editionsawsent,awspro,awspr

  • D s conntype
    typeapache_impala

Connectivity:

  • Connect to your relational database systems hosted on Amazon RDS. In the Connections page, click the Amazon RDS card for your connection type.
    D s ed
    rtrue
    editionsawsent,awspro,awspr

    For more information, see Create Connection Window.

Connectivity:

  • Read-only support for 
    D s conntype
    typeTeradata
     connections. For more information, see Teradata Connections.

Developer:

D s ed
editionsawsent,awspro,awspr

Download and install the Python SDK, which enables you to leverage the visual tools of the 

D s webapp
 to transform data in your existing Python pipelines.

Info

NOTE: This is an Alpha release. Do not deploy the Python SDK in production environments.

For more information, see Python SDK.

Job execution:

You can choose to ignore the recipe errors before job execution and then review any errors in the recipe through the Job Details page.

Resource usage:

  • Review the total vCPU hours consumed by your datasets, recipes, and job execution within your workspace across an arbitrary time period. 

Language:

  • NUMVALUE function can be used to convert a String value formatted as a number into an Integer or Decimal value.
  • NUMFORMAT function now supports configurable grouping and decimal separators for localizing numeric values.
  • For more information, see Changes to the Language.

Changes in System Behavior

None.

Key Bug Fixes

None.

New Known Issues

None.

June 7, 2021

Release 8.4 push 2

What's New

Template Gallery:

  • Check out the new gallery of flow templates, which can be imported into your workspace. These templates are pre-configured to solve the most compelling loading and transformation use cases in the product. For more information, see www.trifacta.com/templates.
    • For more information on importing flows into your workspace, see Import Flow.

Connectivity:

  • Early Preview (read-only) connections available with this release:

    D s ed
    editionsawsent,awspro,awspr

    • YouTube Analytics

Changes in System Behavior

None.

Key Bug Fixes

None.

New Known Issues

None.

May 24, 2021

Release 8.4

What's New

Self-serve upgrades from your free trial: Through the Admin console, you can review and select the paid plan that works for you. Submit payment details through the application and begin using your upgrade workspace immediately.

D s ed
editionsawspro,awssta

Connectivity:

  • Early Preview (read-only) connections available with this release:

    D s ed
    editionsawsent,awspro,awspr

Connectivity:

Collaboration:

  • You can receive email notifications whenever a plan or a flow is shared with you by the owner.

Language:

Changes in System Behavior

None.

Key Bug Fixes

TicketDescription
TD-60881Incorrect file path and missing file extension in the application for parameterized outputs
TD-60382

Date format M/d/yy is handled differently by PARSEDATE function on

D s photon
and Spark.

New Known Issues

None.

May 5, 2021

Release 8.3 - push 2

What's New

None.

Changes in System Behavior

Improved method of JSON import

The 

D s webapp
 now uses the conversion service to ingest JSON files during import. This improved method of ingestion can save significant time wrangling JSON into records.

Info

NOTE: The new method of JSON import is now enabled by default. It can be disabled as needed. Additional information is below.

For more information, see Working with JSON v2.

Key Bug Fixes

None.

New Known Issues

None.

April 26, 2021

Release 8.3

What's New

Tip

Single login for multiple workspaces: Login through https://cloud.trifacta.com and then choose the workspace to which to connect. If you are a member of multiple workspaces, you can switch between workspaces through the User menu. For more information, see Home Page.

Connectivity:

  • Early Preview (read-only) connections available with this release:

    D s ed
    editionsawsent,awspro,awspr

  • Authorize.net
  • Cockroach DB
  • DB2
  • Magento
  • Redis
  • Shopify
  • Smartsheet
  • Trello
  • QuickBase

Connectivity:

D s ed
editionsawsent,awspro,awspr

You can publish results to external S3 buckets through an Access key and Secret key. For more information, see External S3 Connections

Job execution:

Introducing new filter pushdowns to optimize the performance of your flows during job execution. For more information, see Flow Optimization Settings Dialog.

Job results:

You can now preview job results and download them from the Overview tab of the Job details page. For more information, see Job Details Page.

Tip

Tip: You can also preview job results in Flow View. See View for Outputs.

Changes in System Behavior

Improved method of JSON import

Beginning in this release, the 

D s webapp
 now uses the conversion service to ingest JSON files during import. This improved method of ingestion can save significant time wrangling JSON into records.

Info

NOTE: The new method of JSON import is disabled by default but can be enabled as needed.

For more information, see Working with JSON v2.

Flows that use imported datasets created using the old method continue to work without modification.

Info

NOTE: It is likely that support for the v1 version of JSON import is deprecated in a future release. You should switch to using the new version as soon as possible. For more information on migrating your flows and datasets to use the new version, see Working with JSON v1.

Future work on support for JSON is targeted for the v2 version only.

For more information on using the old version and migrating to the new version, see Working with JSON v1.

API

The following API endpoints are scheduled for deprecation in a future release:

Info

NOTE: Please avoid using the following endpoints.

Code Block
/v4/connections/vendors
/v4/connections/credentialTypes
/v4/connections/:id/publish/info
/v4/connections/:id/import/info

These endpoints have little value for public use.

Key Bug Fixes

TicketDescription
TD-60701Most non-ASCII characters incorrectly represented in visual profile downloaded in PDF format
TD-59854Datetime column from Parquet file incorrectly inferred to the wrong data type on import.

New Known Issues

None.

March 31, 2021

Release 8.2 - push 2

What's New

This is the initial release of the following product editions:

  • D s product
    productawsent
  • D s product
    productawspro
  • D s product
    productawssta
Tip

Upgrade: Trial customers can upgrade through the Admin console. See Admin Console.

Changes in System Behavior

None.

Key Fixes

None.

New Known Issues

None.

March 22, 2021

Release 8.2

What's New

Preferences:

  • Re-organized user account, preferences, and storage settings to streamline the setup process. See Preferences Page.

API:

  • You can now transfer ownership of assets created in 
    D s product
     between users, based on their user identifiers or email addresses. For more information, see Changes to the APIs.

Connectivity:

  • Early Preview (read-only) connections available with this release:

    D s ed
    editionsawsent,awspro,awspr

  • Amazon Athena
  • Amazon DynamoDB
  • Greenplum
  • HubSpot
  • MariaDB
  • Microsoft Dynamics 365 Sales
  • ServiceNow
  • Smartsheet
  • For more information, see Early Preview Connection Types.

Plan metadata references:

D s ed
editionsawsent,awspro,awspr

Use metadata values from other tasks and from the plan itself in your HTTP task definitions.

Spark Execution Properties Settings:

Advanced Spark parameters have been newly added to the Spark running environment. Use these parameters to override the global Spark settings for individual jobs. For more information, see Spark Execution Properties Settings.

Improve Accessibility of Job Results:

The Jobs tabs have been enhanced to display the list of latest and the previous jobs that have been executed for the selected output.

For more information, see View for Outputs.

Sample Jobs Page:

You can monitor the status of all sample jobs that you have generated. Project administrators can access all sample jobs in the workspace. For more information, see Sample Jobs Page.

Changes in System Behavior

None.

Key Fixes

TicketDescription
TD-59236Use of percent sign (%) in file names causes Transformer page to crash during preview.
TD-59218BOM characters at the beginning of a file causing multiple headers to appear in Transformer Page.
TD-58932Cannot read file paths with colons from EMR Spark jobs
TD-58802Running job on Photon using zipped CSV that was uploaded yields garbage characters in output.
TD-58694Very large number of files generated during Spark job execution

New Known Issues

TicketDescription
TD-60701Most non-ASCII characters incorrectly represented in visual profile downloaded in PDF format.

February 26, 2021

Release 8.1

What's New

Storage environment:

  • Support for use of 

    D s tfs
     and S3 as storage environments at the same time. For more information, see Configure Storage Environment.

    Info

    NOTE: When new workspaces are created,

    D s tfs
    is set as the default storage environment. S3 can be added as another storage environment or set as the default storage environment as sign-up is complete. For more information, see Getting Started with Trifacta.

Connectivity:

  • Introducing Early Preview connections. In each release of cloud-based product editions, new connection types may be made available in read-only mode for users to begin exploring their datasets stored in the connected datastores.

    Info

    NOTE: Early Preview connection types are read-only and are subject to change before they may be made generally available.

    D s ed
    editionsawspr

  • Early Preview connections available with this release:


API:


Customize connection types (connectors) to ensure consistency across all connections of the same type and to meet your enterprise requirements. For more information, see Changes to the APIs.

Job results:

Results of data quality checks are now part of the visual profile PDF available with your job results. In the PDF, you can download the data quality results over the entire dataset .

  • Visual profiling must be enabled for the job.
  • For more information, see Job Details Page.

Specify column headers during import

You can specify the column headers for your dataset during import. For more information, see Import Data Page.

Changes in System Behavior

None.

Key Bug Fixes

TicketDescription
TD-56170The Test Connection button for some relational connection types does not perform a test authentication of user credentials.
TD-54440

Header sizes at intermediate nodes for JDBC queries cannot be larger than 16K.

Previously, the column names for JDBC data sources were passed as part of a header in a GET request. For very wide datasets, these GET requests often exceeded 16K in size, which represented a security risk.

New Known Issues

None.

March 9, 2021

Release 8.1, push 2

What's New

Macro updates:

You can replace an existing macro definition with a macro that you have exported to your local desktop.

Info

NOTE: Before you replace the existing macro, you must export a macro to your local desktop. For more information, see Export Macro.

For more information, see Macros Page.

Early Preview connections available with this release:

Changes in System Behavior

None.

Key Fixes

None.

New Known Issues

None.

...

January 26, 2021

Release 8.0

What's New

Connectivity:

  • Support for connections to SharePoint Lists. See SharePoint Connections.
  • Support for using OAuth2 authentication for Salesforce connections. See Salesforce Connections.

  • Support for re-authenticating through connections that were first authenticated using OAuth2.

Import:

  • Improved method for conversion and ingestion of XLS/XSLX files. For more information, see Import Excel Data.

Recipe development:

  • The Flag for Review feature enables you to set review checkpoints in your recipes. You can flag recipe steps for review by other collaborators for review and approval. For more information, see Flag for Review.

Metric-based data quality rules:

Update Macros:

  • Replace / overwrite an existing macro's steps and inputs with a newly created macro.
  • Map new macro parameters to the existing parameters before replacing.
  • Edit macro input names and default values as needed. 

Job execution:

  • You can enable the 
    D s webapp
     to apply SQL filter pushdowns to your relational datasources to remove unused rows before their data is imported for a job execution. This optimization can significantly improve performance as less data is transferred during the job run. For more information, see Flow Optimization Settings Dialog.
  • Optimizations that were applied during the job run now appear in the Job Details Page. See Job Details Page.

APIs:

  • Individual workspace users can be permitted to create and use their own access tokens for use with the REST APIs. For more information, see Workspace Settings Page.

Changes in System Behavior

None.

Key Bug Fixes

TicketDescription
TD-57180

AWS jobs run on Photon to publish to HYPER format fail during file conversion or writing.

New Known Issues

TicketDescription
TD-56170

The Test Connection button for some relational connection types does not perform a test authentication of user credentials.

Tip

Workaround: Append the following to your Connect String Options:

Code Block
;ConnectOnOpen=true

This option forces the connection to validate user credentials as part of the connection. There may be a performance penalty when this option is used.