Contents:
Release 7.10
December 21, 2020
What's New
Tip: Check out the new in-app tours, which walk you through the steps of wrangling your datasets into clean, actionable data.
Import:
- The maximum permitted size of a file uploaded through Trifacta application has been increased from 100 MB to 1 GB.
Plan View:
- Import and Export Plans: You can import and export plans from one environment, workspace, or projects to others.
For more information, see Export Plan.
For more information, see Import Plan.
- Share Plans: Share plans with one or more users to work together on the same plan. For more information, see Share a Plan.
- Email notifications: Send email notifications to plan owners and collaborators based on the status of execution of plans. For more information, see Manage Plan Notifications Dialog.
Photon:
Introducing Trifacta Photon, an in-memory running environment for running jobs. Embedded in the Trifacta Wrangler Pro, Trifacta Photon is fast and best-suited for small- to medium-sized jobs.
- When you choose to run a job, you can now choose to run a job on Trifacta Photon.
- Trifacta Wrangler Pro specifies the most appropriate running environment as the default selection based on the size of your job.
- For more information, see Run Job Page.
Sampling:
- Trifacta Photon also enables quick scan sampling. A quick scan sample generates an appropriate selection of rows from the dataset from which to perform the sample. These samples are faster to generate. For more information, see Overview of Sampling.
- For more information on generating samples, see Samples Panel.
Sharing:
Define permissions on individual objects when they are shared.
NOTE: Fine-grained sharing permissions apply to flows and connections only.
For more information, see Changes to User Management.
Authentication:
- Support for authentication to third-party datastores using OAuth2. For more information, see Enable OAuth2 Authentication.
- Support for using OAuth2 for Snowflake connections. For more information, see OAuth2 for Snowflake.
Connectivity:
Improved Salesforce connection type.
For more information, see Create Salesforce Connections.
API:
- Experimental feature: Export Python Pandas code to generate the transformation steps required to produce a defined output object.
- NOTE: This feature can be changed or removed from the platform at any time without notice. Do not deploy it in a production environment.
- For more information, see API Workflow - Wrangle Output to Python.
Changes in System Behavior
New public bucket for product assets
In prior releases, the product referenced the following S3 bucket, which contained demo assets:
trifacta-public-datasets
Beginning in this release, please enable access through your IAM role to the following buckets:
trifacta-public-datasets 3fac-data-public aws-saas-datasets
NOTE: These buckets are available for read access on the public Internet. However, if you are using IAM roles to enable access to AWS resources, you may need to review your policies to change the reference to the new bucket. If the bucket is not updated in the policy, users who are assigned the IAM role may not be able to access these product assets.
For more information, see Getting Started with Trifacta Wrangler Pro.
Key Bug Fixes
Ticket | Description |
---|---|
TD-54742 | Access to S3 is disabled after upgrade. |
TD-53527 | When importing a dataset via API that is sourced from a BZIP file stored on S3, the columns may not be properly split when the platform is permitted to detect the structure. |
New Known Issues
Ticket | Description |
---|---|
TD-57180 | AWS jobs run on Photon to publish to HYPER format fail during file conversion or writing. Workaround: Run the job on the Spark running environment instead. |
TD-56830 | Receive NOTE: Some Salesforce tables require mandatory filters when they are queried. Mandatory filters are not currently supported for Salesforce connections. |
November 18, 2020
Release 7.9
What's New
Plan View:
- Execute Plan using status rules: Starting in Release 7.9, you can execute tasks based on the previous task execution result. For more information, see Create a Plan.
- Execute Parallel Plan tasks: In previous releases, plans were limited to a sequential order of task execution. Beginning in Release 7.9, you can create branches in the graph into separate parallel nodes, enabling the corresponding tasks to run in parallel. This feature enables you to have a greater level of control of your plans' workflows. For more information, see Create a Plan.
- Zoom options: Zoom control options and keyboard shortcuts have been introduced in the plan canvas. For more information, see Plan View Page.
- Filter Plan Runs: Filter your plan runs based on dates or plan types. For more information, see Plan Runs Page.
Transform Builder:
- An All option has been added for selecting columns in the Transform Builder. For more information, see Changes to the Language.
Changes in System Behavior
Flow optimizations re-enabled:
For Trifacta Wrangler Pro, flow execution optimizations were disabled in an earlier release due to to technical issues. These optimizations are designed to improve query performance during job and sampling execution.
Beginning in this release, flow optimizations are re-enabled for new flows. When you create a new flow now, flow optimizations are automatically enabled for it.
- By default, flow optimizations are enabled for the entire workspace. They can be disabled if necessary. See Workspace Settings Page.
For flows created in a previous release, flow optimizations are disabled by default. You can choose to enable optimizations for an individual flow through Flow View page.
NOTE: If a flow execution fails multiple consecutive times, flow optimizations are automatically skipped. If job execution then succeeds, optimizations are automatically disabled for the flow.
For more information, see Manage Flow Advanced Settings Dialog.
Better license management:
In prior releases, the Trifacta application locked out all users if the number of active users exceeded the number permitted by the license. This situation could occur if users were being added via API, for example.
Beginning in this release, the Trifacta application does not block access when the number of licensed users is exceeded.
NOTE: If you see the notification banner about license key violations, please adjust your users until the banner is removed. If you need to adjust the number of users associated with your license key, please contact Trifacta Support.
Key Bug Fixes
Ticket | Description |
---|---|
TD-55125 | Cannot copy flow. However, export and import of the flow enables copying. |
TD-53475 | Missing associated artifact error when importing a flow. |
New Known Issues
None.
October 19, 2020
Release 7.8
What's New
Plans:
Create HTTP tasks for your plans, which can be configured to issue a request to an API endpoint over HTTP.
- For more information, see Plan View for HTTP Tasks.
- For more information on plans, see Overview of Operationalization.
- The viewport position and zoom level are now preserved when returning to a given flow.
Language:
- Rename columns now supports uppercase or lowercase characters or shorten column names to a specified character length from the left or right. For more information, see Changes to the Language.
Data quality rules:
Improvements to suggestions for data quality rules:
- Existing Data quality rules panel is updated with View suggestions button.
- Data quality rules are now categorized by suggestions for individual columns.
- Some rule types support the May be missing checkbox. When it is selected, the data quality rule allows missing values to be acceptable for a specified column. For more information on data quality rules, see Data Quality Rules Panel.
Connectivity:
IAM support for Redshift connections.
NOTE: To enable use of an existing IAM role for Redshift, additional permissions must be added. For more information, see Required AWS Account Permissions.
For more information, see Create Redshift Connections.
Changes in System Behavior
Enhanced Flow and Flow View menu options:
The context menu options for Flow View and Flow have been renamed and reorganized for a better user experience.
- For more information, see Flows Page.
- For more information, see Flow View Page.
Key Bug Fixes
None.
New Known Issues
Ticket | Description |
---|---|
TD-54030 | When creating custom datasets from Snowflake, columns containing time zone data are rendered as null values in visual profiles, and publishing back to Snowflake fails. Workaround: In your SELECT statement applied to a Snowflake database, references to time zone-based data must be wrapped in a function to convert it to UTC time zone. For more information, see Create Dataset with SQL. |
October 2, 2020
Release 7.7
What's New
None.
Changes in System Behavior
Disabled Optimizer Service
In the September release, the Optimizer service was introduced, which enabled users to apply advanced physical and logical optimizations for flow and job executions. Recently, an issue was discovered, which has caused us to disable the service temporarily.
- This issue affected a very small number of users who were using the new feature. Now that the feature is disabled, impacted users should experience impacts only to performance of flow and job executions. Performance should be similar to pre-release of the service.
- The Optimizer service was disabled through a configuration change that did not require any service interruptions. Users should not experience any loss of functionality or availability due to the work to resolve this issue.
- The Trifacta Engineering team is actively working to resolve the issue. Thank you for patience. If you have further questions, please contact Trifacta Support.
Key Bug Fixes
None.
New Known Issues
None.
September 21, 2020
Release 7.7
What's New
Manage workspace users:
Workspace administrators can:
- Modify users. See Workspace Users Page.
- Explore details on individual users. See Workspace User Details Page.
- Assign and un-assign workspace roles to individual users. See Workspace Roles Page.
Flow View:
- Automatically organize the nodes of your flow with a single click. See Flow View Page.
Changes in System Behavior
Deprecated Parameter History Panel Feature
As a part of collaborative suggestions enhancement, the support for Parameter History panel is deprecated from the software. For more information on collaborative suggestions feature, see Overview of Predictive Transformation.
Classic Flow View no longer available
In Release 7.6, an improved version of Flow View was released. At the time of release, users could switch back to using the classic version.
Beginning in this release, the classic version of Flow View is no longer available.
Tip: The objects in your flows that were created in classic Flow View may be misaligned in the new version of Flow View. You can use auto-arrange to re-align your flow objects.
For more information, see Flow View Page.
Key Bug Fixes
Ticket | Description |
---|---|
TD-53318 | Cannot publish results to relational targets when flow name or output filename or table name contains a hyphen (e.g. my - filename.csv). |
New Known Issues
None.
August 19, 2020
Release 7.6
What's New
Flow View:
- Configure advanced settings on your flow and its job executions. See Manage Flow Advanced Settings Dialog.
Plan View:
- Apply overrides to recipe parameters for your plans. See Plan View Page.
- Download logs for plan runs and individual flow tasks in the run. See Plan Runs Page.
Data quality rules:
- You can select data quality rules from a set of suggestions presented to you. For more information, see Data Quality Rules Panel.
- For more information, see Overview of Data Quality.
Job Execution:
Support for job cancellation. See Jobs Page.
Documentation:
- Additional connect string options and troubleshooting information has been included for specific relational connections. For more information, see Connection Types.
Changes in System Behavior
IP addresses to whitelist have changed:
Please verify that the following range of IP addresses have been whitelisted for the Trifacta service for access to relational datasources in your enterprise:
35.199.3.51/32 35.245.35.240/28
For more information, see Getting Started with Trifacta Wrangler Pro.
Key Fixes
Ticket | Description |
---|---|
TD-52221 | API: Unable to update awsConfig objects in per-user or per-workspace modes. |
TD-48915 | Inserting special characters in an output filename results in a validation error in the the application and job failures. |
New Known Issues
None.
July 20, 2020
Release 7.5
What's New
New Flow View is now generally available:
- Drag and drop to reposition objects on the Flow View canvas, and zoom in and out to focus on areas of development.
- Perform joins and unions between objects on the Flow View canvas.
- Search for flow objects by name or by type.
Annotate the canvas with notes.
Tip: The relative position of objects on the flow view canvas is preserved between screen updates. On refresh, the window on the canvas is repositioned based on the leftmost object on the canvas to focus on the flow to other objects from that one.
NOTE: Classic Flow View is no longer available.
See Flow View Page.
Import:
For long-loading relational datasets, you can monitor the ingest process through Flow View as you continue your work.
For more information, see Flow View Page.
Improved performance when browsing databases for tables to import.
Tip: Performance improvements are due to limiting the volume of table metadata that is imported when paging through available tables. This metadata can be retrieved when you hover over a table in the database browser.
For more information, see Database Browser.
Logical and physical optimizations when reading from relational sources during job execution, which includes column pruning push-down among other enhancements.
NOTE: This feature may need to be enabled in your workspace. See Workspace Settings Page.
This feature applies to the following relational connections in this release:
Transformer Page:
Collaborative suggestions allow users within a workspace to receive suggestions based on the transformations that have been recently created by themselves or by all members of the workspace. As more users generate transformations, the relevance of these suggestions to the data in the workspace continues to improve.
This feature must be enabled for individual users or across the workspace. See Workspace Settings Page.
When the feature is enabled, individual users can choose to not share their transformation data. See User Profile Page.
For more information, see Overview of Predictive Transformation.
- Create and edit flow parameters and their overrides while editing your recipe. See Transformer Page.
- For more information on editing flow parameters, see Manage Parameters Dialog.
Plans:
- Monitor status of all of your plan runs and drill into details. See Plan Runs Page.
Authorization:
- Workspace administrators can now create and assign roles to govern access to types of objects in the workspace. For more information, see Changes to User Management.
Language:
- New approximation functions for median, percentile, and quartile based on a very fast algorithm:
- New functions to encode and decode base64 strings.
Changes in System Behavior
Schema information is retained:
When schematized datasources are ingested, schema information is now retained for publication of job results.
NOTE: In prior releases, you may have set column data types manually because this schema information was lost during the ingest process. You may need to remove these manual steps from your recipe. For more information, see Improvements to the Type System.
Enhanced PII masking:
- For social security numbers and credit card numbers, the methods by which these values are determined for purposes of masking sensitive Personally Identifiable Information (PII) has been expanded and improved. For more information, see Improvements to the Type System.
IP addresses to whitelist have changed:
Please verify that the following range of IP addresses have been whitelisted for the Trifacta service for access to relational datasources in your enterprise:
35.199.3.51/32 35.245.35.240/28
For more information, see Getting Started with Trifacta Wrangler Pro.
Key Fixes
None.
New Known Issues
Ticket | Description |
---|---|
TD-50942 | If a flow is unshared with you, you cannot see or access the datasources for any jobs that you have already run on the flow. You can still access the job results. |
June 22, 2020
Release 7.4
What's New
Language:
- New weekday name function.
- See Changes to the Language.
Changes in System Behavior
NOTE: Beginning in this release, the set of IP addresses for the Trifacta Service has been changed. If you have connected to any relational sources from the product, please update all of your database services to which Trifacta Wrangler Pro connects to whitelist the new IP addresses.
34.86.43.62/32 35.230.178.129/32 35.245.163.90/32 34.86.140.202/32
For more information, see Getting Started with Trifacta Wrangler Pro.
API:
- Redshift connections now require a different credential type.
- Snowflake connections now require a different credential type.
- See Changes to the APIs.
Key Bug Fixes
None.
New Known Issues
None.
June 4, 2020
Release 7.3
What's New
Data quality rules:
- Introducing data quality rules, which enable you to define data quality checks specific to your dataset. For more information, see Overview of Data Quality.
- Data quality rules are created in the Transformer page. For more information, see Data Quality Rules Panel.
Language:
New rolling window date functions.
Function Name | Description |
---|---|
ROLLINGMAXDATE Function | Computes the rolling maximum of date values forward or backward of the current row within the specified column. Inputs must be of Datetime type. |
ROLLINGMINDATE Function | Computes the rolling minimum of Date values forward or backward of the current row within the specified column. Inputs must be of Datetime type. |
ROLLINGMODEDATE Function | Computes the rolling mode (most common value) forward or backward of the current row within the specified column. Input values must be of Datetime data type. |
Changes in System Behavior
None.
Key Bug Fixes
Ticket | Description |
---|---|
TD-49559 | Cannot select and apply custom data types through column Type menu. |
TD-47473 | Uploaded files (CSV, XLS, PDF) that contain a space in the filename fail to be converted. |
TD-34840 | Platform fails to provide suggestions for transformations when selecting keys from an object with many of them. |
New Known Issues
None.
May 18, 2020
Release 7.2
What's New
Introducing new Flow View:
The Flow View page has been redesigned to improve the user experience and overall productivity.
- Enhancements include:
- Drag and drop to reposition objects on the Flow View canvas, and zoom in and out to focus on areas of development.
- Perform joins and unions between objects on the Flow View canvas.
Annotate the canvas with notes.
Tip: The relative position of objects on the flow view canvas is preserved between screen updates. On refresh, the window on the canvas is repositioned based on the leftmost object on the canvas to focus on the flow to other objects from that one.
- You can toggle between new and classic views through the context menu in the corner of Flow View. See Flow View Page.
Publishing:
Support for generating results and publishing to Tableau Hyper format.
NOTE: Tableau TDE format will be deprecated in a future release. Please switch to using Tableau Hyper format.
If you have upgraded to Tableau Server 10.5 or later, you may have a mix of TDE and Hyper files stored on the server. You can automatically upgrade the TDE files to Hyper, if needed. For more information, see https://help.tableau.com/current/online/en-us/extracting_upgrade.htm.
- If you are on Tableau Server 10.5 or later and you append to a TDE file, the file is automatically converted to Hyper format. This conversion cannot be reverted.
- See Create Tableau Server Connections.
Connectivity:
Improved performance for Oracle and SQL Server connections. These performance improvements will be applied to other relational connections in future releases.
Language:
Function Name | Description |
---|---|
KTHLARGESTDATE Function |
Extracts the ranked Datetime value from the values in a column, where |
KTHLARGESTUNIQUEDATE Function |
Extracts the ranked unique Datetime value from the values in a column, where |
KTHLARGESTDATEIF Function |
Extracts the ranked Datetime value from the values in a column, where |
KTHLARGESTUNIQUEDATEIF Function |
Extracts the ranked unique Datetime value from the values in a column, where |
MINDATEIF Function | Returns the minimum Datetime value of rows in each group that meet a specific condition. Set of values must valid Datetime values. |
MAXDATEIF Function | Returns the maximum Datetime value of rows in each group that meet a specific condition. Set of values must valid Datetime values. |
MODEDATEIF Function | Returns the most common Datetime value of rows in each group that meet a specific condition. Set of values must valid Datetime values. |
Changes in System Behavior
None.
Key Bug Fixes
Ticket | Description |
---|---|
TD-47473 | Uploaded files (CSV, XLS, PDF) that contain a space in the filename fail to be converted. |
TD-34840 | Platform fails to provide suggestions for transformations when selecting keys from an object with many of them. |
New Known Issues
None.
April 15, 2020
Release 7.1
What's New
API Documentation:
API reference documentation is now available directly through the application. This release includes more supported endpoints and documented options. To access, select Help menu > API Documentation.
Workflow documentation is available with the product documentation. For more information, see API Reference.
Import:
- Ingestion of large relational datasets is no longer a blocking operation. Track progress of large-scale ingestion in Flow View and the Library page.
- See Flow View Page.
- See Import Data Page.
Flow View:
Create flow parameters that you can reference in the recipes of your flow. Flow parameters can be string literals, Trifacta patterns, or regular expression patterns.
NOTE: For this release, flow parameters can be applied into your recipes only.
As needed, you can apply overrides to the parameters in your flow or to downstream flows.
NOTE: Flow parameters do not apply to datasets or output objects, which have their own parameters. However, if you specify an override at the flow level, any parameters within the flow that use the same name receive the override value, including output object parameters and datasets with parameters.
- See Manage Parameters Dialog.
- For more information on parameters, see Overview of Parameterization.
Transformation:
- Faster and improved method of surfacing transform suggestions based on machine learning.
Language:
Some functions now accept Datetime values: Beginning in this release, the following functions now accept Datetime values as inputs. When a Datetime value is input, output values are in unixtime format.
Tip: You can wrap the unixtime format output in the DATEFORMAT function to render the results in the preferred Datetime format. See DATEFORMAT Function.
- MIN Function
- MINIF Function
- ROLLINGMIN Function
- MAX Function
- MAXIF Function
- ROLLINGMAX Function
- MODE Function
- MODEIF Function
- ROLLINGMODE Function
- KTHLARGEST Function
- KTHLARGESTIF Function
- ROLLINGKTHLARGEST Function
- KTHLARGESTUNIQUE Function
- KTHLARGESTUNIQUEIF Function
- ROLLINGKTHLARGESTUNIQUE Function
Date calculation functions:
Function Name | Description |
---|---|
MINDATE Function | Computes the minimum value found in all row values in a Datetime column. |
MAXDATE Function | Computes the maximum value found in all row values in a Datetime column. |
MODEDATE Function | Computes the most frequent (mode) value found in all row values in a Datetime column. |
Work day functions:
Function Name | Description |
---|---|
NETWORKDAYS Function | Calculates the number of working days between two specified dates, assuming Monday - Friday workweek. Optional list of holidays can be specified. |
NETWORKDAYSINTL Function | Calculates the number of working days between two specified dates. Optionally, you can specify which days of the week are working days as an input parameter. Optional list of holidays can be specified. |
WORKDAY Function | Calculates the work date that is before or after a start date, as specified by a number of days. A set of holiday dates can be optionally specified. |
WORKDAYINTL Function | Calculates the work date that is before or after a start date, as specified by a number of days. You can also specify which days of the week are working days and a list of holidays via parameters. |
Time zone conversion functions:
Function Name | Description |
---|---|
CONVERTFROMUTC Function | Converts Datetime value to corresponding value of the specified time zone. Input can be a column of Datetime values, a literal Datetime value, or a function returning Datetime values. |
CONVERTTOUTC Function | Converts Datetime value in specified time zone to corresponding value in UTC time zone. Input can be a column of Datetime values, a literal Datetime value, or a function returning Datetime values. |
CONVERTTIMEZONE Function | Converts Datetime value in specified time zone to corresponding value second specified time zone. Input can be a column of Datetime values, a literal Datetime value, or a function returning Datetime values. |
Changes in System Behavior
Authorization:
- All Trifacta admin users are now workspace admins.
All workspace admins now have access to all user-created objects within the workspace.
NOTE: Workspace admin access is at the owner level to each user-created object in the workspace. Under some conditions, workspace admins may have access to source datasets and generated results. See Workspace Admin Permissions.
Key Bug Fixes
None.
New Known Issues
Ticket | Description |
---|---|
TD-47473 | Uploaded files (CSV, XLS, PDF) that contain a space in the filename fail to be converted. Workaround: Remove the space in the filename and upload again. |
March 17, 2020
Release 7.0
Beginning in this release, you can access publicly available APIs of the Trifacta platform to run and monitor jobs. Numerous bug fixes and performance improvements.
What's New
APIs:
APIs are now publicly available! You can now use a library of publicly available REST APIs to automate key aspects of object creation and job execution. For more information, see API Reference.
Import:
- Ingestion of large relational datasets is no longer a blocking operation.
- Track progress of large-scale ingestion in Flow View and the Library page.
- See Flow View Page.
- See Import Data Page.
- Track progress of large-scale ingestion in Flow View and the Library page.
- Import tabular data from PDF documents. NOTE: This feature is in Beta release.
- See Import PDF Data.
Transformer Page:
- Improved performance when loading the Transformer page and when navigating between the Flow View and Transformer pages.
- Join steps are now created in a larger window for more workspace. See Join Window.
Changes in System Behavior
None.
Key Bug Fixes
None.
New Known Issues
None.
February 19, 2020
Release 6.11
This release introduces in-app chat and content suggestions within the application. Give it a try!
What's New
In-app chat:
Have a question about the product? Use the new in-app chat feature to explore content or ask a question to our support staff. If you need assistance, please reach out!
Language:
New functions to parse values against specific data types:
Function Name Description PARSEBOOL Function Evaluates a String input against the Boolean datatype. If the input matches, the function outputs a Boolean value. Input can be a literal, a column of values, or a function returning String values.
PARSEFLOAT Function Evaluates a String input against the Decimal datatype. If the input matches, the function outputs a Decimal value. Input can be a literal, a column of values, or a function returning String values.
PARSEINT Function Evaluates a String input against the Integer datatype. If the input matches, the function outputs an Integer value. Input can be a literal, a column of values, or a function returning String values.
Changes in System Behavior
None.
Key Fixes
None.
New Known Issues
None.
January 23, 2020
Release 6.10
This release delivers enhancements to job monitoring, visual profiles that are downloadable in PDF format, and a useful feature to kickoff any support inquiries.
What's New
Troubleshooting:
- Encounter an issue with the product? Select Help > Report issue to collect session information for Trifacta Support. See Report Issue.
Flow View:
- Monitor job progress through each phase in the Jobs panel. See Flow View Page.
Job Details:
- When visual profiling is enabled for a job, you can now download your visual profile in PDF format. See Job Details Page.
Documentation:
- New content on the getting started with sampling. See Sampling Basics.
- Feature overview: Overview of Sampling
- Best practices: https://community.trifacta.com/s/article/Best-Practices-Managing-Samples-in-Complex-Flows
Changes in System Behavior
Sharing:
- The Send a Copy feature is no longer available in the product. As a workaround, you can make a copy of the flow and share it. See Flow View Page.
Key Bug Fixes
None.
New Known Issues
None.
December 17, 2019
Release 6.9
This release introduces new statistical functions, including co-efficient and covariance calculations for enhanced analysis. A redesigned User menu facilitates easier management of user and workspace settings.
What's New
Transformer Page:
- New column selection UI simplifies choosing columns in your transformations. See Transform Builder.
Workspace:
- Redesigned Settings and Help menus. See Home Page.
- User settings are now modified through Preferences. See Preferences Page.
- Administrators now have a dedicated admin area. See Admin Console.
Language:
New statistical functions.
Function Name Description MEDIAN Function Computes the median from all row values in a column or group. Input column can be of Integer or Decimal.
PERCENTILE Function Computes a specified percentile across all row values in a column or group. Input column can be of Integer or Decimal.
QUARTILE Function Computes a specified quartile across all row values in a column or group. Input column can be of Integer or Decimal.
CORREL Function Computes the correlation coefficient between two columns. Source values can be of Integer or Decimal type.
COVAR Function Computes the covariance between two columns using the population method. Source values can be of Integer or Decimal type.
COVARSAMP Function Computes the covariance between two columns using the sample method. Source values can be of Integer or Decimal type.
Changes in System Behavior
Language:
All MODE functions return the lowest value in a set of values if there is a tie in the evaluation.
In prior releases, these functions returned a null value in the event of a tie for most common value among the evaluated ones.
- See MODE Function.
- See MODEIF Function.
- See LISTMODE Function.
- See ROLLINGMODE Function.
Key Bug Fixes
None.
New Known Issues
None.
November 13, 2019
Release 6.8
This release features enhancements to the user experience in the workspace, in the form of keyboard shortcuts and user-specific locale settings. You can also receive email notifications based on the outcome of your job executions. Flows and macros can be exported and imported into different editions and releases of the product. Read on!
What's New
Workspace:
- Individual users can now enable or disable keyboard shortcuts in the workspace or Transformer page. See User Profile Page.
- Configure locale settings at the workspace or user level. See Locale Settings.
- You can optionally duplicate the datasets from a source flow when you create a copy of it. See Flow View Page.
- Create a copy of your imported dataset. See Library Page.
Transformer Page:
- Create a new table from selected columns, functions applied to your source, and constants to replace your current dataset. See Select.
Improved Date/Time format selection. See Choose Datetime Format Dialog.
Tip: Datetime formats in card suggestions now factor in the user's locale settings for greater relevance.
- Improved matching logic and performance when matching columns through RapidTarget. See Overview of RapidTarget.
Job execution:
- If you enabled visual profiling for your job, you can download a JSON version of the visual profile. See Job Details Page.
Enable and configure email notifications based on the success or failure of job executions.
- For more information on enabling, see Workspace Settings Page.
- Individual users can opt out of receiving email messages or can configure use of a different email address. See Email Notifications Page.
- For more information on enabling emails for individual flows, see Manage Flow Notifications Dialog.
- For more information on enabling, see Workspace Settings Page.
Language:
This release introduces the sampling method of calculating statistical functions. The following are now available:
Function Name | Description |
---|---|
STDEVSAMP Function | Computes the standard deviation across column values of Integer or Decimal type using the sample statistical method. |
VARSAMP Function |
Computes the variance among all values in a column using the sample statistical method. Input column can be of Integer or Decimal. If no numeric values are detected in the input column, the function returns |
STDEVSAMPIF Function | Generates the standard deviation of values by group in a column that meet a specific condition using the sample statistical method. |
VARSAMPIF Function | Generates the variance of values by group in a column that meet a specific condition using the sample statistical method. |
ROLLINGSTDEVSAMP Function | Computes the rolling standard deviation of values forward or backward of the current row within the specified column using the sample statistical method. |
ROLLINGVARSAMP Function | Computes the rolling variance of values forward or backward of the current row within the specified column using the sample statistical method. |
Changes in System Behavior
Import/Export:
- Flows can now be exported and imported across products and versions of products. See Export Flow.
Key Bug Fixes
Ticket | Description |
---|---|
TD-44548 | RANGE function returns null values if more than 1000 values in output. |
New Known Issues
None.
October 9, 2019
Release 6.7
This release introduces two key management features. You can now export and import macros into other instances of Trifacta Wrangler Pro, which enables broader adoption of your data wrangling practices. You can also create webhook notifications to be sent to a third-party application based on the success or failure of your job.
What's New
Browser:
- Support for Firefox browser. NOTE: This feature is in Beta release.
For supported versions, see Desktop Requirements.
Project Management:
- Support for export and import of macros. See Macros Page.
- For more information on macros, see Overview of Macros.
Operationalization:
- Create webhook notifications for third-party platforms based on results of your job executions. See Create Flow Webhook Task.
Connectivity:
- Support for ingest from read-only Snowflake databases. See Create Snowflake Connections.
Changes in System Behavior
None.
Key Bug Fixes
None.
New Known Issues
None.
September 11, 2019
Release 6.6
This release introduces new functions to the language and improvements in search for transformations.
What's New
Transformer Page:
- Improvements to the Search panel enable faster discovery of transformations, functions, and other objects. See Search Panel.
Language:
Function Name | Description |
---|---|
SINH Function | Computes the hyperbolic sine of an input value for a hyperbolic angle measured in radians. The value can be a Decimal or Integer literal or a reference to a column containing numeric values. |
COSH Function | Computes the hyperbolic cosine of an input value for a hyperbolic angle measured in radians. The value can be a Decimal or Integer literal or a reference to a column containing numeric values. |
TANH Function | Computes the hyperbolic tangent of an input value for a hyperbolic angle measured in radians. The value can be a Decimal or Integer literal or a reference to a column containing numeric values. |
ASINH Function | Computes the arcsine of an input value for a hyperbolic angle measured in radians. The value can be a Decimal or Integer literal or a reference to a column containing numeric values. |
ACOSH Function | Computes the arccosine of an input value for a hyperbolic angle measured in radians. The value can be a Decimal or Integer literal or a reference to a column containing numeric values. |
ATANH Function | Computes the arctangent of an input value for a hyperbolic angle measured in radians. The value can be a Decimal or Integer literal or a reference to a column containing numeric values. |
Changes in System Behavior
None.
Key Bug Fixes
Ticket | Description |
---|---|
TD-42080 | Cannot run flow or deployment that contains more than 10 recipe jobs |
New Known Issues
None.
August 14, 2019
Release 6.5
This release introduces new functions and fixes a number off issues.
What's New
Import:
- Scan nested folders to import datasets with parameters. See Create Dataset with Parameters.
Language:
Function Name | Description |
---|---|
SIN Function | Computes the sine of an input value for an angle measured in radians. The value can be a Decimal or Integer literal or a reference to a column containing numeric values. |
COS Function | Computes the cosine of an input value for an angle measured in radians. The value can be a Decimal or Integer literal or a reference to a column containing numeric values. |
TAN Function | Computes the tangent of an input value for an angle measured in radians. The value can be a Decimal or Integer literal or a reference to a column containing numeric values. |
Cotangent Function | See TAN Function. |
Secant Function | See COS Function. |
Cosecant Function | See SIN Function. |
ASIN Function | For input values between -1 and 1 inclusive, this function returns the angle in radians whose sine value is the input. This function is the inverse of the sine function. The value can be a Decimal or Integer literal or a reference to a column containing numeric values. |
ACOS Function | For input values between -1 and 1 inclusive, this function returns the angle in radians whose cosine value is the input. This function is the inverse of the cosine function. The value can be a Decimal or Integer literal or a reference to a column containing numeric values. |
ATAN Function | For input values between -1 and 1 inclusive, this function returns the angle in radians whose tangent value is the input. This function is the inverse of the tangent function. The value can be a Decimal or Integer literal or a reference to a column containing numeric values. |
Arccotangent Function | See ATAN Function. |
Arcsecant Function | See ACOS Function. |
Arccosecant Function | See ASIN Function. |
Connectivity:
- Support for using non-default database for your Snowflake stage. See Create Snowflake Connections.
Changes in System Behavior
None.
Key Bug Fixes
Ticket | Description |
---|---|
TD-40348 | When loading a recipe in an imported flow that references an imported Excel dataset, Transformer page displays Input validation failed: (Cannot read property 'filter' of undefined) error, and the screen is blank. |
New Known Issues
None.
July 18, 2019
Release 6.4
This release introduces macros, which enable reuse and parameterization of common sequences of recipe steps.
What's New
Reuse:
- Introducing user-defined macros, which enable saving and reusing sequences of steps. For more information, see Overview of Macros.
Connectivity:
Support for direct publishing to Tableau Server. For more information, see Run Job Page.
Support for Snowflake database connections. See Create Snowflake Connections.
Transformation:
- New cluster view for transforming by example. See Transformation by Example Page.
Job Execution:
- Support for detailed job monitoring for ingest and publishing jobs. See Overview of Job Monitoring.
- Parameterize output paths and table and file names. See Run Job Page.
Wrangle:
- Broader support for metadata references: For Excel files,
$filepath
references now return the location of the source Excel file. Sheet names are appended to the end of the reference. See Source Metadata References.
Changes in System Behavior
NOTE: The desktop version of Trifacta Wrangler will cease operations on August 31, 2019. If you are still using the product at that time, your data will be lost. Please transition to using the free Cloud version of Trifacta® Wrangler. Automated migration is not available. To register for a free account, please visit https://cloud.trifacta.com.
NOTE: The Chat with us feature is no longer available. For Trifacta Wrangler Pro customers, this feature had to be enabled in the product. For more information, see Trifacta Support.
Documentation:
- In prior releases, the documentation listed UTF32-BE and UTF32-LE as supported file formats. These formats are not supported. Documentation has been updated to correct this error. See Supported File Encoding Types.
Key Bug Fixes
Ticket | Description |
---|---|
TD-40424 |
NOTE: Although these options are available in the application, they have never been supported in the underlying platform. They have been removed from the interface. |
TD-39513 | Import of folder of Excel files as parameterized dataset only imports the first file, and sampling may fail. |
TD-39092 |
For more information, see Source Metadata References. |
TD-31354 | When creating Tableau Server connections, the Test Connection button is missing. See Create Tableau Server Connections. |
New Known Issues
None.
June 17, 2019
Release 6.3
This release features a brand-new way to develop transformations via example. Map source column values to your entered values, and the platform can infer similar pattern-based matches in your column of data. Also, multi-step operations are now available in the Recipe panel. For administrators: you can now review the list of all available schedules in the workspace.
What's New
- Transform by example output values for a column of values. See Overview of TBE.
Transform:
- The redesigned Recipe panel enables multi-step operations and more robust copy and paste actions. See Recipe Panel.
Connectivity:
- Publishing (writeback) is now supported for relational connections. The following connection types are natively supported for publishing to relational systems.
Admin:
- Administrators can review, enable, disable, and delete schedules through the application. See Schedules Page.
Language:
Changes to System Behavior
NOTE: The Chat with us feature is no longer available. For more information, see Trifacta Support.
Key Bug Fixes
Ticket | Description |
---|---|
TD-40243 | API access tokens don't work with native SAML SSO authentication |
May 30, 2019
This release fixes a few bugs.
What's New
None.
Changes in System Behavior
None.
Key Bug Fixes
Ticket | Description |
---|---|
TD-40965 | JSON output escapes quotes in Array or Object outputs. NOTE: By default, all columns for schematized outputs are typecast to their annotated types. This feature can be disabled as needed by a workspace administrator. For more information, see Schematized output in Workspace Settings Page. |
New Known Issues
None.
May 15, 2019
Release 6.2
This release includes new functions and a new method for locating datasets and recipes to join in.
What's New
Transformer Page:
- Browse current flow for datasets or recipes to join into the current recipe. See Join Window.
Language:
New functions:
Function Name Description RANK Function Computes the rank of an ordered set of value within groups. Tie values are assigned the same rank, and the next ranking is incremented by the number of tie values.
DENSERANK Function Computes the rank of an ordered set of value within groups. Tie values are assigned the same rank, and the next ranking is incremented by 1.
Connectivity:
- Enhanced import process for Excel files. See Import Excel Data.
Changes to System Behavior
None.
Key Bug Fixes
None.
New Known Issues
None.
April 10, 2019
Release 6.1
This release greatly expands the set of supported JDBC-based connections. Also, it introduces new selection-specific operations, including replacement of individual cell values, as well as bug fixes.
What's New
Connectivity:
- Improved ingestion performance for JDBC connections. For more information on available connections, see Connection Types.
Wrangling:
- Replace specific cell values. See Replace Cell Values.
Changes to System Behavior
None.
Key Bug Fixes
None.
New Known Issues
None.
March 4, 2019
Release 6.0
This release of Trifacta® Wrangler Pro introduces key features around job monitoring and column management, including multi-select and copy and paste of columns and column values. A new Job Details page captures more detailed information about job execution and enables more detailed monitoring of in-progress jobs.
What's New
NOTE: The PNaCl client for Google Chrome has been replaced by the WebAssembly client. This new client is now the default in use by the platform and is deployed to all clients through the browser. Please verify that all users in your environment are on Google Chrome 68+. For more information, see Desktop Requirements.
Wrangling:
- In data grid, you can select multiple columns before receiving suggestions and performing transformations on them. For more information, see Data Grid Panel.
- New Selection Details panel enables selection of values and groups of values within a selected column. See Selection Details Panel.
- Copy and paste columns and column values through the column menus. see Copy and Paste Columns.
- Support for importing files in Parquet format. See Supported File Formats.
Connectivity:
NOTE: If you are connecting Trifacta Wrangler Pro to any relational source of data, such as Redshift or Oracle, you must add the Trifacta Service to your whitelist for those resources. For more information, see Getting Started with Trifacta Wrangler Pro.
Read/write support for Redshift.
For more information, see Create Redshift Connections.
Read support for the following relational connections.
NOTE: This feature is in Beta release.- Configuration specific to a connection type may be required:
- Oracle
- SQL Server. See Create SQL Server Connections.
- PostgreSQL
- DB2
- Salesforce. See Create Salesforce Connections.
- See Create Connection Window.
- Configuration specific to a connection type may be required:
- Support for publishing to Tableau Server. NOTE: This feature is in Beta release.
See Create Tableau Server Connections.
Monitoring:
- Monitor the status of in-progress jobs through the new Job Details page. See Job Details Page.
Wrangle :
New functions:
Function Name Description ARRAYINDEXOF Function Computes the index at which a specified element is first found within an array. Indexing is left to right.
ARRAYRIGHTINDEXOF Function Computes the index at which a specified element is first found within an array, when searching right to left. Returned value is based on left-to-right indexing.
ARRAYSLICE Function Returns an array containing a slice of the input array, as determined by starting and ending index parameters.
ARRAYMERGEELEMENTS Function Merges the elements of an array in left to right order into a string. Values are optionally delimited by a provided delimiter.
- The LISTUNIQUE function is now the UNIQUE Function.
- All
LIST*
functions now accept Array type only inputs.
Changes to System Behavior
None.
Key Bug Fixes
None.
New Known Issues
Ticket | Description |
---|---|
TD-39299 | In Create Connection window, all connection types are listed as Import and Publish. Workaround: In this release, only Redshift connections are Import and Publish. |
TD-38869 | Upload of Parquet files does not support nested values, which appear as null values in the Transformer page. Workaround: Unnest the values before importing into the platform. |
February 5, 2019
What's New
NOTE: The PNaCl client for Google Chrome has been replaced by the WebAssembly client component. This new client is now the default in use by the platform and is deployed to all clients through the browser. For more information, see Desktop Requirements.
Wrangling:
- Standardize column values through a simple new interface. See Standardize Page.
- For more information on other methods of standardization, see Overview of Standardization.
Workspace:
New functions:
The following functions can now be applied directly to arrays to derive meaningful statistics about them.
Function Description ARRAYSORT Function Sorts array values in the specified column, array literal, or function that returns an array in ascending or descending order.
TRANSLITERATE Function Transliterates Asian script characters from one script form to another. The string can be specified as a column reference or a string literal.
- Hide/unhide or wipeout workspace users. See Workspace Users Page.
Changes to System Behavior
None.
Errata
In prior releases, the product and documentation stated that the platform implemented a version of regular expressions based on Javascript syntax. This is incorrect.
The Trifacta platform implements a version of regular expressions based off of RE2 and PCRE regular expressions.
NOTE: This is not a change in behavior. Only the documentation has been changed.
Key Fixes
None.
New Known Issues
Ticket | Description |
---|---|
TD-37683 | Send a copy does not create independent sets of recipes and datasets in new flow. If imported datasets are removed in the source flow, they disappear from the sent version. Workaround: Create new versions of the imported datasets in the sent flow. |
January 10, 2019
What's New
Language:
- New functions to compute statistics on arrays.
- Track file-based lineage using
$filepath
and$sourcerownumber
references. See Source Metadata References.
Jobs:
- Filter list of jobs by source of job execution or by date range. See Jobs Page.
Changes to System Behavior
None.
Key Fixes
None.
New Known Issues
None.
December 4, 2018
This is the initial release of Trifacta® Wrangler Pro.
This page has no comments.