Page tree

Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Migration of unmigrated content due to installation of a new plugin

D toc

August 19, 2020

Release 7.6

What's New

d-s-experimental

In this release, experimental versions of the following have been deployed to some users of the product:

  • First-time on-boarding: New and improved product walkthrough!
  • Getting started workflow: Shorter and faster method for getting started wrangling data. Example datasets are available for use!


Job Execution:

Changes in System Behavior

None.

Key Bug Fixes

TicketDescription
TD-48915Inserting special characters in an output filename results in a validation error in the the application and job failures.

New Known Issues

None.

July 20, 2020

Release 7.5

What's New

New Flow View is now generally available:

  • Drag and drop to reposition objects on the Flow View canvas, and zoom in and out to focus on areas of development.
  • Perform joins and unions between objects on the Flow View canvas. 
  • Search for flow objects by name or by type.
  • Annotate the canvas with notes.

    Tip

    Tip: The relative position of objects on the flow view canvas is preserved between screen updates. On refresh, the window on the canvas is repositioned based on the leftmost object on the canvas to focus on the flow to other objects from that one.

    Info

    NOTE: Classic Flow View is no longer available.

    See Flow View Page.

Transformer Page:

  • Collaborative suggestions allow users within a workspace to receive suggestions based on the transformations that have been recently created by themselves or by all members of the workspace. As more users generate transformations, the relevance of these suggestions to the data in the workspace continues to improve.

Language:

Changes in System Behavior

Enhanced PII masking:

  • For social security numbers and credit card numbers, the methods by which these values are determined for purposes of masking sensitive Personally Identifiable Information (PII) has been expanded and improved. For more information, see Improvements to the Type System.

Key Fixes

None.

New Known Issues

None.

June 22, 2020

Release 7.4

What's New

Language:

Key Bug Fixes

None.

New Known Issues

None.

June 4, 2020

Release 7.3

What's New

Language:

New rolling window date functions. 

Function NameDescription
ROLLINGMAXDATE Function

D excerpt include
pageROLLINGMAXDATE Function
nopaneltrue

ROLLINGMINDATE Function

D excerpt include
pageROLLINGMINDATE Function
nopaneltrue

ROLLINGMODEDATE Function

D excerpt include
pageROLLINGMODEDATE Function
nopaneltrue

Changes in System Behavior

None.

Key Bug Fixes

TicketDescription
TD-49559Cannot select and apply custom data types through column Type menu.
TD-47473Uploaded files (CSV, XLS, PDF) that contain a space in the filename fail to be converted.
TD-34840Platform fails to provide suggestions for transformations when selecting keys from an object with many of them.


New Known Issues

None.

May 18, 2020

Release 7.2

What's New

Introducing new Flow View:

The Flow View page has been redesigned to improve the user experience and overall productivity. 

D beta

  • Enhancements include:
    • Drag and drop to reposition objects on the Flow View canvas, and zoom in and out to focus on areas of development.
    • Perform joins and unions between objects on the Flow View canvas. 
    • Annotate the canvas with notes.

      Tip

      Tip: The relative position of objects on the flow view canvas is preserved between screen updates. On refresh, the window on the canvas is repositioned based on the leftmost object on the canvas to focus on the flow to other objects from that one.

  • You can toggle between new and classic views through the context menu in the corner of Flow View. See Flow View Page.

Language:

Function NameDescription
KTHLARGESTDATE Function

D excerpt include
pageKTHLARGESTDATE Function
nopaneltrue

KTHLARGESTUNIQUEDATE Function

D excerpt include
pageKTHLARGESTUNIQUEDATE Function
nopaneltrue

KTHLARGESTDATEIF Function

D excerpt include
pageKTHLARGESTDATEIF Function
nopaneltrue

KTHLARGESTUNIQUEDATEIF Function

D excerpt include
pageKTHLARGESTUNIQUEDATEIF Function
nopaneltrue

MINDATEIF Function

D excerpt include
pageMINDATEIF Function
nopaneltrue

MAXDATEIF Function

D excerpt include
pageMAXDATEIF Function
nopaneltrue

MODEDATEIF Function

D excerpt include
pageMODEDATEIF Function
nopaneltrue

Changes in System Behavior

None.

Key Fixes

TicketDescription
TD-47473Uploaded files (CSV, XLS, PDF) that contain a space in the filename fail to be converted.
TD-38480Platform fails to provide suggestions for transformations when selecting keys from an object with many of them.

New Known Issues

None.

April 15, 2020

Release 7.1

What's New

Transformation:

  • Faster and improved method of surfacing transform suggestions based on machine learning.

Language:

Some functions now accept Datetime values: Beginning in this release, the following functions now accept Datetime values as inputs. When a Datetime value is input, output values are in unixtime format.

Tip

Tip: You can wrap the unixtime format output in the DATEFORMAT function to render the results in the preferred Datetime format. See DATEFORMAT Function.

Date calculation functions:

Function NameDescription
MINDATE Function

D excerpt include
pageMINDATE Function
nopaneltrue

MAXDATE Function

D excerpt include
pageMAXDATE Function
nopaneltrue

MODEDATE Function

D excerpt include
pageMODEDATE Function
nopaneltrue

Work day functions:

Function NameDescription
NETWORKDAYS Function

D excerpt include
pageNETWORKDAYS Function
nopaneltrue

NETWORKDAYSINTL Function

D excerpt include
pageNETWORKDAYSINTL Function
nopaneltrue

WORKDAY Function

D excerpt include
pageWORKDAY Function
nopaneltrue

WORKDAYINTL Function

D excerpt include
pageWORKDAYINTL Function
nopaneltrue

Time zone conversion functions:

Function NameDescription
CONVERTFROMUTC Function

D excerpt include
pageCONVERTFROMUTC Function
nopaneltrue

CONVERTTOUTC Function

D excerpt include
pageCONVERTTOUTC Function
nopaneltrue

CONVERTTIMEZONE Function

D excerpt include
pageCONVERTTIMEZONE Function
nopaneltrue

Changes in System Behavior

None.

Key Bug Fixes

None.

New Known Issues

TicketDescription
TD-47473

Uploaded files (CSV, XLS, PDF) that contain a space in the filename fail to be converted.

Tip

Workaround: Remove the space in the filename and upload again.


March 17, 2020

Release 7.0

Numerous bug fixes and performance improvements.

What's New

Transformer Page:

  • Improved performance when loading the Transformer page and when navigating between the Flow View and Transformer pages.
  • Join steps are now created in a larger window for more workspace. See Join Window.

Changes in System Behavior

None.

Key Bug Fixes

None.

New Known Issues

TicketDescription
TD-47473

Uploaded files (CSV, XLS, PDF) that contain a space in the filename fail to be converted.

Tip

Workaround: Remove the space in the filename and upload again.


February 19, 2020

Release 6.11

This release introduces in-app chat and content suggestions within the application. Give it a try!

What's New

In-app chat: 

Tip

Have a question about the product? Use the new in-app chat feature to explore content or ask a question to our support staff. If you need assistance, please reach out!

Language:

  • New functions to parse values against specific data types:

    Function NameDescription
    PARSEBOOL Function

    D excerpt include
    pagePARSEBOOL Function
    nopaneltrue

    PARSEFLOAT Function

    D excerpt include
    pagePARSEFLOAT Function
    nopaneltrue

    PARSEINT Function

    D excerpt include
    pagePARSEINT Function
    nopaneltrue

Changes in System Behavior

None.

Key Fixes

None.

New Known Issues

None.

January 23, 2020

Release 6.10

This release delivers enhancements to job monitoring, visual profiles that are downloadable in PDF format, and a useful feature to kickoff any support inquiries.

What's New

Troubleshooting:

  • Encounter an issue with the product? Select Help > Report issue to collect session information for 
    D s support
    . See Report Issue.

Job Details:

  • When visual profiling is enabled for a job, you can now download your visual profile in PDF format. See Job Details Page

Documentation:

Changes in System Behavior

None.

Key Bug Fixes

None.

New Known Issues

None.

December 17, 2019

Release 6.9

This release introduces new statistical functions, including co-efficient and covariance calculations for enhanced analysis. A redesigned User menu facilitates easier management of user settings.

What's New

Transformer Page:

  • New column selection UI simplifies choosing columns in your transformations. See Transform Builder

Workspace:

  • Redesigned Settings and Help menus. See Home Page.

Language:

Changes in System Behavior

Language:

All MODE functions return the lowest value in a set of values if there is a tie in the evaluation.

In prior releases, these functions returned a null value in the event of a tie for most common value among the evaluated ones.

Key Bug Fixes

None.

New Known Issues

None.

November 13, 2019

Release 6.8

This release features enhancements to the user experience in the workspace, in the form of keyboard shortcuts and user-specific locale settings, and other useful features and improvements. Read on!

What's New

Workspace:

  • Individual users can now enable or disable keyboard shortcuts in the workspace or Transformer page. See User Profile Page.
  • Configure locale settings at the workspace or user level. See Locale Settings.
  • You can optionally duplicate the datasets from a source flow when you create a copy of it. See Flow View Page.
  • Create a copy of your imported dataset. See Library Page.

Transformer Page:

  • Create a new table from selected columns, functions applied to your source, and constants to replace your current dataset. See Select.
  • Improved Date/Time format selection. See Choose Datetime Format Dialog.

    Tip

    Tip: Datetime formats in card suggestions now factor in the user's locale settings for greater relevance.

  • Improved matching logic and performance when matching columns through RapidTarget. See Overview of RapidTarget.

Job execution:

  • If you enabled visual profiling for your job, you can download a JSON version of the visual profile. See Job Details Page.

Language:

This release introduces the sampling method of calculating statistical functions. The following are now available:

Function NameDescription
STDEVSAMP Function

D excerpt include
pageSTDEVSAMP Function
nopaneltrue

VARSAMP Function

D excerpt include
pageVARSAMP Function
nopaneltrue

STDEVSAMPIF Function

D excerpt include
pageSTDEVSAMPIF Function
nopaneltrue

VARSAMPIF Function

D excerpt include
pageVARSAMPIF Function
nopaneltrue

ROLLINGSTDEVSAMP Function

D excerpt include
pageROLLINGSTDEVSAMP Function
nopaneltrue

ROLLINGVARSAMP Function

D excerpt include
pageROLLINGVARSAMP Function
nopaneltrue

Changes in System Behavior

None.

Key Bug Fixes

TicketDescription
TD-44548RANGE function returns null values if more than 1000 values in output.

New Known Issues

None.

October 9, 2019

Release 6.7

What's New

Browser:

Project Management:

Changes in System Behavior

None.

Key Bug Fixes

None.

New Known Issues

None.

September 11, 2019

Release 6.6

This release introduces new functions to the language and improvements in search for transformations.

What's New

Transformer Page:

  • Improvements to the Search panel enable faster discovery of transformations, functions, and other objects. See Search Panel.

Language:

Function NameDescription
SINH Function

D excerpt include
pageSINH Function
nopaneltrue

COSH Function

D excerpt include
pageCOSH Function
nopaneltrue

TANH Function

D excerpt include
pageTANH Function
nopaneltrue

ASINH Function

D excerpt include
pageASINH Function
nopaneltrue

ACOSH Function

D excerpt include
pageACOSH Function
nopaneltrue

ATANH Function

D excerpt include
pageATANH Function
nopaneltrue


Changes in System Behavior

None.

Key Bug Fixes

None.

New Known Issues

None.

August 14, 2019

Release 6.5

This release introduces new functions and fixes a number off issues.

What's New

Language:

Function NameDescription
SIN Function

D excerpt include
pageSIN Function
nopaneltrue

COS Function

D excerpt include
pageCOS Function
nopaneltrue

TAN Function

D excerpt include
pageTAN Function
nopaneltrue

Cotangent FunctionSee TAN Function.
Secant FunctionSee COS Function.
Cosecant FunctionSee SIN Function.
ASIN Function

D excerpt include
pageASIN Function
nopaneltrue

ACOS Function

D excerpt include
pageACOS Function
nopaneltrue

ATAN Function

D excerpt include
pageATAN Function
nopaneltrue

Arccotangent FunctionSee ATAN Function.
Arcsecant FunctionSee ACOS Function.
Arccosecant FunctionSee ASIN Function.

Changes in System Behavior

None.

Key Bug Fixes

None.

New Known Issues

None.

July 18, 2019

Release 6.4

This release introduces macros, which enable flexible reuse of common sequences of recipe steps.

What's New

Reuse:

  • Introducing user-defined macros, which enable saving and reusing sequences of steps. For more information, see Overview of Macros.

Connectivity:

  • Support for direct publishing to Tableau Server. For more information, see Run Job Page.

Transformation:

Wrangle:

  • Broader support for metadata references: For Excel files, $filepath references now return the location of the source Excel file. Sheet names are appended to the end of the reference. See Source Metadata References.

Changes in System Behavior

Info

NOTE: The desktop version of Trifacta Wrangler will cease operations on August 31, 2019. If you are still using the product at that time, your data will be lost. Please transition to using the free Cloud version of

D s product
productss
rtrue
. Automated migration is not available. To register for a free account, please visit https://cloud.trifacta.com.

Info

NOTE: The Chat with us feature is no longer available. For

D s product
customers, this feature had to be enabled in the product. For more information, see
D s support
.


Documentation:

  • In prior releases, the documentation listed UTF32-BE and UTF32-LE as supported file formats. These formats are not supported. Documentation has been updated to correct this error. See Supported File Encoding Types

Key Bug Fixes

TicketDescription
TD-40424

UTF-32BE and UTF-32LE are available as supported file encoding options. They do not work.

Info

NOTE: Although these options are available in the application, they have never been supported in the underlying platform. They have been removed from the interface.


New Known Issues

None.

June 17, 2019

Release 6.3

This release features a brand-new way to develop transformations via example. Map source column values to your entered values, and the platform can infer similar pattern-based matches in your column of data. Also, multi-step operations are now available in the Recipe panel. For administrators: you can now review the list of all available schedules in the workspace.  

What's New

  • Transform by example output values for a column of values. See Overview of TBE.

Transform:

  • The redesigned Recipe panel enables multi-step operations and more robust copy and paste actions. See Recipe Panel.

Language:

Changes to System Behavior

Info

NOTE: The Chat with us feature is no longer available. For more information, see

D s support
.

Key Bug Fixes

None.

New Known Issues

None.

May 15, 2019

Release 6.2

This release includes new functions and a new method for locating datasets and recipes to join in.

What's New

Transformer Page:

  • Browse current flow for datasets or recipes to join into the current recipe. See Join Window.

Language:

  • New functions:

    Function NameDescription
    RANK Function

    D excerpt include
    pageRANK Function
    nopaneltrue

    DENSERANK Function

    D excerpt include
    pageDENSERANK Function
    nopaneltrue

Connectivity:

Changes to System Behavior

None.

Key Bug Fixes

None.

New Known Issues

None.

April 10, 2019

Release 6.1

This introduces new selection-specific operations, including replacement of individual cell values, as well as bug fixes.

What's New

Wrangling:

Changes to System Behavior

None.

Key Bug Fixes

None.

New Known Issues

None.

March 4, 2019

Release 6.0

This release of 

D s product
rtrue
 introduces key features around job monitoring and column management, including multi-select and copy and paste of columns and column values. A new Job Details page captures more detailed information about job execution and enables more detailed monitoring of in-progress jobs. 

What's New

Info

NOTE: The PNaCl client for Google Chrome has been replaced by the WebAssembly client. This new client is now the default in use by the platform and is deployed to all clients through the browser. Please verify that all users are on Google Chrome 68+. For more information, see Desktop Requirements.

Wrangling:

  • In data grid, you can select multiple columns before receiving suggestions and performing transformations on them. For more information, see Data Grid Panel.
    • New Selection Details panel enables selection of values and groups of values within a selected column. See Selection Details Panel.
  • Copy and paste columns and column values through the column menus. see Copy and Paste Columns.
  • Support for importing files in Parquet format. See Supported File Formats.

Monitoring:

  • Monitor the status of in-progress jobs through the new Job Details page. See Job Details Page

D s lang
:

Changes to System Behavior

$filepath disabled

In a prior release, the $filepath reference was enabled in

D s product
productsaas
. Since all file paths are to the local desktop, this reference is considered unreliable. It has been disabled for use in this version and subsequent versions of the product.

Info

NOTE: If your recipes contain references to $filepath in them, they are broken in the new version of the product. Please review your recipes in the Transformer Page to see if specific steps are broken.

Key Bug Fixes

None.

New Known Issues

TicketDescription
TD-38869

Upload of Parquet files does not support nested values, which appear as null values in the Transformer page.

Tip

Workaround: Unnest the values before importing into the platform.


February 5, 2019

What's New

Info

NOTE: The PNaCl client for Google Chrome has been replaced by the WebAssembly client component. This new client is now the default in use by the platform and is deployed to all clients through the browser. For more information, see Desktop Requirements.

 

Wrangling:

Workspace:

  • New functions:

    The following functions can now be applied directly to arrays to derive meaningful statistics about them. 

    FunctionDescription
    ARRAYSORT Function

    D excerpt include
    pageARRAYSORT Function
    nopaneltrue

    TRANSLITERATE Function

    D excerpt include
    pageTRANSLITERATE Function
    nopaneltrue

Changes to System Behavior

None.

Errata

In prior releases, the product and documentation stated that the platform implemented a version of regular expressions based on Javascript syntax. This is incorrect.

The platform implements a version of regular expressions based off of RE2 and PCRE regular expressions.

Info

NOTE: This is not a change in behavior. Only the documentation has been changed.

Key Fixes

None.

New Known Issues

None.

January 10, 2019

What's New

Language:

  • New functions to compute statistics on arrays.
  • Track file-based lineage using $filepath and $sourcerownumber references. See Source Metadata References.

Jobs:

  • Filter list of jobs by source of job execution or by date range. See Jobs Page.

Changes to System Behavior

None.

Key Fixes

None.

New Known Issues

None.

December 4, 2018

This release includes one new feature and a number of updates to address issues in the platform.

What's New

Info

NOTE: Beginning in this release,

D s product
productss
rtrue
utilizes the WebAssembly client extension in Google Chrome. This replaces the PNaCl client extension, which was used in earlier releases. No configuration is required. For more information, see Desktop Requirements.

 

  • Organize your flows into folders. See Flows Page.

Changes to System Behavior

None.

Key Fixes

TicketDescription
TD-36332Data grid can display wrong results if a sample is collected and dataset is unioned.
TD-36192Canceling a step in recipe panel can result in column menus disappearing in the data grid.

New Known Issues

None.

October 24, 2018 Update

This release is primarily focused on fixing issues in the platform.

What's New

None.

Changes to System Behavior

None.

Key Fixes

TicketDescription
TD-35504
Cancel job throws 405 status code error. Clicking Yes repeatedly pops up Cancel Job dialog.

TD-35481

Recipe is malformed after software update.

New Known Issues

None.

October 2, 2018 Update

What's New

Tip

Tip: For a general overview of the product and its capabilities, see Product Overview.

Transformer Page:

Jobs:

Language:

  • Rename columns using values across multiple rows. See Rename Columns.

Changes in System Behavior

None.

Key Bug Fixes

TicketDescription
TD-34472Splitting a column on multiple pattern yields an error in the Transformer page.
TD-31252Assigning a target schema through the Column Browser does not refresh the page.

New Known Issues

TicketComponentDescription
TD-34840Transformer PagePlatform fails to provide suggestions for transformations when selecting keys from an object with many of them.

August 30, 2018 Update

What's New

Transformations:

Transformation NameDescription
Bin columnPlace numeric values into bins of equal or custom size for the range of values
Scale columnScale a column's values to a fixed range or to zero mean, unit variance distributions.
One-hot encodingEncode values from one column into separate columns containing 0 or 1, depending on the absence or presence of the value in the corresponding row.
Group ByGenerate new columns or replacement tables from aggregate functions applied to grouped values from one or more columns.

Publishing:

  • Add quotes as CSV file publishing options. See Run Job Page.

Changes to System Behavior

None.

Key Bug Fixes

TicketDescription
TD-34407Profile job fails due to Out of Memory error.
TD-34390Profile job fails with bigger than spark.driver.maxResultSize error.
TD-34389Transform job fails when sorting on a Boolean column.
TD-33428

Job execution on recipe with high limit in split transformation due to Java Null Pointer Error during profiling.

Info

NOTE: Avoid creating datasets that are wider than 2500 columns. Performance can degrade significantly on very wide datasets.

TD-33744If you cancel out of a previewed join, the previewed dataset remains in the flow.

 

New Known Issues

None.

July 30, 2018 Update

What's New

Transformer Page:

  • Join tool is now integrated into the context panel in the Transformer page. See Join Window.
  • Patterns are available for review and selection, prompting suggestions, in the context panel.

Changes to System Behavior



New Functions

Function NameDescription
DOUBLEMETAPHONE FunctionReturns a two-element array of primary and secondary phonetic encodings for an input string, based on the Double Metaphone algorithm.
DOUBLEMETAPHONEEQUALS FunctionCompares two input strings using the Double Metaphone algorithm. An optional threshold parameter can be modified to adjust the tolerance for matching.

 

Key Bug Fixes

None.

New Known Issues

TicketComponentDescription
TD-33744Transformer Page - Tools

If you cancel out of a previewed join, the previewed dataset remains in the flow.

Workaround: Remove the previewed dataset through Flow View.

 

June 26, 2018 Update

What's New

Changes to System Behavior

SOURCEROWNUMBER function generates null values consistently

The SOURCEROWNUMBER function returns the row number of the row as it appears in the original dataset. After some operations, such as unions, joins, and aggregations, this row information is no longer available.

Previously, the results were confusing. When source row information was not available, the function was simply not available for use.

Now, the behavior of the SOURCEROWNUMBER function is more consistent:

  • If the source row information is available, it is returned.
  • If it is not available:
    • The function can still be used.
    • The function returns null values in all cases.

For more information, see SOURCEROWNUMBER Function.

New Functions

Function NameDescription
UNIQUE FunctionGenerates a new column containing an array of the unique values from a source column.

Key Bug Fixes

None.

New Known Issues

None.

May 29, 2018 Update

In this release 

D s product
productsaas:r=true
 has been enhanced with account monitoring capabilities, so you are alerted when you are approaching data usage and job execution limits. As needed, you can remove objects from the platform to reduce your current usage. Read below for details.

What's New

Account Management:

  • Review your storage and download volumes for the current month. See Data Usage Page.

Transformer Page:

Publishing:

Changes to System Behavior

None.

Key Bug Fixes

TicketDescription
TD-31626Adding join keys does not refresh join preview pane.
TD-31264Patterns not available for Datetime columns

New Known Issues

TicketComponentDescription
TD-31343Connectivity

Upload of XSLX appears to fail.

Tip

Tip: XLSX file upload is currently slow. Please be patient with the upload process. This area is targeted for improvements in a future release.

April 2, 2018 Update

Welcome to the inaugural release of the cloud version

D s product
productsaas
rtrue
! This release represents the migration of the prior version of Wrangler for the desktop to the cloud, where you can take advantage of more storage and faster processing.

Info

NOTE: As of this release, the desktop version of

D s product
productpe
is no longer updated. You can continue to use the product for a period of time. However, at some point in the future, this product will be terminated and no longer accessible.

At this time, you should migrate to using the cloud version of

D s product
productsaas
. This new product contains the latest features from
D s company
and will be the supported version going forward.