...

• For more information, see Flows Page.
• For more information, see Connections Page.
• For more information, see Plans Page.

Connectivity:

• Early Preview (read-only) connections available with this release:

  D s ed
  r true editions gdpent,gdppro,gdppr

• • D s conntype
    type presto_db

  • D s conntype
    type bing_ads

  • For more information, see Early Preview Connection Types.

Sampling:

• Adjust the size of samples loaded in the browser for your current recipe to improve performance and address low-memory conditions. See Change Recipe Sample Size.

Changes in System Behavior

None.

Deprecated

None.

...

• Sample Size.

Changes in System Behavior

None.

Deprecated

None.

Key Bug Fixes

New Known Issues

None.

October 12, 2021

Release 8.8

What's New

Project Usage:

• VCU usage and active users are now displayed in the 

  D s webapp

   for administrators. For more information, see Usage Page.

• You can now configure the 

  D s webapp

   to execute 

  D s photon

   jobs in your VPC.
  

  D beta

  
  

  D s ed
  editions gdpent

  
  For more information, please contact 

  D s support

  .

Changes

Cancellation of jobs is temporarily disabled:

In previous releases, you could cancel in-progress jobs for flow and sampling jobs through the

Job cancellation may be re-enabled in the future.

Billing:

Charges for your project and user usage of 

Beginning at the end of October 2021, these discrepancies will be addressed. The daily reporting interval will be changed to start and end at midnight Pacific time to match how Google Marketplace reports. However, the usage tracking will remain based on the UTC time zone.

vCPU usage has been tracked on an hourly basis and will be unchanged.

For more information, see Usage Page.

Import:

Improvements have been made in how double quotes are handled in CSV files during import to align 

• Example values in source CSV file:

  Code Block
  """My product""",In stock,"16,000",0.05

  Note that the value 16,000 must be double-quoted, since the value contains a comma, which is the field delimiter.

• Previously, this value appeared in the Transformer page in columns as the following:

  c1	c2	c3	c4
  """My product"""	In stock	"16,000"	0.05

• As of this version, the 

  D s webapp

   handles the values in a better manner when displaying them in the Transformer page:

  c1	c2	c3	c4
  "My product"	In stock	16,000	0.05

  • c1: Escaped values (tripe double-quotes) in the source no longer render in the application as triple double-quotes and are represented as quoted values.

  • c3: Note that the double quotes in c3 have been stripped. Leading and trailing quotes are trimmed if the quotes are balanced within a cell.

    Info

    NOTE: This change in behavior applies only to newly created imported datasets sourced from a CSV file. Existing imported datasets should not be affected. However, if a newly imported dataset is transformed by a previously existing recipe that compensated for the extra quotes in the Transformer page, the effects on output data could be unpredictable. These recipes and their steps should be reviewed. This change does apply to any newly imported dataset sourced from CSV and may cause the data to change. For example, if you export an older flow and import into a new workspace or project, this change in parsing behavior applies to the datasets that are newly created in the new environment. Recipes may require review upon import.

• When results are generated in CSV, output files should continue to reflect the formatting of the source data before import. See above.

  Tip
  Tip: You can also choose the Include quotes option when creating a CSV output.

  • When profiling is enabled, values that appear in CSV as "" are now marked as missing.

API:

• To prevent overloading mission-critical API endpoints, rate limiting on a select set of API endpoints has been implemented in the

  D s platform

  . For more information, see Changes to the APIs.

BigQuery Running Environment:

When running jobs in BigQuery, some additional data types, functions, and transformations are now supported:

• Data types: The following data types are now supported for execution in BigQuery:

  • Arrays
  • Objects (Maps)
• Aggregation functions: 
  • LIST
  • LISTIF
  • UNIQUE
  • See Aggregate Functions.
• Date functions:
  • WEEKNUM
  • CONVERTFROMUTC
  • CONVERTTOUTC
  • CONVERTTIMEZONE
    
  • DATEDIF: All unit types are now supported.
  • See Date Functions.

• String functions:

  • SUBSTITUTE
  • PROPER
  • REMOVESYMBOLS
  • DOUBLEMETAPHONE
    
  • See String Functions.
    

• Nested functions:

  • ARRAYCONCAT
  • ARRAYCROSS
  • ARRAYINTERSECT
  • ARRAYLEN
  • ARRAYSTOMAP
  • ARRAYUNIQUE
  • ARRAYZIP
  • FILTEROBJECT
  • KEYS
  • ARRAYELEMENTAT
  • LISTAVERAGE
  • LISTMAX
  • LISTMIN
  • LISTMODE
  • LISTSTDEV
  • LISTSUM
  • LISTVAR
  • ARRAYSORT
  • ARRAYINDEXOF
  • ARRAYMERGEELEMENTS
  • ARRAYRIGHTINDEXOF
  • ARRAYSLICE
  • See Nested Functions.
• Other functions:
  • IPTOINT
  • IPFROMINT
  • See Other Functions.

• Transformations:
  

  Search term	Transform
  Unnest elements	unnest
  Expand Array to rows	flatten
  Extract between delimiters	extractbetweendelimiters
  Unpivot	unpivot
  Standardize column	standardize
  Nest columns	nest
  Extract matches to Array	extractlist
  Replace between delimiters	replacebetweenpatterns
  Scale to min max	scaleminmax
  Scale to mean	scalestandardize
  Convert key/value to Object	extractkv
  Join	Join datasets For more information, see Join Types.

  • Legend:

    • Search term: the value you enter in the Transform Builder
    • Transform: name of the underlying transform

    • For more information, see Transformation Reference.

BigQuery Running Environment:

• Support for reading Google Cloud Storage files for execution in BigQuery.
  

  D s ed
  editions gdpent,gdppro,gdppr

  
  
  • For more information, see Flow Optimization Settings Dialog.
  • For more information, see Google Cloud Storage Access.

Deprecated

None.

Known Issues

None.

Fixes

New Known Issues

None.

September 15, 2021

Release 8.7

What's New

Templates:

...

• Some enhancements to flagging steps for review. See Flag for Review.

Changes

None.

Deprecated

API:

• Deprecated API endpoint to transfer assets between users has been removed from the platform. This endpoint was previously replaced by an improved method of transfer.
• Some connection-related endpoints have been deprecated. These endpoints have little value for public use.
• For more information, see Changes to the APIs.

Known Issues

if(ismissing($col),NULL(),$col)

Fixes

August 16, 2021

Release 8.6

What's New

Template Gallery:

Collaboration:

• Flow editors and plan collaborators can be permitted to schedule jobs. See See Dataprep Project Settings Page.

...

Better Handling of JSON files:

The 

Usage reporting:

Detailed reporting on vCPU and active users is now available in the 

For more information, see Usage Page.

Changes

• The following machine types are now available when running a 

  D s dataflow

   job:

  Code Block
  "e2-standard-2", "e2-standard-4", "e2-standard-8", "e2-standard-16", "e2-standard-32"

Deprecated

None.

Known Issues

• TD-63564: Schedules created by a flow collaborator with editor access stop working if the collaborator is removed from the flow.

  • Tip: Flow owners can delete the schedule and create a new one. When this issue is fixed, the original schedule will continue to be executed under the flow owner's account.

  • Collaborators with viewer access cannot create schedules.
    

Fixes

• TD-61478: Time-based data types are imported as String type from BigQuery sources when type inference is disabled.

July 20, 2021

Release 8.5

What's New

...

• Review the total vCPU hours consumed by your datasets, recipes, and job execution within your project across an arbitrary time period. 
  • For more information, see Usage Page.
  • For more information, see Usage Metrics.

Changes

None.

Deprecated

None.

Known Issues

None.

Fixes

• TD-62190: You may not be able to view the SQL that was used to execute a job within BigQuery. This issue is due to a regression in the new BigQuery console in which job identifiers containing dashes are not supported. A ticket has been filed with Google.

June 7, 2021

Release 8.4

What's New

Template Gallery:

• Check out the new gallery of flow templates, which can be imported into your workspace. These templates are pre-configured to solve the most compelling loading and transformation use cases in the product. For more information, see www.trifacta.com/templates.
  • For more information on importing flows into your workspace, see Import Flow.
  • For more information on using a template in the product, see Start with a Template. 

...

• New content on parsing functions. See Changes to the Language.

Changes

D s photon

limits on execution time

...

In conjunction with the previous change, execution of scheduled jobs is not supported on

Deprecated

None.

Known Issues

• TD-62190: You may not be able to view the SQL that was used to execute a job within BigQuery. This issue is due to a regression in the new BigQuery console in which job identifiers containing dashes are not supported. A ticket has been filed with Google.

Fixes

• TD-60881:  Incorrect file path and missing file extension in the application for parameterized outputs
• TD-60382: Date format M/d/yy is handled differently by PARSEDATE function on

  D s photon

  and Spark.

May 20, 2021

Release 8.3 - push 3

What's New

Connectivity:

• Support for SFTP connections.
  

  D s ed
  editions gdpent,gdppro,gdppr

  
  

  Info
  NOTE: This connection type is import only.

  For more information, see SFTP Connections.

Changes

D s photon

enabled by default

...

Deprecated

None.

Known Issues

None.

Fixes

None.

May 10, 2021

Release 8.3

What's New

Running Environments:

• Support for full job execution on BigQuery.
  • Support for visual profiling of jobs executed in BigQuery.
  • For more information, see Configure Running Environments.
  • For more information, see Overview of Job Execution.

...

Changes

Improved method of JSON import

...

For more information on using the old version and migrating to the new version, see Working with JSON v1.

Deprecated

None.

Known Issues

• TD-61478: Time-based data types are imported as String type from BigQuery sources when type inference is disabled.

Fixes

• TD-60701: Most non-ASCII characters incorrectly represented in visual profile downloaded in PDF format.
• TD-59854: Datetime column from Parquet file incorrectly inferred to the wrong data type on import.

April 26, 2021

Release 8.2 push2

What's New

...

• D s product
  product gdpent

• D s product
  product gdppro

• D s product
  product gdpsta

Changes

None.

Deprecated

None.

Known Issues

None.

Fixes

None.

April 14, 2021

Release 8.2

...

• D s product
  product gdpent

• D s product
  product gdppro

• D s product
  product gdpsta

What's New

Photon:

Introducing

...

From the Home Page, you can quickly redesign your output and destination experience. The step-by-step procedures enables you to create an improved and streamlined output creation experience. For more information, see Start with a Template.

Changes

Improved methods for disabling the product:

...

These endpoints have little value for public use.

Deprecated

None.

Known Issues

• TD-60701: Most non-ASCII characters incorrectly represented in visual profile downloaded in PDF format.

Fixes

• TD-59236:  Use of percent sign (%) in file names causes Transformer page to crash during preview.
• TD-59218:  BOM characters at the beginning of a file causing multiple headers to appear in Transformer Page.

...