Trifacta Dataprep
Page tree


Support | Blog | Contact Us 

Versions Compared

Old Version 45

changes.mady.by.user docuser1

Saved on

compared with

New Version 46

changes.mady.by.user docuser1

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Published by Scroll Versions from space DEV and version r0810

...

For release notes from previous releases, see Earlier Releases of Dataprep by Trifacta.Cloud Dataprep.

December 7, 2021

Release 8.10

What's New

User management:

Introducing user and role management. In the Admin console in the 

D s webapp
, you can enable and disable user access and determine access levels to individual object types, such as flows, connections, and plans. 

D s ed
nottrue
editionsgdple

Connectivity:

  • Enable connectivity between the 

    D s webapp
     and your cloud databases using SSH tunneling.

    Info

    NOTE: SSH tunneling is enabled on a per-connection basis. For this release, SSH tunneling can be enabled on the following connection types:

    D s conntype
    typeoracle
    ,
    D s conntype
    typepostgres
    ,
    D s conntype
    typemysql
    , and
    D s conntype
    typesqlserver
    .

    For more information, see Configure SSH Tunnel Connectivity.

  • Early Preview (read-only) connections available with this release:
    D s ed
    editionsgdpent,gdppro,gdppr

Session Management:

You can view the current and recent sessions for your account in the 

D s webapp
. As needed, you can revoke any unfamiliar devices or sessions. For more information, see Sessions Page.

Changes in System Behavior

Data type mismatches can now be written out in CSV format:

Beginning in this release, for CSV outputs mismatched values are written as regular values by default. In prior releases, mismatched values were written as null values in CSV outputs.

See Improvements to the Type System.

Ingestion:

Maximum permitted record length has been increased from 1 MB to 20 MB. For more information, see Working with JSON v2.

Split transformation:

When splitting a column based on positions, the positions no longer need to be listed in numeric order. See Changes to the Language.

Deprecated

None.

Key Bug Fixes

None.

New Known Issues

TicketDescription
TD-66185

Flatten transformation cannot handle multi-character delimiters.

Tip

Workaround: When a column of arrays is flattened using the

D s photon
running environment, multi-character String delimiters are not supported. As a workaround, you can create a regular expression delimiter, as in the following, which uses either left bracket or right bracket as the delimiter:

Code Block
/[|]/


November 23, 2021

Release 8.9

What's New

Refer and Earn:

Beginning in this release, for every new sign-up you refer, you get a reward of your choice. For more information, see Referrals Page.

...

For more information, see Start a Subscription.

BigQuery Running Environment:

...

  • Adjust the size of samples loaded in the browser for your current recipe to improve performance and address low-memory conditions. See Change Recipe Sample Size.

Changes in System Behavior

None.

Deprecated

None.

Key Bug Fixes

TicketDescription
TD-65502Datasets from parameters are improperly being permitted to be referenced in recipes and returns an error during job execution.

New Known Issues

None.

October 12, 2021

Release 8.8

What's New

Project Usage:

  • VCU usage and active users are now displayed in the 
    D s webapp
     for administrators. For more information, see Usage Page.

...

Data types: The following data types are now supported for execution in BigQuery:

  • Arrays
  • Objects (Maps)

...

  • LIST
  • LISTIF
  • UNIQUE
  • See Aggregate Functions.
  • Date functions:
    • WEEKNUM
    • CONVERTFROMUTC
    • CONVERTTOUTC
    • CONVERTTIMEZONE
    • DATEDIF: All unit types are now supported.
    • See Date Functions.

    • ...

    String functions:

    ...

  • SUBSTITUTE
  • PROPER
  • REMOVESYMBOLS
  • DOUBLEMETAPHONE
  • See String Functions.

    • ...

    Nested functions:

    ...

  • ARRAYCONCAT
  • ARRAYCROSS
  • ARRAYINTERSECT
  • ARRAYLEN
  • ARRAYSTOMAP
  • ARRAYUNIQUE
  • ARRAYZIP
  • FILTEROBJECT
  • KEYS
  • ARRAYELEMENTAT
  • LISTAVERAGE
  • LISTMAX
  • LISTMIN
  • LISTMODE
  • LISTSTDEV
  • LISTSUM
  • LISTVAR
  • ARRAYSORT
  • ARRAYINDEXOF
  • ARRAYMERGEELEMENTS
  • ARRAYRIGHTINDEXOF
  • ARRAYSLICE
  • See Nested Functions.
  • Other functions:

  • Transformations:

    Search term

    Transform

    Unnest elementsunnest
    Expand Array to rowsflatten
    Extract between delimitersextractbetweendelimiters
    Unpivotunpivot
    Standardize columnstandardize
    Nest columnsnest
    Extract matches to Arrayextractlist
    Replace between delimitersreplacebetweenpatterns
    Scale to min maxscaleminmax
    Scale to meanscalestandardize
    Convert key/value to Objectextractkv
    JoinJoin datasets
    For more information, see Join Types.

    • Legend:

      • Search term: the value you enter in the Transform Builder
      • Transform: name of the underlying transform

      • For more information, see Transformation Reference.

    • ...

    Deprecated

    None.

    Known Issues

    None.

    Fixes

    ...

    September 15, 2021

    Release 8.7

    What's New

    Templates:

    D s ed
    rtrue
    editionsgdpent,gdppro,gdpsta,gdppr,gdpst

    ...

    Changes

    None.

    Deprecated

    API:

    • Deprecated API endpoint to transfer assets between users has been removed from the platform. This endpoint was previously replaced by an improved method of transfer.
    • Some connection-related endpoints have been deprecated. These endpoints have little value for public use.
    • For more information, see Changes to the APIs.

    ...

    August 16, 2021

    Release 8.6

    What's New

    Template Gallery:

    Tip

    Tip:  You can start a trial account by selecting a pre-configured template from our templates gallery. See  www.trifacta.com/templates.  

    ...

    • The following machine types are now available when running a 

      D s dataflow
       job:

      Code Block
      "e2-standard-2",
"e2-standard-4",
"e2-standard-8",
"e2-standard-16",
"e2-standard-32"

    Deprecated

    None.

    Known Issues

    • TD-63564: Schedules created by a flow collaborator with editor access stop working if the collaborator is removed from the flow.

      • Tip: Flow owners can delete the schedule and create a new one. When this issue is fixed, the original schedule will continue to be executed under the flow owner's account.

      • Collaborators with viewer access cannot create schedules.

    ...

    • TD-61478: Time-based data types are imported as String type from BigQuery sources when type inference is disabled.

    July 20, 2021

    Release 8.5

    What's New

    Tip

    Tip: When you complete your

    D s product
    productgdpent
    or
    D s product
    productgdppro
    trial, you can choose to license a higher or lower tier product edition. For more information, see Product Editions.

    ...

    • Review the total vCPU hours consumed by your datasets, recipes, and job execution within your project across an arbitrary time period. 

    Changes

    None.

    Deprecated

    None.

    Known Issues

    None.

    Fixes

    • TD-62190: You may not be able to view the SQL that was used to execute a job within BigQuery. This issue is due to a regression in the new BigQuery console in which job identifiers containing dashes are not supported. A ticket has been filed with Google.

    June 7, 2021

    Release 8.4

    What's New

    Template Gallery:

    • Check out the new gallery of flow templates, which can be imported into your workspace. These templates are pre-configured to solve the most compelling loading and transformation use cases in the product. For more information, see www.trifacta.com/templates.
      • For more information on importing flows into your workspace, see Import Flow.
      • For more information on using a template in the product, see Start with a Template. 

    ...

    In conjunction with the previous change, execution of scheduled jobs is not supported on

    D s photon
    . Since
    D s photon
    jobs are now limited to 10 minutes of execution time, scheduled jobs have been automatically migrated to execution on
    D s dataflow
    to provide better execution success. For more information, see Trifacta Photon Running Environment.

    Deprecated

    None.

    Known Issues

    • TD-62190: You may not be able to view the SQL that was used to execute a job within BigQuery. This issue is due to a regression in the new BigQuery console in which job identifiers containing dashes are not supported. A ticket has been filed with Google.

    ...

    May 20, 2021

    Release 8.3 - push 3

    What's New

    Connectivity:

    • Support for SFTP connections.

      D s ed
      editionsgdpent,gdppro,gdppr

      Info

      NOTE: This connection type is import only.

      For more information, see SFTP Connections.

    ...

    D s photon
    can be enabled or disabled by a project administrator. For more information, see Dataprep Project Settings Page.

    Deprecated

    None.

    Known Issues

    None.

    Fixes

    None.

    May 10, 2021

    Release 8.3

    What's New

    Running Environments:

    ...

    For more information on using the old version and migrating to the new version, see Working with JSON v1.

    Deprecated

    None.

    Known Issues

    • TD-61478: Time-based data types are imported as String type from BigQuery sources when type inference is disabled.

    ...

    April 26, 2021

    Release 8.2 push2

    What's New

    Tip

    Upgrade: Trial customers can upgrade through the Admin console. See Admin Console.

    ...

    • D s product
      productgdpent
    • D s product
      productgdppro
    • D s product
      productgdpsta

    Changes

    None.

    Deprecated

    None.

    Known Issues

    None.

    Fixes

    ...

    • D s product
      productgdpent
    • D s product
      productgdppro
    • D s product
      productgdpsta

    What's New

    Photon:

    Introducing

    D s photon
    , an in-memory running environment for running jobs. Embedded in the
    D s product
    ,
    D s photon
    delivers improved performance in job execution and is best-suited for small- to medium-sized jobs.

    ...

    These endpoints have little value for public use.

    Deprecated

    None.

    Known Issues

    • TD-60701: Most non-ASCII characters incorrectly represented in visual profile downloaded in PDF format.

    ...

    For release notes from previous releases, see Earlier Releases of Cloud Dataprep by Trifacta.

    © 2013-2022 Trifacta® Inc. Privacy Policy  |  Terms of Use