Page tree

 

Support | BlogContact Us | 844.332.2821

Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Published by Scroll Versions from space DEV and version next

D toc

Feburary 5, 2019

What's New

Info

NOTE: The PNaCl client for Google Chrome has been replaced by the WebAssembly client component. This new client is now the default in use by the platform and is deployed to all clients through the browser. For more information, see Desktop Requirements.

 

Wrangling:

Workspace:

  • New functions:

    The following functions can now be applied directly to arrays to derive meaningful statistics about them. 

    FunctionDescription
    ARRAYSORT Function

    D excerpt include
    pageARRAYSORT Function
    nopaneltrue

    TRANSLITERATE Function

    D excerpt include
    pageTRANSLITERATE Function
    nopaneltrue

Changes to System Behavior

None.

Errata

In prior releases, the product and documentation stated that the platform implemented a version of regular expressions based on Javascript syntax. This is incorrect.

The 

D s platform
 implements a version of regular expressions based off of RE2 and PCRE regular expressions.

Info

NOTE: This is not a change in behavior. Only the documentation has been changed.

Key Fixes

None.

New Known Issues

None.

January 10, 2019

What's New

Language:

  • New functions to compute statistics on arrays.
  • Track file-based lineage using $filepath and $sourcerownumber references. See Source Metadata References.

...

  • Filter list of jobs by source of job execution or by date range. See Jobs Page.

Changes to System Behavior

None.

Key Fixes

None.

New Known Issues

None.

December 4, 2018

This release includes one new feature and a number of updates to address issues in the platform.

What's New

Info

NOTE: Beginning in this release,

D s product
productss
rtrue
utilizes the WebAssembly client extension in Google Chrome. This replaces the PNaCl client extension, which was used in earlier releases. No configuration is required. For more information, see Desktop Requirements.

...

  • Organize your flows into folders. See Flows Page.

Changes to System Behavior

None.

Key Fixes

TicketDescription
TD-36332Data grid can display wrong results if a sample is collected and dataset is unioned.
TD-36192Canceling a step in recipe panel can result in column menus disappearing in the data grid.

New Known Issues

None.

October 24, 2018 Update

This release is primarily focused on fixing issues in the platform.

What's New

None.

Changes to System Behavior

None.

Key Fixes

TicketDescription
TD-35504
Cancel job throws 405 status code error. Clicking Yes repeatedly pops up Cancel Job dialog.

TD-35481

Recipe is malformed after software update.

New Known Issues

None.

October 2, 2018 Update

What's New

Tip

Tip: For a general overview of the product and its capabilities, see Product Overview.

...

TicketDescription
TD-34472Splitting a column on multiple pattern yields an error in the Transformer page.
TD-31252Assigning a target schema through the Column Browser does not refresh the page.

New Known Issues

TicketComponentDescription
TD-34840Transformer PagePlatform fails to provide suggestions for transformations when selecting keys from an object with many of them.

August 30, 2018 Update

What's New

Transformations:

Transformation NameDescription
Bin columnPlace numeric values into bins of equal or custom size for the range of values
Scale columnScale a column's values to a fixed range or to zero mean, unit variance distributions.
One-hot encodingEncode values from one column into separate columns containing 0 or 1, depending on the absence or presence of the value in the corresponding row.
Group ByGenerate new columns or replacement tables from aggregate functions applied to grouped values from one or more columns.

...

  • Add quotes as CSV file publishing options. See Run Job Page.

Changes to System Behavior

None.

Key Bug Fixes

TicketDescription
TD-34407Profile job fails due to Out of Memory error.
TD-34390Profile job fails with bigger than spark.driver.maxResultSize error.
TD-34389Transform job fails when sorting on a Boolean column.
TD-33428

Job execution on recipe with high limit in split transformation due to Java Null Pointer Error during profiling.

Info

NOTE: Avoid creating datasets that are wider than 2500 columns. Performance can degrade significantly on very wide datasets.

TD-33744If you cancel out of a previewed join, the previewed dataset remains in the flow.

 

New Known Issues

None.

July 30, 2018 Update

What's New

Transformer Page:

  • Join tool is now integrated into the context panel in the Transformer page. See Join Panel.
  • Patterns are available for review and selection, prompting suggestions, in the context panel. See Pattern Details Panel.

Changes to System Behavior

 

New Functions

Function NameDescription
DOUBLEMETAPHONE FunctionReturns a two-element array of primary and secondary phonetic encodings for an input string, based on the Double Metaphone algorithm.
DOUBLEMETAPHONEEQUALS FunctionCompares two input strings using the Double Metaphone algorithm. An optional threshold parameter can be modified to adjust the tolerance for matching.

 

Key Bug Fixes

None.

New Known Issues

TicketComponentDescription
TD-33744Transformer Page - Tools

If you cancel out of a previewed join, the previewed dataset remains in the flow.

Workaround: Remove the previewed dataset through Flow View.

 

June 26, 2018 Update

What's New

Changes to System Behavior

SOURCEROWNUMBER function generates null values consistently

...

Function NameDescription
LISTUNIQUE FunctionGenerates a new column containing an array of the unique values from a source column.

Key Bug Fixes

None.

New Known Issues

None.

May 29, 2018 Update

In this release 

D s product
productsaas:r=true
 has been enhanced with account monitoring capabilities, so you are alerted when you are approaching data usage and job execution limits. As needed, you can remove objects from the platform to reduce your current usage. Read below for details.

What's New

Account Management:

  • Review your storage and download volumes for the current month. See Data Usage Page.

...

Changes to System Behavior

None.

Key Bug Fixes

TicketDescription
TD-31626Adding join keys does not refresh join preview pane.
TD-31264Patterns not available for Datetime columns

New Known Issues

TicketComponentDescription
TD-31343Connectivity

Upload of XSLX appears to fail.

Tip

Tip: XLSX file upload is currently slow. Please be patient with the upload process. This area is targeted for improvements in a future release.

...