Page tree

Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Published by Scroll Versions from space DEV and version r091

D toc

The following changes have been applied to 

D s lang
 in this release of
D s product
rtrue
.

Release 8.11

Nest transformation explicitly types transformed column

In prior releases, when a Nest transformation was applied to a column to nest values into Arrays or Objects, the resulting column was re-inferred by the 

D s webapp
. This re-inference should not be necessary, since the target column's data type is effectively declared in the transformation definition. 

Beginning in this release, the output column of these Nest transformations is explicitly typed to Array or Object data type, based on the definition of the transformation. 

Info

NOTE: Existing uses of the Nest transformation are not immediately affected. However, if these transformations are edited, then the changes may cause unexpected results and breakages in downstream transformations. If the recipe was originally designed expecting a different data type, subsequent steps may have been used to clean up the nested data, assuming that it was String values or some other data type. If the output column is now explicitly typed as Array or Object data type, these steps may be broken. You may be able to fix these broken steps by explicitly typing the output column to String after the Nest transformation and before your subsequent steps.

For more information, see Nest Your Data.

Release 8.10

Split by position no longer requires sorted list of positions

Beginning in this release, when you create a Split by position transformation, the numeric values indicating the positions do not need to be listed in sorted numeric order. 

Tip

Tip: You can now do faster iteration since you can add new positions as needed when previewing the transformation.

For more information, see Split Column.

 

Release 8.5

Support for numeric separators in NUMFORMAT function

Beginning in Release 8.5, the NUMFORMAT function supports the following configurable separators for localizing numeric values:

Option NameDescription
Decimal SeparatorThe string used to separate the integer part of a Decimal value from its fractional part.
Grouping SeparatorThe string used to separate a group of digits. 

For more information, see NUMFORMAT Function.

New functions

Function NameDescription
NUMVALUE Function

D excerpt include
pageNUMVALUE Function
nopaneltrue

Release 8.4

New functions

Documentation for the following functions is now available.

Function NameDescription
FINDNTH Function

D excerpt include
pageFINDNTH Function
nopaneltrue

PARSESTRING Function

D excerpt include
pagePARSESTRING Function
nopaneltrue

PARSEARRAY Function

D excerpt include
pagePARSEARRAY Function
nopaneltrue

PARSEOBJECT Function

D excerpt include
pagePARSEOBJECT Function
nopaneltrue

Release 8.3

None.

Release 8.2

None.

Release 7.10

New functions

Function NameDescription
EOMONTH Function

D excerpt include
pageEOMONTH Function
nopaneltrue

Release 7.9

Transform Builder now supports All columns option

Beginning in Release 7.9, select All columns option has been added in the Transform Builder. 

Option NameDescription
All

Selects all columns in the dataset

Example:

D trans
RawWrangletrue
p03Value_new
Typestep
WrangleText##NO_WRANGLE##
p01NameOption
p01ValueAdd suffix
p02NameColumns
p02ValueAll
p03NameSuffix
SearchTermRename columns

The following is the list of the transformations that accept the All option for selecting columns:

  • Date format

  • Delete columns

  • Move columns

  • Rename column

  • Replace

  • Replace text or patterns

  • Replace cells

  • Replace text between delimiters

  • Replace by position

  • Replace mismatched values

  • Replace missing values

  • Edit with formula

  • Change column type

  • Text format

  • Unpivot columns

For more information, see Transform Builder.

Release 7.8

Rename transform now supports Upper / Lower and Left / Right options

Beginning in Release 7.8, the Rename transform supports the following new options:

Option NameDescription
Convert to lowercase

Converts existing column names to lowercase

Convert to UPPERCASEConverts existing column names to uppercase
Keep from beginning (left)Specifies the number of characters to keep from the beginning of column names
Keep from end (right)Specifies the number of characters to keep from the end of column names

For more information on rename columns, see Rename Columns.

Release 7.5

New Functions

Approximation statistical functions:

Tip

Tip: Approximation functions are suitable for larger datasets. As the number of rows increases, accuracy and calculation performance improves for these functions. 

Function NameDescription
APPROXIMATEMEDIAN Function

D excerpt include
pageAPPROXIMATEMEDIAN Function
nopaneltrue

APPROXIMATEPERCENTILE Function

D excerpt include
pageAPPROXIMATEPERCENTILE Function
nopaneltrue

APPROXIMATEQUARTILE Function

D excerpt include
pageAPPROXIMATEQUARTILE Function
nopaneltrue

base64 encoding functions:

Function NameDescription
BASE64ENCODE Function

D excerpt include
pageBASE64ENCODE Function
nopaneltrue

BASE64DECODE Function

D excerpt include
pageBASE64DECODE Function
nopaneltrue

Release 7.4

New Functions

Function NameDescription
WEEKDAYNAME Function

D excerpt include
pageWEEKDAYNAME Function
nopaneltrue