Transformation Reference

D toc

This section contains reference information on the transformations available in

D s product

r	true

.

Tip
Tip: Use the values in the Title column as search strings in the Search panel to begin specifying these transformations.

Name

Title

Description

changetype

Change column type

Changes the data type of a column [settype].

comment

Add comment

Adds a comment to your recipe [comment]. See Add Comments to Your Recipe.

conditions

Conditional column

Returns values based on conditions such as if-then-else or case statements. See Apply Conditional Transformations.

convertpattern

Convert patterns

Finds one or more patterns or text literals and replaces them with specified pattern values.

countmatches

Count matches

Counts the number of matches [countpattern]. See Compute Counts.

countmatchesbetween

Count matches between delimiters

Counts the number of matches [countpattern]. See Compute Counts.

deduplicate

Remove duplicate rows

Removes duplicate rows where values in every column are the same. See Deduplicate Data.

derive

New formula

Creates a new column with the result of a formula

drop

Delete columns

Delete one or more columns. See Remove Data.

extractbetweendelimiters

Extract text between delimiters

Extracts text found between two patterns. See Extract Values.

extractcustom

Extract text or pattern

Extracts text found between two patterns. Variant: Custom text or pattern. See Extract Values.

extractfirstcharacters

Extract the first n characters

Extracts text according to its position. Variant: Extract the first n characters. See Extract Values.

extractkv

Convert key/value pairs into Objects

Extracts key-value pairs into an Object [extractkv]. See Extract Values.

extractlastcharacters

Extract the last n characters

Extracts key-value pairs into an Object [extractkv]. Variant: Extract the last n characters. See Extract Values.

extractlist

Convert list into Array

Extracts a list into an Array [extractlist]. See Extract Values.

extractrangeofcharacters

Extract characters between positions

Extracts text according to its position. Variant: Extract the last n characters. See Extract Values.

extractmismatched

Extract mismatched values

Extracts a list into an Array [extractlist]. Variant: The data type to match against. See Extract Values.

extractnumbers

Extract numbers from text

Extracts a list into an Array [extractlist]. Variant: Extract numbers from a text. See Extract Values.

extractquerystrings

Extract HTTP query strings

Extracts a list into an Array [extractlist]. Variant: Extract fields from an URL query string. See Extract Values.

filtercontains

Filter rows when value contains

Filter rows that satisfy a condition. Variant: Filter rows that contain a specified value or pattern. See Filter Data.

filtercustom

Filter rows using custom formula

Filter rows that satisfy a condition. Variant: Filter rows that satisfy an arbitrary formula. See Filter Data.

filterendswith

Filter rows when value ends with

Filter rows that satisfy a condition. Variant: Filter rows that ends with a specified value or pattern. See Filter Data.

filterexactly

Filter rows when value is exactly

Filter rows that satisfy a condition. Variant: Filter rows that match exactly a specified value. See Filter Data.

filternot

Filter rows when value is not

Filters rows that do not satisfy a condition. See Filter Data.

filterfromtop

Filter rows from top

Filter rows by their position. Variant: Filter rows from the top. See Filter Data.

filtergreaterthan

Filter rows when value is greater than

Filter rows that satisfy a condition. Variant: Filter rows with values greater than (or equal to) a specified value. See Filter Data.

filterinterval

Filter rows at regular interval

Filter rows by their position. Variant: . Variant: The size of the interval to filter rows at. See Filter Data.

filterlessthan

Filter rows when value is less than

Filter rows that satisfy a condition. Variant: Filter rows with values less than (or equal to) a specified value. See Filter Data.

filtermissing

Filter rows when value is missing

Filter rows that satisfy a condition. Variant: Filter rows with missing values. See Remove Data.

filtermismatched

Filter rows when value is mismatched

Filter rows that satisfy a condition. Variant: Filter rows with mismatched values. See Filter Data.

filteroneof

Filter rows when value is one of

Filter rows that satisfy a condition. Variant: Filter rows that match any of the specified values. See Filter Data.

filterrange

Filter rows in range

Filter rows by their position. Variant: Filter rows within a range. See Filter Data.

filterstartswith

Filter rows when value starts with

Filter rows that satisfy a condition. Variant: Filter rows that starts with a specified value or pattern. See Filter Data.

flatten

Expand Arrays into rows

Converts each element in an Array into a new row. See Working with Arrays.

groupby

Group by

Group data and perform aggregated calculations on it. See Create Aggregations.

join

Join datasets

Adds additional columns from other data sources [join]. See Join Panel.

lowercase

Convert text to lowercase

Format text in columns. Variant: Convert text in column to lowercase. See Modify String Values.

leftpad

Pad text with leading characters

Format text in columns. Variant: Add the necessary number of characters to each value to make them of the same length. See Modify String Values.

merge

Merge columns

Concatenates the values from two or more columns into a new column [merge]. See Add Two Columns.

move

Move columns

Moves one or more columns before or after another column [move].

nest

Nest columns into objects

Converts columns into an Object or Array [nest]. See Working with Arrays.

pivot

Pivot table

Creates a new column for each unique value in a column [pivot]. See Pivot Data.

prefix

Add prefix to text

Format text in columns. Variant: Specify a prefix to be added at the beginning of each selected column name. See Modify String Values.

propercase

Convert text to Propercase

Format text in columns. Variant: Convert text in column to ProperCase. See Modify String Values.

removesymbols

Remove symbols from text

Format text in columns. Variant: Remove all non-alphanumerical characters from the text. See Remove Data.

removewhitespace

Remove whitespace from text

Format text in columns. Variant: Remove all whitespace found in the text. See Remove Data.

removeaccents