When your dataset is initially loaded into the Transformer page, one or more of these transforms may be automatically added to your recipe to transform it into easy-to-use tabular data.
For more information, see Initial Parsing Steps.
|Manage Columns||These transforms assist in adding, removing, or changing the contents of the columns in your dataset.|
|Manage Rows||Row-based transforms allow you to remove duplicate rows or keep or delete rows based on conditional expressions.|
|Search and Replace||Use these transforms to locate patterns in your data and, if needed, to replace them.|
|Nested Data||These transforms can be used to nest or unnest your data.|
|Aggregation||These transforms enable you to perform aggregated analysis on your dataset using group-based aggregation functions.|
|Other||Miscellaneous transforms that do not fit into any of the other categories.|
The following are the available transforms.
|Aggregate Transform||Aggregation||The |
In the Transform Editor, click the Tools ( ) icon. Then, select Aggregate .
|Comment Transform||Other||Inserts a non-functional comment as a recipe step.|
|Countpattern Transform||Search and Replace||Counts the number of instances of a specified pattern in a column and writes that value into a newly generated column. Source column is unchanged.|
|Deduplicate Transform||Manage Rows||Removes exact duplicate rows from your dataset. Duplicate rows are identified by exact matches between values. For example, two strings with different capitalization do not match.|
|Delete Transform||Manage Rows||Deletes a set of rows in your dataset, based on a condition specified in the ||Select one or more rows in the data grid. The |
|Derive Transform||Manage Columns||Generate a new column where the values are the output of the |
|Drop Transform||Manage Columns||Removes the specified column or columns permanently from your dataset.|
Select Drop from the column drop-down.
Select one or more columns in the data grid. The
|Extract Transform||Search and Replace||Extracts a subset of data from one column and inserts it into a new column, based on a specified string or pattern. The source column in unmodified.|
|Extractkv Transform||Search and Replace|
Extracts key-value pairs from a source column and writes them to a new column. Source column must be of String type, although the data can be formatted as other data types.
|Extractlist Transform||Search and Replace||Extracts a set of values based on a specified pattern from a source column of any data type. The generated column contains an array of occurrences of the specified pattern. While the new column contains array data, the data type of the new column is sometimes inferred as String.|
|Flatten Transform||Nested Data||Unpacks array data into separate rows for each value.|
|Header Transform||Initial Parsing||Uses one row from the dataset sample as the header row for the table. Each value in this row becomes the name of the column in which it is located.||This transform might be automatically added to the beginning of your recipe. See Initial Parsing Steps.|
|Keep Transform||Manage Rows||Retains a set of rows in your dataset, which are specified by the conditional in the ||Select one or more rows in the data grid. The |
|Merge Transform||Manage Columns||Merges two or more columns in your dataset to create a new column of String type. Optionally, you can insert a delimiter between the merged values.|
|Move Transform||Manage Columns||Moves the specified column or columns before or after another column in your dataset.|
|Nest Transform||Nested Data||Creates a map an Object or array Array of values using column names and their values as key-value pairs for one or more columns. Generated column type is determined by the |
|Pivot Transform||Nested Data|
|Rename Transform||Manage Columns||Renames a column to a specified name.||Select Rename from the column drop-down.|
|Replace Transform||Search and Replace||Replaces values within the specified column or columns based on the string literal, pattern, or location within the cell value, as specified in the transform.||Select a value in a cell in the data grid. This transform is typically one of the suggestions.|
|Set Transform||Search and Replace||Replaces all values in the specified column with the specified value, which can be a literal or an expression. You can specify an optional ||Select a value in a cell in the data grid. This transform is typically one of the suggestions.|
|Settype Transform||Manage Columns||Sets the data type of the specified column. This transform does not modify the source values. The data in the column is re-inferred against the specified data type, which can change the results of column profiling.||Select a new data type from the icon on the left side of the column header.|
|Split Transform||Initial Parsing||Splits the specified column into separate columns of data based on the delimiters in the transform. Delimiters can be specified in a number of methods described below.||This transform might be automatically added to the beginning of your recipe. See Initial Parsing Steps .|
|Splitrows Transform||Initial Parsing||Splits a column of values into separate rows of data based on the specified delimiter. You can split rows only on String literal values. Pattern-based row splitting is not supported.||This transform might be automatically added to the beginning of your recipe. See Initial Parsing Steps .|
|Unnest Transform||Nested Data|
Unpacks nested data from an array Array or map Object column to create new rows or columns based on the keys in the source data. This transform works differently on columns of Object or Array or Map type.
|This transform might be automatically added to the beginning of your recipe. See Initial Parsing Steps .|
|Unpivot Transform||Nested Data||Reshapes the layout of data by merging one or more columns into key and value columns. Keys are the names of input columns, and the values are the cell values from the source columns. Rows of data are duplicated, once for each input column.|
|Valuestocols Transform||Manage Columns||For each unique value in a column, a separate column is created. For each row that contains the value in the source column, an indicator value is inserted in the new column. This value can be a literal value or the output of a function. If no indicator value is generated, a null value is written.|
|Window Transform||Aggregation||The |