The following example demonstrates functions that can be used to clean up strings. These functions include the following:
Source:
In the following (space) and (tab) indicate space keys and tabs, respectively. Carriage return and newline characters are also supported by whitespace functions.
| Strings | source |
|---|
| String01 | this source(space)(space) |
| String02 | (tab)(tab)this source |
| String03 | (tab)(tab)this source(space)(space) |
| String04 | this source's? |
| String05 | Why, you @#$%^&*()! |
| String06 | this söurce |
| String07 | (space)this söurce |
| String08 | à mañana |
Transformation:
The following transformation steps generate new columns using each of the string cleanup functions:
| D trans |
|---|
| RawWrangle | true |
|---|
| p03Value | 'trim_source' |
|---|
| Type | step |
|---|
| WrangleText | derive type:single value: TRIM(source) as: 'trim_source' |
|---|
| p01Name | Formula type |
|---|
| p01Value | Single row formula |
|---|
| p02Name | Formula |
|---|
| p02Value | TRIM(source) |
|---|
| p03Name | New column name |
|---|
| SearchTerm | New formula |
|---|
|
| D trans |
|---|
| RawWrangle | true |
|---|
| p03Value | 'removewhitespace_source' |
|---|
| Type | step |
|---|
| WrangleText | derive type:single value: REMOVEWHITESPACE(source) as: 'removewhitespace_source' |
|---|
| p01Name | Formula type |
|---|
| p01Value | Single row formula |
|---|
| p02Name | Formula |
|---|
| p02Value | REMOVEWHITESPACE(source) |
|---|
| p03Name | New column name |
|---|
| SearchTerm | New formula |
|---|
|
| D trans |
|---|
| RawWrangle | true |
|---|
| p03Value | 'removesymbols_source' |
|---|
| Type | step |
|---|
| WrangleText | derive type:single value: REMOVESYMBOLS(source) as: 'removesymbols_source' |
|---|
| p01Name | Formula type |
|---|
| p01Value | Single row formula |
|---|
| p02Name | Formula |
|---|
| p02Value | REMOVESYMBOLS(source) |
|---|
| p03Name | New column name |
|---|
| SearchTerm | New formula |
|---|
|
Results:
| Strings | source | removesymbols_source | removewhitespace_source | trim_source |
|---|
| String01 | this source(space)(space) | this source(space)(space) | thissource | this source |
| String02 | (tab)(tab)this source | (tab)(tab)this source | thissource | this source |
| String03 | (tab)(tab)this source(space)(space) | (tab)(tab)this source(space)(space) | thissource | this source |
| String04 | this source's? | this sources | thissource's? | this source's? |
| String05 | "Why, you @#$%^&*()!" | Why you | Why,you@#$%^&*()! | Why, you @#$%^&*()! |
| String06 | this söurce | this söurce | thissöurce | this söurce |
| String07 | (space)this söurce | (space)this söurce | thissöurce | this söurce |
| String08 | à mañana | à mañana | àmañana | à mañana |
