| Excerpt |
|---|
As part of your data cleansing steps, you might need to remove duplicate rows of data from your dataset. |
Validate Duplicate Data
In some cases, it might be acceptable to have duplicated data. For example, additional records using the same primary key might be included in a dataset as amendments or detail records.
...
| D trans |
|---|
| Type | step |
|---|
| p01Name | Formula type |
|---|
| p01Value | Single row formula |
|---|
| p02Name | Formula |
|---|
| p02Value | LOWER(Description) |
|---|
| SearchTerm | New formula |
|---|
|
For more information, see Normalize Numeric Values.Deduplicate Rows Based on a Primary Key
...
| D s also |
|---|
| inCQL | true |
|---|
| label | (label = "cleanse_tasksdeduplicate") |
|---|
|
