In your recipe steps, you can apply conditional logic to determine if transformational changes should occur. You can build logical tests into your transformations in multiple levels:
Through the Transform Builder, you can build conditional tests using if/then/else or case logic to manipulate on the data.
case
. true
or false
and specify values if true
(then) or if false
(else).true
.true
, a different value can be written.After the transformation is added to the recipe, actions can then be taken based on the values in this new column.
You can also apply conditional logical as part of your function definitions for other transformations.
For example, the following replaces values in the same column with IN
if they are greater than 0.5 or OUT
otherwise:
In the above, the token $col
is a reference back to the value defined for the column (testCol
in this case). However, you can replace it with a reference to any column in the dataset.
You can use the IF function in any transformation that accepts functional inputs. For more information, see IF Function.
However, these can become problematic to debug. Instead, you can use the CASE function to assist in building more complex logical trees. The following is more legible and easier to manage:
If test | Test | Output if true |
---|---|---|
If: | $col >= 0.75 | IN |
If above is false : | $col >= 0.35 | MAYBE IN |
If above is false : | default | OUT |
For more information, see CASE Function.
Logical operators can be applied to your function expressions to expand the range of your logical tests.
In the above example, suppose you have a second column called, Paid
, which contains Boolean values. You could expand the previous statement to include a test to see if Paid=true
:
The above performs a logical AND operation on the two expressions in each tested case. The logical operator is &&
.
You can also reference explicit functions to perform logical tests. The above might be replaced with the following:
Logic | Logical Operator | Logical Function |
---|---|---|
Logical AND | (exp1 && exp2) | AND(exp1,exp2) |
Logical OR | (exp1 || exp2) | OR(exp1,exp2) |
Logical NOT | !(exp1 == exp2) | NOT(exp1,exp2) |
Depending on the structure of your transformation and your preferences, either form may be used.