...
- In the Import Data page, navigate your environment to locate one of the files or tables that you wish to parameterize.
Click Create Dataset with Parameters.
D caption Create Dataset with Parameters
- Within the Define Parameterized Path, select a segment of text. Then select one of the following options:
- Add Datetime Parameter
- Add Variable
- Add Pattern Parameter - wildcards and patterns
- For more information on limitations, see Overview of Parameterization.
- If you need to navigate elsewhere, select Browse.
- Specify the parameter. Click Save.
Click Update matches. Verify that all of your preferred datasets are matching.
Info NOTE: If you are matching with more datasets than you wish, you should review your parameters.
Click Create.
The parameterized dataset is loaded. See Import Data Page.
A flow containing a dataset with parameters has additional options for managing them. See Flow View Page.
Add Datetime Parameter
Datetime parameters require the following elements:
...
Tip |
---|
Tip: Type |
Default Value: If the variable value is not overridden at execution time, this value is inserted in the variable location in the path.
...
Info |
---|
NOTE: A workspace administrator or project owner can create environment parameters. For more information, see Environment Parameters Page. |
Uses:
- Parameterized bucket names are very useful when you are moving flows between workspaces or projects. When the flow is imported into a new workspace, the environment parameter references the appropriate bucket name in the new workspace.
- If you change source buckets or move data to a new storage bucket, updating the paths to your objects can be as simple as changing the value of the environment parameter where your data is stored.
...
Environment Name | Source Bucket Name | Environment Parameter Value | ||
---|---|---|---|---|
Dev | MyCo_Dev |
| ||
Prod | MyCo_Prod |
|
For more information, see Overview of Parameterization. see Environment Parameters Page.
Add Pattern Parameter
In the screen above, you can see an example of pattern-based parameterization. In this case, you are trying to parameterize the two digits after the value: POS-r
.
...
- If disabled, the scan stops when the next slash (
/
) in the path is encountered. Folders are not matched. If enabled, the scan continues to any depth of folders.
Info NOTE: A high number of files and folders to scan can significantly increase the time required to load your dataset with parameters.
Example 1: all text files
Suppose your file and folder structure look like the following:
...
Info |
---|
NOTE: If regular expressions are poorly specified, they can create unexpected matches and results. Use them with care. For a list of limitations of regular expressions for parameterization, see Overview of Parameterization. |
The following regular expression matches the same two sources in the previous screen:
...
A
D s item | ||
---|---|---|
|
D s item | |||
---|---|---|---|
D s item | |||
|
|
...
This simpler syntax is easier to parse and performs the same match as the regular expression version.
For more information on
D s item | ||
---|---|---|
|
D s also | ||||
---|---|---|---|---|
|