...
In this example, you have three
| D s item | ||
|---|---|---|
|
| Environment Name | S3 Bucket Name |
|---|---|
| Dev | myco-s3-dev |
| Test | myco-s3-test |
| Prod | myco-s3-prod |
In your Dev workspace, you can create an environment parameter called the following:
...
| Tip |
|---|
Tip: If you are creating datasets using custom SQL, this method can be used for migrating flows between workspaces. If the flows reference imported datasets that use custom SQL, you only need to update the value of the environment parameter in the target workspace and reset the connection identifier in order to reconnect the imported flow to its data sources. |
| Environment Name | Database Name |
|---|---|
| Dev | myco-DB-dev |
| Test | myco-DB-test |
| Prod | myco-DB-prod |
In your Dev workspace, you can create the environment parameter as follows:
...
| Tip |
|---|
Tip: For best results when parameterizing directories in your file path, include the trailing slash ( |
Options:
You can choose to search nested folders for files that match your specified pattern.
Info NOTE: You cannot create multiple wildcard parameters when the Include nested folders option is selected. When this option is selected for the dataset, only one wildcard parameter is supported.
| Tip |
|---|
Tip: If your imported dataset is stored in a bucket, you can parameterize the bucket name, which can be useful if you are migrating flows between environments or must change the bucket at some point in the future. |
...
For each of the following types of parameter, you can apply override values as needed.
| Override Type | Description | ||
|---|---|---|---|
| dataset parameters | When you run a job, you can apply override values to variables for your imported datasets. See Run Job Page. | ||
| flow parameters | At the flow level, you can apply override values to flow parameters. These values are passed into the recipe and the rest of the flow for evaluation during recipe development and job execution.
| ||
| output parameters | When you define your output objects in Flow View, you can apply override values to the parameterized output paths on an as-needed basis when you specify your job settings. See Run Job Page. |
Order of Parameter Evaluation
...
