NOTE: Avoid creating datasets with parameters where individual files or tables have differing schemas. Either import these sources separately and then correct in the application before performing a union on the datasets, or make corrections in the source application to standardize the schemas.
When working with datasets with parameters, it may be useful to do the following if you expect the underlying datasets to be less than 100% consistent with each other.
For example, suppose you have two environments: Dev and Prod. You can create an environment parameter called
env.sourceBucketName to store the name of the bucket from which all data in the workspace or project is imported.
|Environment Name||Source Bucket Name||Environment Parameter Value|
For more information, see Environment Parameters Page.