Page tree

Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Published by Scroll Versions from space DEV and version r092

...

Info

NOTE: Avoid creating datasets with parameters where individual files or tables have differing schemas. Either import these sources separately and then correct in the application before performing a union on the datasets, or make corrections in the source application to standardize the schemas.

 

When working with datasets with parameters, it may be useful to do the following if you expect the underlying datasets to be less than 100% consistent with each other. 

...

For example, suppose you have two environments: Dev and Prod. You can create an environment parameter called env.sourceBucketName to store the name of the bucket from which all data in the workspace or project is imported.

Environment NameSource Bucket NameEnvironment Parameter Value
DevMyCo_Dev
Code Block
$env.sourceBucketName = 'MyCo_Dev'
ProdMyCo_Prod
Code Block
$env.sourceBucketName = 'MyCo_Prod'

For more information, see Environment Parameters Page.

...