Page tree

Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Published by Scroll Versions from space DEV and version next

...

  1. Run-time overrides: Parameter values specified at run-time for jobs. 

    Info

    NOTE: The override value is applied to all subsequent operations in the platform. When a job is submitted to the job queue, any overrides are applied at that time. Changes to override values do not affect jobs that are already in flight.

    Info

    NOTE: You can specify run-time override values when executing jobs through the APIs. See API Workflow - Run Job.

    See Run Job Page.

  2. Flow level overrides: At the flow level, you can specify override values, which are passed into the flow's objects. These values can be overridden by overrides set in the above locations. See Manage Parameters Dialog.
  3. Default values: If no overrides are specified, the default values are applied:
    1. Imported datasets: See Create Dataset with Parameters.
    2. Flow parameters: See Manage Parameters Dialog.
    3. Output parameters: See Run Job Page.
  4. Inherited (upstream) values: Any parameter values that are passed into a flow can be overridden by any matching override specified within the downstream flow.

Run Jobs with Parameters

When running a job based on datasets with parameters, results are written into separate folders for each parameterized path. 

Info

NOTE: During job execution, a canary file is written for each set of results to validate the path. For datasets with parameters, if the path includes folder-level parameterization, a separate folder is created for each parameterized path. During cleanup, only the the canary files and the original folder path are removed. The parameterized folders are not removed. This is a known issue.


...

Runtime Parameter Overrides

...