Page tree

Versions Compared


  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Published by Scroll Versions from space DEV and version next


(required) Internal identifier for the object whose results you wish to generate. The recipes of all preceding datasets on which this dataset depends are executed as part of the job.
runParameters.overridesUse this section specify key-value pairs for parameter overrides to be applied during job execution.

(required, if first time running the job) Indicates the running environment on which the job is executed. Accepted values:

  • photon
  • spark - Spark job on the integrated Hadoop cluster
  • databricksSpark - Spark implementation on Azure Databricks

For more information, see Running Environment Options.


(required, if first time running the job) When set to true, a visual profile of the job is generated as specified by the profiling options for the platform. See Profiling Options.

overrides.writesettings(required, if first time running the job) These settings define the publishing options for the job. See below.

(optional) If this value is set to null, then the job does not show up in the Job Details page.

If set to cli, the job appears as a CLI job.

See Job Details Page.