Page tree

Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Published by Scroll Versions from space DEV and version next

D toc
D s ed
nottrue
editionsgdple
D s photon
 is an in-memory running environment that is hosted on the 
D s node
. This environment is initialized only when a job is queued for execution on it. Designed for small- to medium-sized jobs, it offers superior performance due to its location on the 
D s node
 and its in-memory processing.

When you choose to run a job in the 

D s webapp
D s photon
 is selected as the default running environment if it is available and the job size is estimated to small or medium.

Tip

Tip:

D s photon
is also used for sampling jobs that are configured to use the Quick Scan method. For more information, see Overview of Sampling.


Tip

Tip: In the Run Job page, select Photon to run the job on this running environment.

D s photon
 is enabled by default but can be disabled as needed.


Info

NOTE:

D s photon
may require enablement in your project of workspace. See Configure Running Environments.

Info

NOTE: Jobs that are executed on

D s photon
may be limited to run for a maximum of 10 minutes, after which they fail with a timeout error. If your job fails due to this limit, please switch to running the job on
D s dataflow
.

Info

NOTE:

D s photon
cannot process numeric values with more than 16 digits. Columns containing such values are converted to String values, and the digits beyond 16 are converted to 0.

Info

NOTE: When a recipe containing a user-defined function is applied to text data, any null characters cause records to be truncated during

D s photon
job execution. In these cases, please execute the job on Spark.

D s also
labelrunning_environment