Page tree

Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Published by Scroll Versions from space DEV and version next

...

Type of ProfilerRequires Hadoop cluster?Supported Running EnvironmentDescription

Scala Spark Profiler

Yesall

Generates a profile on the

d-s-serverphoton
running environment using the Spark Job Service. Does not require any Spark installation on the cluster.

Tip

Tip: This is the best-performing profiler in most use cases.

d-s-serverphoton
Profiler

No

d-s-serverphoton

Default profiler when

d-s-serverphoton
running environment is enabled, and the Scala Spark Profiler has not been enabled.

...

By default, profiling jobs execute on the running environment where the transformation job was executed. You can configure the 

d-s-serverphoton
 running environment to execute profiling jobs as a separate job in the Spark running environment. This separation allows users to begin working with the transformed data while waiting for the profiling job to complete. 

...

When profiling is selected for jobs executing on the 

d-s-serverphoton
 running environment, their jobs are executed on the Spark running environment as a separate job.

...