Page tree

 

Support | BlogContact Us | 844.332.2821

Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

After results have been successfully generated and profiling has been enabled, you can explore a visualization of the generated results in the Results Summary page. See Results Summary Page.

Profiling Engine

Decoupled from the user interface, the profiling engine performs the calculations required to power the visualizations before job execution and after the job results have been generated.

...

Info

NOTE: When you choose to profile your results, you are creating two distinct tasks: 1) run your transform recipe against your source and 2) profile the results. Due to the computational complexity of generating the interactive results, a profiling task often takes longer to complete than a transformation task and is therefore an optional element of a job run.

Exact vs. Approximate Metrics in Visual Profiles

Generally, visual profiles represented in the user interface, in places like column histograms and column details, are exact measurements against the current sample.

On generated results, visual profiles tend favor approximations. 

Below, you can review details on how metrics are calculated in visual profiling performed in different areas of the platform.

User Interface

The UI leverages the Photon running environment when displaying visual profiles on sampled data.

Info

NOTE: Profiles are executed on the currently sampled data. Results may vary when the full transformation job is executed.

Metric TypeMeasurement
Frequency (top-k)Exact
Unique value countsExact
Numerical histogramsExact
Simple statistics (mean, stdev, min, max)Exact
QuartilesExact

Photon Running Environment

When profiling jobs are executed on the 

D s server
, they leverage the server-side version of the Photon running environment.

Metric TypeMeasurement
Frequency (top-k)Approximate
Numerical histogramsApproximate
Simple statistics (mean, stdev, min, max)Exact
QuartilesExact