Page tree

Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Published by Scroll Versions from space DEV and version next

Sequences of operations that end-users execute in the

D s webapp
rtrue
 are rendered as commands in
D s lang
fulltrue
. When a job is executed, the
D s lang
 recipe of steps is executed against the entire dataset. In the following diagram, you can review the layers that execute
D s lang
 recipes across your dataset.

D caption
typefigure
Platform execution layers
  • D s lang
     recipe
    : End-users create these sequential recipes by performing point-and-click operations on sampled data in the application. These recipes are stored in the
    D s item
    itemdatabase
     and can be executed at any time against the full dataset.
  • D s lang
     compiler:
    • Dataflow Compiler: This component compiles your recipe into a set of commands that can be executed against the specified execution target.
    • Dataflow Optimizer: The optimizer reviews the set of compiled commands to perform general optimizations for the queries.
    • Target Optimization and Specialization: The
      D s lang
       compiler performs additional optimizations and addresses any special requirements depending on the execution target. 
  • Extensible Function Library: Optionally, developers can create user-defined functions using Java. 
  • Execution Environments: The
    D s platform
     supports a variety of environments for execution of jobs.