Page tree

Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Spark: Executes the job using the Spark running environment.


Options


Profile results: Optionally, you can enable this option to generate a visual profile of your job results.

...

Info

NOTE: If you attempt to refresh the schema of a parameterized dataset based on a set of files, only the schema for the first file is checked for changes. If changes are detected, the other files are must contain those changes as well. This can lead to changes being assumed or undetected in later files and potential data corruption in the flow.

...