...
Spark: Executes the job using the Spark running environment.
Options
Profile results: Optionally, you can enable this option to generate a visual profile of your job results.
...
Info |
---|
NOTE: If you attempt to refresh the schema of a parameterized dataset based on a set of files, only the schema for the first file is checked for changes. If changes are detected, the other files are must contain those changes as well. This can lead to changes being assumed or undetected in later files and potential data corruption in the flow. |
...