When you upgrade to a new version of
Changes for Release 6.0
In the next release of
Search your CLI scripts for:
For references to this type of job, replace with one of the following references, depending on your deployment:
Job Type Value Description
Runs job in the Spark running environment.
Runs jobs in the default running environment for the Hadoop cluster. For this release, that environment is Spark. This setting future-proofs against subsequent changes to the default Hadoop running environment.
Runs job on the
. This setting is only recommended for smaller jobs.
- Save your scripts.
- Run an example of each on your upgraded Release 4.1 instance.
Photon, which is the default execution engine on the
NOTE: If your CLI scripts do not specify a
Otherwise, you must review your scripts and manually specify a
The above option instructs the CLI to execute the job on the default running environment for the integrated Hadoop cluster.
- For upgrading customers who have not enabled Spark, the job is executed on Pig, as in previous releases.
- In a future release, when the Pig running environment is deprecated, this setting will still apply to the default running environment (Spark), and your scripts will not need to be updated.
NOTE: If you are upgrading from a previous version in which the
For Release 3.1.1, the messages delivered back to standard output and in the JSON response from the