This documentation applies to Release 4.0. As of Release 4.1, the Pig running environment is no longer available. You can follow these steps on a pre-Release 4.1 instance to convert your Python UDFs to Java UDFs. This content will be removed in a future release.
As Release 4.1, Python UDFs are no longer available in the platform. You must transition or author UDFs in Java. Details are below.
In Release 4.0 introduces Spark as the default running environment for Hadoop job execution. This environment does not support the execution of Python UDFs.
NOTE: Environments that have been upgraded to Release 4.0 are automatically switched to using Spark as the default running environment. To complete these steps, you must re-enable Pig as the default running environment, which is described below.
This section describes the general process for converting existing Python UDFs to Java UDFs in a production environment.
NOTE: Development of user-defined functions is a developer-level skill.
For Release 4.1 upgrade:
In previous releases, the Python UDF documentation included examples on how to create the TODAY() and NOW() functions. These functions are now available through the application by default.