Configure Publishing to Cloudera Navigator

Contents:

Expand all Collapse all

Contents:

This integration is currently blocked by the following third-party known issue: Cloudera Navigator OPSAPS-39589.

This functionality was last confirmed to behaving correctly in the following deployment only:

Designer Cloud Powered by Trifacta platform Release 4.0 and earlier
Cloudera 5.8.x
Cloudera Navigator 2.7.1

For more information, please contact Cloudera Support.

The Designer Cloud Powered by Trifacta® platform can optionally publish metadata about recipe and jobs to Cloudera Navigator, which provides data governance over the Cloudera cluster. This section describes how to enable and configure this integration.

Cloudera Navigator is an integrated data management solution for the Cloudera platform, providing security, governance, discovery, and analysis across diverse datasets in the cluster. For more information, see https://www.cloudera.com/resources/datasheet/cloudera-navigator-datasheet.html.

When this integration is enabled, recipe and job information can be published for all jobs executed through Pig.

NOTE: This method of publishing works only for jobs executed on Pig. It does not work for jobs executed on the Spark running environment.

Publishing Behavior

When this feature is enabled, the following behaviors are applied to publishing:

When a job completes on the Hadoop Pig running environment, the Designer Cloud Powered by Trifacta platform automatically attempts to publish the link to the corresponding Alteryx job to Navigator.
If the attempt is successful, there is no need to execute any additional publishing to Navigator.
If the publishing fails or if you are trying to publish to Navigator a Alteryx job that predates enabling this feature, you can execute publication manually. See Export Results Window.

Pre-requisites

NOTE: The integration does not support publishing of Spark jobs to Navigator. This is a known issue.

The Designer Cloud Powered by Trifacta platform must be installed, configured, and integrated with an existing instance of the Cloudera platform. Please see the Cloudera Navigator documentation for additional details.
1. Cloudera 5.8.x supported only.
2. Cloudera Navigator 2.7.1 or later supported.
The Alteryx node must have the Cloudera Manager port opened. The default port is 7187.
You must have a Navigator user account with write permissions into the appropriate Navigator project.
To enable SSL use:

NOTE: CDH 5.8 is required for use with SSL with Cloudera Navigator.
1. A Java keystore and a sample CA certificate must be created on the node hosting Cloudera Manager.
2. A valid, self-signed certificate must be created on the node hosting Cloudera Manager.
3. In the order listed, the above certificates must be imported into the Java keystore.
4. Retain the server path and the passwords for the keystore and certificates.
5. For more information, see the documentation that was provided for your Cloudera Manager release.

Enable Navigator Publish

Please complete the following steps to enable publication to Cloudera Navigator.

You can apply this change through the Admin Settings Page (recommended) or trifacta-conf.json. For more information, see Platform Configuration Methods.
Locate the clouderaNavigator properties.

Edit the following properties:

Property	Description
`"clouderaNavigator.baseURL"`	Base URL of the Navigator instance where you are publishing. NOTE: The port number must be specified as part of the `baseURL` . Default value is `7187` .
`"clouderaNavigator.namespace"`	Namespace in Navigator where metadata is published.
`"clouderaNavigator.enabled"`	When set to `true`, publication to Navigator is enabled.
`"clouderaNavigator.username"`	Username of the Navigator account to use to connect.
`"clouderaNavigator.password"`	Password of the Navigator account

If you are using HTTPS to connect to Cloudera Navigator, additional configuration is required. Otherwise, set clouderaNavigator.https.enabled to false.
Save the file.

Additional Configuration for SSL

To enable communication over SSL with Cloudera Navigator, please complete the following steps in Cloudera Manager and on the Alteryx node.

NOTE: Before you begin, you must create valid certificates and import them into the Java keystore in the node hosting Cloudera Manager.

Steps:

Launch Cloudera Manager.
Select MGMT.
Click Configuration.
Click Scope > Navigator Metadata Server Category > Security.
Set Enable TLS/SSL for Navigator Metadata Server to true.
Set TLS/SSL for Navigator Metadata Server to the path where the Java keystore was created. The following is the default path:
```
/opt/cm_keystore.jks
```
Set TLS/SSL Keystore File Password to the password to the Java keystore.
Set TLS/SSL Keystore Key Password to the password to the certificate.
Restart the MGMT service.
The JKS file that you created must be transferred to an accessible location on the Alteryx node.
On the Alteryx node, edit trifacta-conf.json .
Edit the following properties:
```
  "clouderaNavigator": {
    "https": {
      "trustStore": {
        "type": "jks",
        "location": "/path/to/jks/file"
      },
      "enabled": false
    },
```
Property Description
type Set this value to jks.
location
Specify the path on the Alteryx node to the JKS file.
enabled To enable SSL access, set this value to true.
Change the baseURL value to use HTTPS.
Save the file and restart the platform. See Start and Stop the Platform.

Validate

Steps:

If you haven't done so already, r estart the platform to apply the configuration changes. See Start and Stop the Platform.
Open a dataset in the Transformer Page.
Click Run Job.
Select Run with Hadoop.
When the job completes, click the Export Results in the Job Results window.
In the Export Results window, click Publish under Publish to Cloudera Navigator. See Export Results Window.
A success message is displayed.
Click the displayed links to verify the results inside Cloudera Navigator.
1. You may need to provide a username and password.
2. There may be a short delay in the results appearing in Cloudera Navigator.

Troubleshooting

Error - Requested data was not found: Pig job info for job '20' not found

When you attempt to publish through the Export Results window and receive this error, you have used a running environment other than Pig. Please re-execute the job using Hadoop Pig.

Send Feedback

Page tree