...

By default, the platform ingests data from your relational datasources to the base storage layer for faster job execution. See Configure JDBC Ingestion.

Append

...

hadoop principal to logged queries

...

...

Optionally, you can choose to enable appending the

D s item
item user identifier

Hadoop principal as a comment to the SQL queries that are written to your database logs.

Info
NOTE: This feature only applies if you are connecting to a Hadoop cluster. Otherwise, no value is inserted if this feature is enabled.

Example:

Code Block
execute <unnamed>: SELECT * FROM "public"."artifacts" LIMIT 10 /* userId:<hadoopPrincipal> 1 */

In the above,

...

D s item
item userId

...

the value of the Hadoop principal is written in the comment.

These types of queries are logged for the following basic activities:

• Data preview: when previewing data from a relational source, a query is executed against the database
• Data import: when selecting a table to import
• Data import using custom SQL:
  • Click Validate button.
  • Custom SQL execution.

This feature enables auditing of

D s item
item user activities

through your database logs in Hadoop-based environments.

Steps:

1. D s config

2. Locate the following setting and set it to true:

   Code Block
   "feature.addUserIdToSQLQuery.enabled": false,

3. Save your changes and restart the platform.

Enable Driver Logging

Optionally, you can enable the inclusion of log entries from the driver underlying a relational connection.

...