Page tree

Versions Compared


  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Published by Scroll Versions from space DEV and version r0822


By default, the platform ingests data from your relational datasources to the base storage layer for faster job execution. See Configure JDBC Ingestion.



hadoop principal to logged queries



Optionally, you can choose to enable appending the

D s item
itemuser identifier

Hadoop principal as a comment to the SQL queries that are written to your database logs.


NOTE: This feature only applies if you are connecting to a Hadoop cluster. Otherwise, no value is inserted if this feature is enabled.


Code Block
execute <unnamed>: SELECT * FROM "public"."artifacts" LIMIT 10 /* userId:<hadoopPrincipal> 1 */

In the above,


D s item


the value of the Hadoop principal is written in the comment.

These types of queries are logged for the following basic activities:

  • Data preview: when previewing data from a relational source, a query is executed against the database
  • Data import: when selecting a table to import
  • Data import using custom SQL:
    • Click Validate button.
    • Custom SQL execution.

This feature enables auditing of

D s item
itemuser activities
through your database logs in Hadoop-based environments.


  1. D s config
  2. Locate the following setting and set it to true:

    Code Block
    "feature.addUserIdToSQLQuery.enabled": false,
  3. Save your changes and restart the platform.

Enable Driver Logging

Optionally, you can enable the inclusion of log entries from the driver underlying a relational connection.