Page tree

 

Contents:


The Trifacta® platform provides the following major services. For each of the listed service, any relevant logs are listed.

The logging levels for many of these services can be modified through the Admin Settings page. See Configure Logging for Services.

Download Logs

Support logs

For support use, the most meaningful logs and configuration files can be downloaded from the application. Select Help menu > Download logs.

NOTE: If you are submitting an issue to  Trifacta Support, please download these files through the application.

For more information, see Download Logs Dialog.The admin version of this dialog enables downloading logs by timeframe, job ID, or session ID. For more information, see Admin Download Logs Dialog.

Log directory

System logs are maintained in the following directory:  /opt/trifacta/logs

Trifacta® administrators can access the logs through the Trifacta application. Use the following URL:

<hostname>:<port_number>/logs

Available logs

FilenameDescription
jobgroups/

Directory of logs for transformation jobs by Id.

Tip: If you are troubleshooting a failed job, please acquire the job logs from the Job Details page when you contact Trifacta Support. See Job Details Page.


jobs/Directory of logs for other kinds of jobs, such as sampling or ingest, by Id.
nginx/ Temporary storage for nginx server. No log files are stored here.
artifact-storage-service.access.logAccess logs for the artifact storage service.
artifact-storage-service.logApplication logs for the artifact storage service.
authorization-service.access.logAccess logs for the authorization service.
authorization-service.logApplication logs for the authorization service.
batch-job-runner.access.log

Access logs for the batch job runner service.

Batch job runner service manages transformation jobs and scheduling. More information is below.

batch-job-runner.job-status.logStatus information on batch job runner jobs.
batch-job-runner.logApplication logs for the batch job runner service.
configuration-service.access.log

Access logs for the configuration service service.

Configuration service is used for managing configuration that can be changed at runtime for different workspaces and users. Some of these settings are available through the Trifacta application. See Workspace Settings Page.

configuration-service.logApplication logs for the configuration service.
conversion-service.access.log

Access logs for the conversion service.

Conversion service is used for converting from various inputs formats and to various output formats.

conversion-service.logApplication logs for the conversion service.
data-service.access.log

Access logs for the data service.

Data service is used for interacting with relational sources. More information is below.

data-service.logApplication logs for the data service.
java-vfs-service.access.logAccess logs for the Java VFS service.
java-vfs-service.logApplication logs for the Java VFS service.
job-metadata-service.access.logAccess logs for the job metadata service.
job-metadata-service.logApplication logs for the job metadata service.
migration.log Application logs for database migrations performed for the webapp service.
ml_service.access.log

Access logs for the ml (machine-learning) service.

Machine learning service is used for predictive interaction, suggestion ranking, pattern profiling, pattern suggestions, and collecting user action logs. More information is below.

ml_service.logApplication logs for the ml (machine-learning) service.
nginx_service.logApplication logs for the nginx service. More information is below.
protobuf-events.logClient events around column values, user selections, and recipe editing.
proxy_access.logAccess logs for the nginx server.
proxy_error.logError logs for the nginx server.
scheduling-service.access.log

Access logs for the scheduling service.

Scheduling service is used for scheduling jobs at a specific time. More information is below.

scheduling-service.logApplication logs for the scheduling service.
secure-token-service.access.log

Access logs for the secure token service.

secure-token-service is used for securely storing tokens for some external services, such as Azure AD and Databricks.

secure-token-service.log

Application logs for the secure token service

spark-job-service.log

Application logs for the Spark job service.

Spark job service is used for interfacing with cluster-based Spark service to plan and execute Spark jobs. More information is below.

supervisord.log

Logs for the supervisord system service.

supervisord manages the starting, stopping, and restarting of services for the Trifacta platform. More information is below.

time-based-trigger-service.access.log

Access logs for the time-based trigger service.

Time-based trigger service is used for managing the triggers for scheduled jobs. More information is below.

time-based-trigger-service.logApplication logs for the time-based trigger service.
vfs-service.access.log

Access logs for the VFS service.

VFS service is used for managing loading of files from various supported datastores. More information is below.

vfs-service.logApplication logs for the VFS service.
webapp.access.log

Access logs for the Webapp service.

Webapp service serves the Trifacta application to users. More information is below.

webapp.logApplication logs for the Webapp service. More information is below.
webapp.sql-error.logError log for SQL issued from the Webapp service.
webworker.log

Event logs for webworkers running in browser clients.

Webworkers run in the background of a browser client's Trifacta session and are used for predictive interaction, suggestion ranking, pattern profiling, pattern suggestions, and collecting user action logs.

Artifact Storage Service

Description: Manages storage of feature-specific usage data, such as value mappings. 

Log FileCan Help With
artifact-storage-service-access.log

Access issues to the service.

artifact-storage-service.logTransactions with the database for the features that use it.

Authorization Service

Description: Manages access permissions for workspace objects. 

Log FileCan Help With
authorization-service-access.log

Access issues to the service.

authorization-storage-service.logTransactions with the database for the features that use it.

Batch Job Runner

Description: This service manages the tracking of jobs submitted to the backend running environment.

Log FileCan Help With
batch-job-runner.log
  • Service errors and crashes
  • Determine execution environment of the job. Search for:
    • LocalJobRunner = local execution in Photon
    • YARNRunner = execution in Spark
  • Communication errors back from environment
  • Status information on jobs
  • Status information on counts of job retries

For more information on this service, see Configure Batch Job Runner.

Configuration Service

Description: Service for managing configurations at the user, workspace, and system levels, which can be changed at runtime.

Log FileCan Help With
configuration-service-access.logIssues accessing the service.
configuration-service.logConfiguration problems.

Some configuration service options are surfaced in the Trifacta application. See Workspace Settings Page

Conversion Service

Description: Service converts some formats for input or output. For example, Microsoft Excel workbooks must be ingested through the conversion service and stored as separate CSVs for each worksheet. 

Log FileCan Help With
conversion-service-access.logIssues accessing the service.
conversion-service.logProblems with ingest jobs for datasets whose sources must be converted.

Data Service

Description: Service prepares queries against JDBC interfaces, using internal REST API calls.

Log FileCan Help With
data-service.log
  • Initialization of communications through JDBC interface
  • Query failures

For more information on this service, see Configure Data Service.

Java UDF Service

Description: Service enables the execution of Java-based user-defined functions within a transform recipe.

Log FileCan Help With
java-udf-service.log
  • Status of the service

Tip: You can pass through messages on errors through Logger to this log, which can assist in diagnosing issues.

For more information, see User-Defined Functions.

Java VFS Service

Description: Service manages metadata associated with jobs during execution.

Log FileCan Help With
java-vfs-service.log
  • Help with issues accessing data on ADLS Gen2
  • Status of the service

For more information, see Configure Java VFS Service.

Job Metadata Service

Description: Service manages metadata associated with jobs during execution.

Log FileCan Help With
job-metadata-service.log
  • Help with job phases and status
  • Status of the service

Machine Learning Service

Description: ML service provides machine learning capabilities for the platform. 

Log FileCan Help With
ml_service.log
  • This log is likely to contain information that is only useful if the ML service has crashed.

Migration

Description: Migration applies to database migrations executed as part of upgrading the platform. 

Log FileCan Help With
migration.log
  • Connectivity errors and other issues that may have occurred during migration.

Nginx Service

Description: Ngnix is a proxy server embedded in the platform that serves the web application and other resources. 

Log FileCan Help With
nginx_service.log
  • This log may be useful in identifying any warnings that occurred when the nginx services starts.
  • The nginx server may contain log information for the server that provides HTTP access.

Proxy

Description: The proxy (nginx) service manages requests from the user interface to the other components of the platform. 

Log FileCan Help With
proxy_access.log
  • Shows any requests made through the nginx to the port used by the Trifacta platform.
proxy_error.log
  • Contains any errors thrown by the nginx service when a request is made to the port used by the Trifacta platform.

 

Scheduling Service

Description: Handles all metadata related to scheduling.

Log FileCan Help With
scheduling-service.log
  • Schedule-related issues
scheduling-service.access.log
  • Gives information about accessed routes

Spark Job Service

Description: Service that manages jobs processed on Spark.

Log FileCan Help With
spark-job-service.log

Supervisord Server

Description: Process that starts, stops, and restarts services in the platform.

Log FileCan Help With
supervisord.log
  • Status information from platform services

Time-Based Trigger Service

Description: Handles all metadata related to the trigger service

Log FileCan Help With
time-based-trigger-service.log
  • schedules not triggering correctly
time-based-trigger-service.access.log
  • Gives information about accessed routes

VFS Service

Description: Loads data from the various filesystems supported by the platform, both in the front-end user interface and in batch mode when the Trifacta Photon running environment is enabled. For more information, see Running Environment Options.

Log FileCan Help With
vfs-service.log
  • Client connection issues
  • Status issues with backend components
  • Information on batch jobs that cannot be started

Webapp Service

Description: Loads data from the various filesystems supported by the platform in the front-end user interface.

Log FileCan Help With
webapp.log
  • Client connection issues
  • Status issues with backend components
  • Information on batch jobs that cannot be started

Additional logs

Job logs

The following sources of information may provide information related to job status and performance:

  • job log
  • spark log
  • cdf script
  • yarn application logs
    (if log aggregation is enabled)
  • platform configuration file
    ( trifacta-conf.json)
  • batch job runner log
  • spark service log
  • hadoop conf directory 

This page has no comments.