Page tree

 

Contents:


The Trifacta® platform provides the following major services. For each of the listed service, any relevant logs are listed.

The logging levels for many of these services can be modified through the Admin Settings page. See Configure Logging for Services.

Download Logs

System logs are maintained in the following directory:  /opt/trifacta/logs

Administrators of the platform can now access all log files through the Trifacta application. For more information, see Admin Settings Page.

Batch Job Runner

Description: This service manages the tracking of jobs submitted to the backend running environment.

Log FileCan Help With
batch-job-runner.log
  • Service errors and crashes
  • Determine execution environment of the job. Search for:
    • LocalJobRunner = local execution in Photon
    • YARNRunner = execution in Spark
  • Communication errors back from environment
  • Status information on jobs
  • Status information on counts of job retries

Data Service

Description: Service prepares queries against JDBC interfaces, using internal REST API calls.

Log FileCan Help With
data-service.log
  • Initialization of communications through JDBC interface
  • Query failures

Java UDF Service

Description: Service enables the execution of Java-based user-defined functions within a transform recipe.

Log FileCan Help With
java-udf-service.log
  • Status of the service

Tip: You can pass through messages on errors through Logger to this log, which can assist in diagnosing issues. See Java UDFs.

Machine Learning Service

Description: ML service provides machine learning capabilities for the platform. 

Log FileCan Help With
ml_service.log
  • This log is likely to contain information that is only useful if the ML service has crashed.

Nginx Service

Description: Ngnix is a proxy server embedded in the platform that serves the web application and other resources. 

Log FileCan Help With
nginx_service.log
  • This log may be useful in identifying any warnings that occurred when the nginx services starts.
  • The nginx server may contain log information for the server that provides HTTP access.

Proxy

Description: The proxy (nginx) service manages requests from the user interface to the other components of the platform. 

Log FileCan Help With
proxy_access.log
  • Shows any requests made through the nginx to the port used by the Trifacta platform.
proxy_error.log
  • Contains any errors thrown by the nginx service when a request is made to the port used by the Trifacta platform.

 

Scheduling Service

Description: Handles all metadata related to scheduling

Log FileCan Help With
scheduling-service.log
  • Schedule-related issues
scheduling-service.access.log
  • Gives information about accessed routes

Spark Job Service

Description: Service that manages jobs processed on Spark.

Log FileCan Help With
spark-job-service.log

Supervisord Server

Description: Process that starts, stops, and restarts services in the platform.

Log FileCan Help With
supervisord.log
  • Status information from platform services

Time-Based Trigger Service

Description: Handles all metadata related to the trigger service

Log FileCan Help With
time-based-trigger-service.log
  • schedules not triggering correctly
time-based-trigger-service.access.log
  • Gives information about accessed routes

VFS Service

Description: Loads data from the various filesystems supported by the platform, both in the front-end user interface and in batch mode when the Trifacta Photon running environment is enabled. For more information, see Running Environment Options.

Log FileCan Help With
vfs-service.log
  • Client connection issues
  • Status issues with backend components
  • Information on batch jobs that cannot be started

Webapp Service

Description: Loads data from the various filesystems supported by the platform in the front-end user interface.

Log FileCan Help With
webapp.log
  • Client connection issues
  • Status issues with backend components
  • Information on batch jobs that cannot be started

Additional logs

Job logs

The following sources of information may provide information related to job status and performance:

  • job log
  • spark log
  • cdf script
  • yarn application logs
    (if log aggregation is enabled)
  • platform configuration file
    ( trifacta-conf.json)
  • batch job runner log
  • spark service log
  • hadoop conf directory
    (if accessible)

 

This page has no comments.