System Services and Logs

Contents:

Expand all Collapse all

Contents:

The Designer Cloud Powered by Trifacta® platform provides the following major services. For each of the listed service, any relevant logs are listed.

The logging levels for many of these services can be modified through the Admin Settings page. See Configure Logging for Services.

Download Logs

System logs are maintained in the following directory: /opt/trifacta/logs

Administrators of the platform can now access all log files through the following URL:

http://<hostname>:<port_number>/logs

This endpoint displays for download all log files stored in the /opt/trifacta/logs directory.

Batch Job Runner

Description: This service manages the tracking of jobs submitted to the backend running environment.

Log File	Can Help With
`batch-job-runner.log`	Service errors and crashes Determine execution environment of the job. Search for: `LocalJobRunner` = local execution `YARNRunner` = execution in Hadoop Communication errors back from environment Status information on jobs Status information on counts of job retries

Data Service

Description: Service prepares queries against JDBC interfaces, using internal REST API calls.

Log File	Can Help With
`data-service.log`	Initialization of communications through JDBC interface Query failures

Diagnostic Server

Description: Diagnostic Server provides status and executes tests against the various components and services of the platform.

This log file is stored in the following location: /opt/trifacta/logs/diagnostic-server

Log File	Can Help With
`diagnostic-server.log`	Identifying why specific diagnostic tests may have failed

Java UDF Service

Description: Service enables the execution of Java-based user-defined functions within a transform recipe.

Log File	Can Help With
`java-udf-service.log`	Status of the service Tip: You can pass through messages on errors through Logger to this log, which can assist in diagnosing issues. See Java UDFs.

Machine Learning Service

Description: ML service provides machine learning capabilities for the platform.

Log File	Can Help With
`ml_service.log`	This log is likely to contain information that is only useful if the ML service has crashed.

Nginx Service

Description: Ngnix is a proxy server embedded in the platform that serves the web application and other resources.

Log File	Can Help With
`nginx_service.log`	This log may be useful in identifying any warnings that occurred when the nginx services starts. The `nginx` server may contain log information for the server that provides HTTP access.

Proxy

Description: The proxy (nginx) service manages requests from the user interface to the other components of the platform.

Log File	Can Help With
`proxy_access.log`	Shows any requests made through the nginx to the port used by the Designer Cloud Powered by Trifacta platform.
`proxy_error.log`	Contains any errors thrown by the nginx service when a request is made to the port used by the Designer Cloud Powered by Trifacta platform.

Scheduling Service

Description: Handles all metadata related to scheduling

Log File	Can Help With
`scheduling-service.log`	Schedule-related issues
`scheduling-service.access.log`	Gives information about accessed routes

Spark Job Service

Description: Service that manages jobs processed on Spark.

Log File	Can Help With
`spark-job-service.log`	Status of the service Debugging issues with Spark jobs See Configure for Spark.

Supervisord Server

Description: Process that starts, stops, and restarts services in the platform.

Log File	Can Help With
`supervisord.log`	Status information from platform services

Time-Based Trigger Service

Description: Handles all metadata related to the trigger service

Log File	Can Help With
`time-based-trigger-service.log`	schedules not triggering correctly
`time-based-trigger-service.access.log`	Gives information about accessed routes

VFS Service

Description: Loads data from the various filesystems supported by the platform, both in the front-end user interface and in batch mode when Photon running environment is enabled. For more information, see Running Environment Options.

Log File	Can Help With
`vfs-service.log`	Client connection issues Status issues with backend components Information on batch jobs that cannot be started

Webapp Service

Description: Loads data from the various filesystems supported by the platform in the front-end user interface.

Log File	Can Help With
`webapp.log`	Client connection issues Status issues with backend components Information on batch jobs that cannot be started

Additional logs

Job logs

The following sources of information may provide information related to job status and performance:

job log
spark log
cdf script
yarn application logs
(if log aggregation is enabled)
platform configuration file
(trifacta-conf.json)
batch job runner log
spark service log
hadoop conf directory
(if accessible)

Send Feedback

Page tree