System Services and Logs

...

Log File	Can Help With
`batch-job-runner.log`	Service errors and crashes Determine execution environment of the job. Search for: `LocalJobRunner` = local execution in Photon `YARNRunner` = execution in HadoopSpark Communication errors back from environment Status information on jobs Status information on counts of job retries

...

Description: Service enables the execution of Java-based user-defined functions within a transform recipe.

Log File Can Help With

java-udf-service.log

Status of the service

Tip
Tip: You can pass through messages on errors through Logger to this log, which can assist in diagnosing issues. See Java UDFs.

Machine Learning Service

Description: ML service provides machine learning capabilities for the platform.

Log File	Can Help With
`ml_service.log`	This log is likely to contain information that is only useful if the ML service has crashed.

Nginx Service

Description: Ngnix is a proxy server embedded in the platform that serves the web application and other resources.

Log File	Can Help With
`nginx_service.log`	This log may be useful in identifying any warnings that occurred when the nginx services starts. The `nginx` server may contain log information for the server that provides HTTP access.

Proxy

Description: The proxy (nginx) service manages requests from the user interface to the other components of the platform.

Log File Can Help With

proxy_access.log

Shows any requests made through the nginx to the port used by the
D s platform
.

proxy_error.log

Contains any errors thrown by the nginx service when a request is made to the port used by the
D s platform
.

Scheduling Service

Description: Handles all metadata related to scheduling

Log File	Can Help With
`scheduling-service.log`	Schedule-related issues
`scheduling-service.access.log`	Gives information about accessed routes

Spark Job Service

Description: Service that manages jobs processed on Spark.

Log File	Can Help With
`spark-job-service.log`	Status of the service Debugging issues with Spark jobs See Configure for Spark.

Supervisord Server

Description: Process that starts, stops, and restarts services in the platform.

Log File	Can Help With
`supervisord.log`	Status information from platform services

Time-Based Trigger Service

Description: Handles all metadata related to the trigger service

Log File	Can Help With
`time-based-trigger-service.log`	schedules not triggering correctly
`time-based-trigger-service.access.log`	Gives information about accessed routes

VFS Service

Description: Loads data from the various filesystems supported by the platform, both in the front-end user interface and in batch mode when the

d-s-serverphoton

running environment is enabled. For more information, see Running Environment Options.

Log File	Can Help With
`vfs-service.log`	Client connection issues Status issues with backend components Information on batch jobs that cannot be started

Webapp Service

Description: Loads data from the various filesystems supported by the platform in the front-end user interface.

Log File	Can Help With
`webapp.log`	Client connection issues Status issues with backend components Information on batch jobs that cannot be started

Additional logs

Job logs

The following sources of information may provide information related to job status and performance:

job log
spark log
cdf script
yarn application logs
(if log aggregation is enabled)
platform configuration file
(
D s triconf
path full
)
batch job runner log
spark service log
hadoop conf directory
(if accessible)

Page tree

Versions Compared

Old Version 1

New Version Current

Key