Page tree

Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Published by Scroll Versions from space DEV and version next

...

Log FileCan Help With
batch-job-runner.log
  • Service errors and crashes
  • Determine execution environment of the job. Search for:
    • LocalJobRunner = local execution in Photon
    • YARNRunner = execution in HadoopSpark
  • Communication errors back from environment
  • Status information on jobs
  • Status information on counts of job retries

...

Description: Service enables the execution of Java-based user-defined functions within a transform recipe.

Log FileCan Help With
java-udf-service.log
  • Status of the service
Tip

Tip: You can pass through messages on errors through Logger to this log, which can assist in diagnosing issues. See Java UDFs.

Machine Learning Service

Description: ML service provides machine learning capabilities for the platform. 

Log FileCan Help With
ml_service.log
  • This log is likely to contain information that is only useful if the ML service has crashed.

Nginx Service

Description: Ngnix is a proxy server embedded in the platform that serves the web application and other resources. 

Log FileCan Help With
nginx_service.log
  • This log may be useful in identifying any warnings that occurred when the nginx services starts.
  • The nginx server may contain log information for the server that provides HTTP access.

Proxy

Description: The proxy (nginx) service manages requests from the user interface to the other components of the platform. 

Log FileCan Help With
proxy_access.log
  • Shows any requests made through the nginx to the port used by the
    D s platform
    .
proxy_error.log
  • Contains any errors thrown by the nginx service when a request is made to the port used by the
    D s platform
    .

 

Scheduling Service

Description: Handles all metadata related to scheduling

Log FileCan Help With
scheduling-service.log
  • Schedule-related issues
scheduling-service.access.log
  • Gives information about accessed routes

Spark Job Service

Description: Service that manages jobs processed on Spark.

Log FileCan Help With
spark-job-service.log

Supervisord Server

Description: Process that starts, stops, and restarts services in the platform.

Log FileCan Help With
supervisord.log
  • Status information from platform services

Time-Based Trigger Service

Description: Handles all metadata related to the trigger service

Log FileCan Help With
time-based-trigger-service.log
  • schedules not triggering correctly
time-based-trigger-service.access.log
  • Gives information about accessed routes

VFS Service

Description: Loads data from the various filesystems supported by the platform, both in the front-end user interface and in batch mode when the 

d-s-serverphoton
 running environment is enabled. For more information, see Running Environment Options.

Log FileCan Help With
vfs-service.log
  • Client connection issues
  • Status issues with backend components
  • Information on batch jobs that cannot be started
 

Webapp Service

Description: Loads data from the various filesystems supported by the platform in the front-end user interface.

Log FileCan Help With
webapp.log
  • Client connection issues
  • Status issues with backend components
  • Information on batch jobs that cannot be started

Additional logs

Job logs

The following sources of information may provide information related to job status and performance:

  • job log
  • spark log
  • cdf script
  • yarn application logs
    (if log aggregation is enabled)
  • platform configuration file
    (
    D s triconf
    pathfull
    )
  • batch job runner log
  • spark service log
  • hadoop conf directory
    (if accessible)