Where are the Symphony log files? How do I read them?

Symphony consists of two components: SOAM and EGO.

Soam logs

By default, soam log files are located in ${SOAM_HOME}/logs directory.

EGO logs

There are three types of EGO daemons. See What Symphony daemons/processes are running on my cluster?:

  • EGO master daemons: their logs are present in EGO_TOP/kernel/log

  • EGO slave daemons: same as EGO master daemon.

  • System services:

    • Egosc: logs present in EGO_TOP/eservice/esc/log

    • Wsgserver: logs present in EGO_TOP/eservice/wsg/log

    • Rs: logs present in EGO_TOP/eservice/rs/log

    • Sd: logs present in ${SOAM_HOME}/logs

    • Wsm: logs present in EGO_TOP/gui/logs/

    • Purger, plc, java(derby): logs present in EGO_TOP/perf/logs/

Reading Soam logs

For Log Level of Debug or INFO, each line of the log matches following format:

<timestamp> <log level> [<pid>:<thread-id>] <logger name> <message body>

For Log Level of INFO, WARN, ERROR, FATAL, each line of the log matches following format:

<timestamp> <log level> [<pid>:<thread-id>] <logger name> <Domain> <message>

where <timestamp> is: Year-month-day Hour-Minute-Second- Millisecond. [<pid>:<thread-id>]

Reading EGO Logs

EGO master and slave daemons: There are two similar format of logs. Each line of the log generally matches following format:

  • <timestamp><log level-string><pid><message>, or

  • <timestamp><pid><log leve-int><version of daemon><message>

where <timestamp> is either similar to Soam timestamp and/or self-explainatory.

System services: System services consist of internal and 3rd party daemons. Each line of the internal daemon log, generally, matches following format:

<timestamp> <log level> <message body>

Each line of the sd and rs daemon log, matches the format of soam logs. See above.

Format of 3rd party daemons do not follow a generic pattern.