We recently upgraded from 11.2.0.1 to 11.2.0.2. this is a stand alone server using ASM. Using SuSe linux Ent Server Version 10 , SP 2
both grid and database installation was upgraded.
After upgrade core files are created in the following location. There are hundreds or code files approx 1 every 10 mins.
<GRID_HOME>/log/<server>/diskmon
cd <GRID_HOME>/log/<server>/diskmon
ls -ltrh
drwxr-x--- 2 epsora epsdba 80 2010-11-11 13:25 core_13834
drwxr-x--- 2 epsora epsdba 80 2010-11-11 13:35 core_14691
drwxr-x--- 2 epsora epsdba 80 2010-11-11 13:45 core_15371
drwxr-x--- 2 epsora epsdba 80 2010-11-11 13:56 core_16166
-rw-r--r-- 1 epsora epsdba 367 2010-11-11 13:56 diskmonOUT.log
-rw-r--r-- 1 epsora epsdba 2.4M 2010-11-11 14:02 diskmon.log
vi diskmon.log shows
2010-11-11 13:35:29.483: [ DISKMON][14691:1082145088] dskm_process_msg5: received msg type KGZM_PING (0x0011)
2010-11-11 13:35:30.212: [ DISKMON][14691:1077942592] dskm_rac_ini13: calling clssgsqgrp
2010-11-11 13:35:30.213: [ DISKMON][14691:1077942592] dskm_rac_ini80: called clssgsqgrp:
2010-11-11 13:35:30.213: [ DISKMON][14691:1077942592] dskm_dump_group_priv: vers: 0 flags: 0x0 confInc: 0 My confInc: 0
2010-11-11 13:35:30.213: [ DISKMON][14691:1077942592] dskm_dump_group_priv: CSS Msg Hdr: vers: 0 type: UNKNOWN (0) chunks: NO MORE CHUNKS (0) transport: UNKNOWN (0) mSize: 0
2010-11-11 13:35:30.213: [ DISKMON][14691:1077942592] dskm_dump_group_priv: Group Private Data is not of type DSKM_MSG_SS_REQ. Not proceeding with msg dump
2010-11-11 13:35:30.213: [ DISKMON][14691:1077942592] dskm_rac_ini15: Found my member number 1 to be busy. Waiting (attempts: 600) for OCSSD to clean up previous incarnation
2010-11-11 13:35:31.216: [ DISKMON][14691:1077942592] dskm_rac_ini13: calling clssgsqgrp
2010-11-11 13:35:31.217: [ DISKMON][14691:1077942592] dskm_rac_ini80: called clssgsqgrp:
2010-11-11 13:35:31.217: [ DISKMON][14691:1077942592] dskm_dump_group_priv: vers: 0 flags: 0x0 confInc: 0 My confInc: 0
2010-11-11 13:35:31.217: [ DISKMON][14691:1077942592] dskm_dump_group_priv: CSS Msg Hdr: vers: 0 type: UNKNOWN (0) chunks: NO MORE CHUNKS (0) transport: UNKNOWN (0) mSize: 0
2010-11-11 13:35:31.217: [ DISKMON][14691:1077942592] dskm_dump_group_priv: Group Private Data is not of type DSKM_MSG_SS_REQ. Not proceeding with msg dump
2010-11-11 13:35:31.217: [ DISKMON][14691:1077942592] dskm_rac_ini16: OCSSD has notified that another diskmon is currently running in this node.
This might be a duplicate startup. If not consult OCSSD log for additional information.
2010-11-11 13:35:31.227: [ DISKMON][14691] INCIDENT : EXCEPTION (SIGNAL: 6) in [gsignal()]
2010-11-11 13:35:31.228: [ DISKMON][14691] Thread 1077942592 got exception 6
2010-11-11 13:35:31.228: [ DISKMON][14691] Stack dump for thread 1077942592
[ DISKMON][14691]
Followed by a huge stack trace.
Can anyone help by trying to identify the root cause of the stack trace and core dumps ?
Thanks