环境是两个机房，A机房是一台机器，B机房是2台机器。A机房的机器是8核，64G内存，B机房是64核128内存。两个机房打通了大二层，网络组播也开启了，在一个网段里。现在的问题是在A机房的机器跑root.sh成功，B机房的两台机器就会失败，在B机房的机器执行成功，A机房的机器执行就会失败。详情见日志文件。
Oracle Database 11g Clusterware Release 11.2.0.4.0 - Production Copyright 1996, 2011 Oracle. All rights reserved.
2018-08-06 18:46:17.740: [ AGENT][4047623968] Logging level for Module: allcomp 0
2018-08-06 18:46:17.740: [ AGENT][4047623968] Logging level for Module: default 0
2018-08-06 18:46:17.740: [ AGENT][4047623968] Logging level for Module: AGENT 1
2018-08-06 18:46:17.740: [ AGENT][4047623968] Logging level for Module: AGFW 1
2018-08-06 18:46:17.740: [ AGENT][4047623968] Logging level for Module: CLSFRAME 0
2018-08-06 18:46:17.740: [ AGENT][4047623968] Logging level for Module: CRSCOMM 0
2018-08-06 18:46:17.740: [ AGENT][4047623968] Logging level for Module: CRSTIMER 0
2018-08-06 18:46:17.740: [ AGENT][4047623968] Logging level for Module: USRTHRD 1
2018-08-06 18:46:17.740: [ AGFW][4047623968] Starting the agent: /u01/app/11.2.0/grid/log/ndg2/agent/ohasd/oraagent_grid/
2018-08-06 18:46:17.740: [ AGENT][4047623968] Agent framework initialized, Process Id = 40364
2018-08-06 18:46:17.742: [ USRTHRD][4047623968] ConnectionPool::initMutex
2018-08-06 18:46:17.742: [ USRTHRD][4047623968] Process::convertPidToString pid = 40364
2018-08-06 18:46:17.743: [ AGFW][4047623968] SERVER IPC CONNECT STR: (ADDRESS=(PROTOCOL=IPC)(KEY=OHASD_IPC_SOCKET_11))
2018-08-06 18:46:17.743: [ AGFW][4047623968] Agent' version is: 2
2018-08-06 18:46:17.743: [CLSFRAME][4047623968] Inited lsf context 0x207d140
2018-08-06 18:46:17.743: [CLSFRAME][4047623968] Initing CLS Framework messaging
2018-08-06 18:46:17.743: [CLSFRAME][4047623968] New Framework state: 2
2018-08-06 18:46:17.743: [CLSFRAME][4047623968] M2M is starting...
2018-08-06 18:46:17.743: [ CRSCOMM][4047623968] Ipc: Starting send thread
2018-08-06 18:46:17.744: [ CRSCOMM][4039018240] Ipc: sendWork thread started.
2018-08-06 18:46:17.745: [ CRSCOMM][4047623968] Connected to server running as user: root
2018-08-06 18:46:17.745: [ CRSCOMM][4036916992] IpcC: IPC Client thread started listening
2018-08-06 18:46:17.745: [ CRSCOMM][4036916992] IpcC: Received member number of 1
2018-08-06 18:46:17.745: [ CRSCOMM][4036916992] IpcC: Member data received
2018-08-06 18:46:17.746: [CLSFRAME][4036916992] New IPC Member:{Relative|Node:0|Process:0|Type:2}:OHASD:ndg2 username=root
2018-08-06 18:46:17.746: [CLSFRAME][4036916992] New process connected to us ID:{Relative|Node:0|Process:0|Type:2} Info:OHASD:ndg2
2018-08-06 18:46:17.746: [CLSFRAME][4047623968] Tints initialized with nodeId: 0 procId: 1
2018-08-06 18:46:17.746: [CLSFRAME][4047623968] Starting thread model named: MultiThread
2018-08-06 18:46:17.746: [CLSFRAME][4047623968] Starting thread model named: TimerSharedTM
2018-08-06 18:46:17.747: [CLSFRAME][4047623968] New Framework state: 3
2018-08-06 18:46:17.747: [ AGFW][4047623968] Agent Framework started successfully
2018-08-06 18:46:17.748: [ AGFW][3823101696]{0:1:2} Agfw engine module has enabled...
2018-08-06 18:46:17.749: [CLSFRAME][3823101696]{0:1:2} Module Enabling is complete
2018-08-06 18:46:17.749: [CLSFRAME][3823101696]{0:1:2} New Framework state: 6
2018-08-06 18:46:17.749: [CLSFRAME][4047623968] M2M is now powered by a doWork() thread.
2018-08-06 18:46:17.750: [ AGFW][3823101696]{0:1:2} Agent is started with userid: grid , expected user: grid
2018-08-06 18:46:17.750: [ CLSVER][3823101696]{0:1:2} Static Version 11.2.0.4.0
2018-08-06 18:46:17.750: [ AGFW][3823101696]{0:1:2} Agent sending message to PE: AGENT_HANDSHAKE[Proxy] ID 20484:11
2018-08-06 18:46:17.755: [ AGFW][3823101696]{0:1:2} Agent received the message: RESTYPE_ADD[ora.daemon.type] ID 8196:176
2018-08-06 18:46:17.756: [ AGFW][3823101696]{0:1:2} Agent does not have the type: ora.daemon.type
2018-08-06 18:46:17.756: [ AGFW][3823101696]{0:1:2} Agent do not have any action entries defined for type: ora.daemon.type
2018-08-06 18:46:17.756: [ AGFW][3823101696]{0:1:2} Could not find any base type named: cluster_resourcefor type: ora.daemon.type
2018-08-06 18:46:17.756: [ AGFW][3823101696]{0:1:2} Could not find any base type entry points for type: ora.daemon.type, Assuming script entry points.
2018-08-06 18:46:17.756: [ AGFW][3823101696]{0:1:2} Could not find the action entry: START
2018-08-06 18:46:17.756: [ AGFW][3823101696]{0:1:2} AGFW assuming START entry point defined in script.
2018-08-06 18:46:17.756: [ AGFW][3823101696]{0:1:2} Could not find the action entry: STOP
2018-08-06 18:46:17.756: [ AGFW][3823101696]{0:1:2} AGFW assuming STOP entry point defined in script.
2018-08-06 18:46:17.756: [ AGFW][3823101696]{0:1:2} Could not find the action entry: CHECK
2018-08-06 18:46:17.756: [ AGFW][3823101696]{0:1:2} AGFW assuming CHECK entry point defined in script.
2018-08-06 18:46:17.756: [ AGFW][3823101696]{0:1:2} Could not find the action entry: CLEAN
2018-08-06 18:46:17.756: [ AGFW][3823101696]{0:1:2} AGFW assuming CLEAN entry point defined in script.
2018-08-06 18:46:17.756: [ AGFW][3823101696]{0:1:2} Added new restype: ora.daemon.type
2018-08-06 18:46:17.757: [ AGFW][3823101696]{0:1:2} Agent sending last reply for: RESTYPE_ADD[ora.daemon.type] ID 8196:176
2018-08-06 18:46:17.758: [ AGFW][3823101696]{0:1:2} Agent received the message: RESTYPE_ADD[ora.asm.type] ID 8196:177
2018-08-06 18:46:17.758: [ AGFW][3823101696]{0:1:2} Added new restype: ora.asm.type
2018-08-06 18:46:17.759: [ AGFW][3823101696]{0:1:2} Agent sending last reply for: RESTYPE_ADD[ora.asm.type] ID 8196:177
2018-08-06 18:46:17.760: [ AGFW][3823101696]{0:1:2} Agent received the message: RESTYPE_ADD[ora.evm.type] ID 8196:178
2018-08-06 18:46:17.760: [ AGFW][3823101696]{0:1:2} Added new restype: ora.evm.type
2018-08-06 18:46:17.761: [ AGFW][3823101696]{0:1:2} Agent sending last reply for: RESTYPE_ADD[ora.evm.type] ID 8196:178
2018-08-06 18:46:17.761: [ AGFW][3823101696]{0:1:2} Agent received the message: RESTYPE_ADD[ora.gipc.type] ID 8196:179
2018-08-06 18:46:17.762: [ AGFW][3823101696]{0:1:2} Added new restype: ora.gipc.type
2018-08-06 18:46:17.762: [ AGFW][3823101696]{0:1:2} Agent sending last reply for: RESTYPE_ADD[ora.gipc.type] ID 8196:179
2018-08-06 18:46:17.763: [ AGFW][3823101696]{0:1:2} Agent received the message: RESTYPE_ADD[ora.gpnp.type] ID 8196:180
2018-08-06 18:46:17.763: [ AGFW][3823101696]{0:1:2} Added new restype: ora.gpnp.type
2018-08-06 18:46:17.764: [ AGFW][3823101696]{0:1:2} Agent sending last reply for: RESTYPE_ADD[ora.gpnp.type] ID 8196:180
2018-08-06 18:46:17.764: [ AGFW][3823101696]{0:1:2} Agent received the message: RESTYPE_ADD[ora.haip.type] ID 8196:181
2018-08-06 18:46:17.765: [ AGFW][3823101696]{0:1:2} Added new restype: ora.haip.type
2018-08-06 18:46:17.765: [ AGFW][3823101696]{0:1:2} Agent sending last reply for: RESTYPE_ADD[ora.haip.type] ID 8196:181
2018-08-06 18:46:17.766: [ AGFW][3823101696]{0:1:2} Agent received the message: RESTYPE_ADD[ora.mdns.type] ID 8196:182
2018-08-06 18:46:17.766: [ AGFW][3823101696]{0:1:2} Added new restype: ora.mdns.type
2018-08-06 18:46:17.767: [ AGFW][3823101696]{0:1:2} Agent sending last reply for: RESTYPE_ADD[ora.mdns.type] ID 8196:182
2018-08-06 18:46:17.767: [ AGFW][3823101696]{0:1:2} Agent received the message: RESOURCE_ADD[ora.mdnsd 1 1] ID 4356:183
2018-08-06 18:46:17.767: [ AGFW][3823101696]{0:1:2} Added new resource: ora.mdnsd 1 1 to the agfw
2018-08-06 18:46:17.768: [ AGFW][3823101696]{0:1:2} Agent sending last reply for: RESOURCE_ADD[ora.mdnsd 1 1] ID 4356:183
2018-08-06 18:46:17.768: [ AGFW][3823101696]{0:0:33} Agent received the message: RESOURCE_START[ora.mdnsd 1 1] ID 4098:184
2018-08-06 18:46:17.768: [ AGFW][3823101696]{0:0:33} Preparing START command for: ora.mdnsd 1 1
2018-08-06 18:46:17.768: [ AGFW][3823101696]{0:0:33} ora.mdnsd 1 1 state changed from: UNKNOWN to: STARTING
2018-08-06 18:46:17.769: [ora.mdnsd][4030613248]{0:0:33} [start] (:CLSN00107:) clsn_agent::start {
2018-08-06 18:46:17.769: [ora.mdnsd][4030613248]{0:0:33} [start] __IS_HASD_AGENT=TRUE
2018-08-06 18:46:17.770: [ora.mdnsd][4030613248]{0:0:33} [start] getOracleHomeAttrib: oracle_home = /u01/app/11.2.0/grid
2018-08-06 18:46:17.770: [ora.mdnsd][4030613248]{0:0:33} [start] Utils::execCmd 1 USR_ORA_ENV: oracleHome:/u01/app/11.2.0/grid CrsHome:/u01/app/11.2.0/grid
2018-08-06 18:46:17.770: [ora.mdnsd][4030613248]{0:0:33} [start] Adding Environment Variables ORA_DAEMON_LOGGING_LEVELS=MDNS=3
2018-08-06 18:46:17.770: [ora.mdnsd][4030613248]{0:0:33} [start] Adding Environment Variables ORA_DAEMON_TRACING_LEVELS=MDNS=3
2018-08-06 18:46:17.770: [ora.mdnsd][4030613248]{0:0:33} [start] Adding Environment Variables _ORA_AGENT_ACTION=TRUE
2018-08-06 18:46:17.770: [ora.mdnsd][4030613248]{0:0:33} [start] Adding Environment Variables __IS_HASD_AGENT=
2018-08-06 18:46:17.770: [ora.mdnsd][4030613248]{0:0:33} [start] Utils:execCmd action = 1 flags = 5 ohome = (null) cmdname = mdnsd.
2018-08-06 18:46:17.770: [ora.mdnsd][4030613248]{0:0:33} [start] getOracleHomeAttrib: oracle_home = /u01/app/11.2.0/grid
2018-08-06 18:46:17.773: [ora.mdnsd][4030613248]{0:0:33} [start] execCmd ret = 0
2018-08-06 18:46:18.773: [ora.mdnsd][4030613248]{0:0:33} [start] without returnbuf
2018-08-06 18:46:18.778: [ora.mdnsd][4030613248]{0:0:33} [start] clsdmc_respget return: status=0, ecode=0
2018-08-06 18:46:18.778: [ora.mdnsd][4030613248]{0:0:33} [start] getOracleHomeAttrib: oracle_home = /u01/app/11.2.0/grid
2018-08-06 18:46:18.779: [ora.mdnsd][4030613248]{0:0:33} [start] PID 40375 from /u01/app/11.2.0/grid/mdns/init/ndg2.pid
2018-08-06 18:46:18.779: [ora.mdnsd][4030613248]{0:0:33} [start] }DaemonAgent::start
2018-08-06 18:46:18.779: [ora.mdnsd][4030613248]{0:0:33} [start] (:CLSN00107:) clsn_agent::start }
2018-08-06 18:46:18.779: [ AGFW][4030613248]{0:0:33} Command: start for resource: ora.mdnsd 1 1 completed with status: SUCCESS
2018-08-06 18:46:18.780: [CLSFRAME][4047623968] TM [MultiThread] is changing desired thread # to 3. Current # is 2
2018-08-06 18:46:18.780: [ AGFW][3823101696]{0:0:33} Agent sending reply for: RESOURCE_START[ora.mdnsd 1 1] ID 4098:184
2018-08-06 18:46:18.782: [ora.mdnsd][4030613248]{0:0:33} [check] clsdmc_respget return: status=0, ecode=0
2018-08-06 18:46:18.783: [ USRTHRD][4030613248]{0:0:33} Thread:[DaemonCheck:mdnsd]start {
2018-08-06 18:46:18.783: [ USRTHRD][4030613248]{0:0:33} Thread:[DaemonCheck:mdnsd]start }
2018-08-06 18:46:18.784: [ AGFW][3823101696]{0:0:33} ora.mdnsd 1 1 state changed from: STARTING to: ONLINE
2018-08-06 18:46:18.784: [ AGFW][3823101696]{0:0:33} Started implicit monitor for [ora.mdnsd 1 1] interval=30000 delay=30000
2018-08-06 18:46:18.784: [ AGFW][3823101696]{0:0:33} Agent sending last reply for: RESOURCE_START[ora.mdnsd 1 1] ID 4098:184
2018-08-06 18:46:18.795: [ AGFW][3823101696]{0:0:33} Agent received the message: RESOURCE_ADD[ora.gpnpd 1 1] ID 4356:197
2018-08-06 18:46:18.795: [ AGFW][3823101696]{0:0:33} Added new resource: ora.gpnpd 1 1 to the agfw
2018-08-06 18:46:18.796: [ AGFW][3823101696]{0:0:33} Agent sending last reply for: RESOURCE_ADD[ora.gpnpd 1 1] ID 4356:197
2018-08-06 18:46:18.799: [ AGFW][3823101696]{0:0:33} Agent received the message: RESOURCE_START[ora.gpnpd 1 1] ID 4098:199
2018-08-06 18:46:18.799: [ AGFW][3823101696]{0:0:33} Preparing START command for: ora.gpnpd 1 1
2018-08-06 18:46:18.799: [ AGFW][3823101696]{0:0:33} ora.gpnpd 1 1 state changed from: UNKNOWN to: STARTING
2018-08-06 18:46:18.801: [ora.gpnpd][4030613248]{0:0:33} [start] (:CLSN00107:) clsn_agent::start {
2018-08-06 18:46:18.801: [ora.gpnpd][4030613248]{0:0:33} [start] __IS_HASD_AGENT=TRUE
2018-08-06 18:46:18.801: [ora.gpnpd][4030613248]{0:0:33} [start] getOracleHomeAttrib: oracle_home = /u01/app/11.2.0/grid
2018-08-06 18:46:18.801: [ora.gpnpd][4030613248]{0:0:33} [start] Utils::execCmd 1 USR_ORA_ENV: oracleHome:/u01/app/11.2.0/grid CrsHome:/u01/app/11.2.0/grid
2018-08-06 18:46:18.801: [ora.gpnpd][4030613248]{0:0:33} [start] Adding Environment Variables ORA_DAEMON_LOGGING_LEVELS=GPNP=1,GIPC=1,RD=1,CLSXSIG=1,CLSXSEC=1,OCRAPI=1,OCRCLI=1,OCRMSG=0
2018-08-06 18:46:18.801: [ora.gpnpd][4030613248]{0:0:33} [start] Adding Environment Variables ORA_DAEMON_TRACING_LEVELS=GPNP=0,GIPC=0,RD=0,CLSXSIG=0,CLSXSEC=0,OCRAPI=0,OCRCLI=0,OCRMSG=0
2018-08-06 18:46:18.801: [ora.gpnpd][4030613248]{0:0:33} [start] Adding Environment Variables _ORA_AGENT_ACTION=TRUE
2018-08-06 18:46:18.801: [ora.gpnpd][4030613248]{0:0:33} [start] Adding Environment Variables __IS_HASD_AGENT=
2018-08-06 18:46:18.801: [ora.gpnpd][4030613248]{0:0:33} [start] Utils:execCmd action = 1 flags = 5 ohome = (null) cmdname = gpnpd.
2018-08-06 18:46:18.802: [ora.gpnpd][4030613248]{0:0:33} [start] getOracleHomeAttrib: oracle_home = /u01/app/11.2.0/grid
2018-08-06 18:46:18.805: [ora.gpnpd][4030613248]{0:0:33} [start] execCmd ret = 0
2018-08-06 18:46:19.805: [ora.gpnpd][4030613248]{0:0:33} [start] without returnbuf
2018-08-06 18:46:19.807: [ COMMCRS][3813881600]clsc_connect: (0x7f0bd80a2280) no listener at (ADDRESS=(PROTOCOL=ipc)(KEY=ndg2DBG_GPNPD))
[ clsdmc][4030613248]Fail to connect (ADDRESS=(PROTOCOL=ipc)(KEY=ndg2DBG_GPNPD)) with status 9
2018-08-06 18:46:19.807: [ora.gpnpd][4030613248]{0:0:33} [start] Error = error 9 encountered when connecting to GPNPD
2018-08-06 18:46:20.808: [ora.gpnpd][4030613248]{0:0:33} [start] without returnbuf
2018-08-06 18:46:20.810: [ora.gpnpd][4030613248]{0:0:33} [start] clsdmc_respget return: status=0, ecode=0
2018-08-06 18:46:20.810: [ora.gpnpd][4030613248]{0:0:33} [start] getOracleHomeAttrib: oracle_home = /u01/app/11.2.0/grid
2018-08-06 18:46:20.810: [ora.gpnpd][4030613248]{0:0:33} [start] PID 40386 from /u01/app/11.2.0/grid/gpnp/init/ndg2.pid
2018-08-06 18:46:20.810: [ora.gpnpd][4030613248]{0:0:33} [start] }DaemonAgent::start
2018-08-06 18:46:20.810: [ora.gpnpd][4030613248]{0:0:33} [start] (:CLSN00107:) clsn_agent::start }
2018-08-06 18:46:20.811: [ AGFW][4030613248]{0:0:33} Command: start for resource: ora.gpnpd 1 1 completed with status: SUCCESS
2018-08-06 18:46:20.812: [ AGFW][3823101696]{0:0:33} Agent sending reply for: RESOURCE_START[ora.gpnpd 1 1] ID 4098:199
2018-08-06 18:46:20.812: [ora.gpnpd][4030613248]{0:0:33} [check] clsdmc_respget return: status=0, ecode=0
2018-08-06 18:46:20.814: [ USRTHRD][4030613248]{0:0:33} Thread:[DaemonCheck:gpnpd]start {
2018-08-06 18:46:20.814: [ USRTHRD][4030613248]{0:0:33} Thread:[DaemonCheck:gpnpd]start }
2018-08-06 18:46:20.814: [ AGFW][3823101696]{0:0:33} ora.gpnpd 1 1 state changed from: STARTING to: ONLINE
2018-08-06 18:46:20.814: [ AGFW][3823101696]{0:0:33} Started implicit monitor for [ora.gpnpd 1 1] interval=30000 delay=30000
2018-08-06 18:46:20.815: [ AGFW][3823101696]{0:0:33} Agent sending last reply for: RESOURCE_START[ora.gpnpd 1 1] ID 4098:199
2018-08-06 18:46:20.863: [ AGFW][3823101696]{0:0:33} Agent received the message: RESOURCE_ADD[ora.gipcd 1 1] ID 4356:206
2018-08-06 18:46:20.863: [ AGFW][3823101696]{0:0:33} Added new resource: ora.gipcd 1 1 to the agfw
2018-08-06 18:46:20.863: [ AGFW][3823101696]{0:0:33} Agent sending last reply for: RESOURCE_ADD[ora.gipcd 1 1] ID 4356:206
2018-08-06 18:46:20.867: [ AGFW][3823101696]{0:0:33} Agent received the message: RESOURCE_START[ora.gipcd 1 1] ID 4098:208
2018-08-06 18:46:20.867: [ AGFW][3823101696]{0:0:33} Preparing START command for: ora.gipcd 1 1
2018-08-06 18:46:20.867: [ AGFW][3823101696]{0:0:33} ora.gipcd 1 1 state changed from: UNKNOWN to: STARTING
2018-08-06 18:46:20.868: [ora.gipcd][4030613248]{0:0:33} [start] (:CLSN00107:) clsn_agent::start {
2018-08-06 18:46:20.868: [ora.gipcd][4030613248]{0:0:33} [start] __IS_HASD_AGENT=TRUE
2018-08-06 18:46:20.869: [ora.gipcd][4030613248]{0:0:33} [start] getOracleHomeAttrib: oracle_home = /u01/app/11.2.0/grid
2018-08-06 18:46:20.869: [ora.gipcd][4030613248]{0:0:33} [start] Utils::execCmd 1 USR_ORA_ENV: oracleHome:/u01/app/11.2.0/grid CrsHome:/u01/app/11.2.0/grid
2018-08-06 18:46:20.869: [ora.gipcd][4030613248]{0:0:33} [start] Adding Environment Variables ORA_DAEMON_LOGGING_LEVELS=CLNTCOMM=2,NODECOMM=2,MONTCOMM=2,GIPCD=2,GIPCDNDE=2,GIPCDCLT=2,GIPCDMON=2
2018-08-06 18:46:20.869: [ora.gipcd][4030613248]{0:0:33} [start] Adding Environment Variables ORA_DAEMON_TRACING_LEVELS=CLNTCOMM=2,NODECOMM=2,MONTCOMM=2,GIPCD=2,GIPCDNDE=2,GIPCDCLT=2,GIPCDMON=2
2018-08-06 18:46:20.869: [ora.gipcd][4030613248]{0:0:33} [start] Adding Environment Variables _ORA_AGENT_ACTION=TRUE
2018-08-06 18:46:20.869: [ora.gipcd][4030613248]{0:0:33} [start] Adding Environment Variables __IS_HASD_AGENT=
2018-08-06 18:46:20.869: [ora.gipcd][4030613248]{0:0:33} [start] Utils:execCmd action = 1 flags = 5 ohome = (null) cmdname = gipcd.
2018-08-06 18:46:20.869: [ora.gipcd][4030613248]{0:0:33} [start] getOracleHomeAttrib: oracle_home = /u01/app/11.2.0/grid
2018-08-06 18:46:20.873: [ora.gipcd][4030613248]{0:0:33} [start] execCmd ret = 0
2018-08-06 18:46:21.873: [ora.gipcd][4030613248]{0:0:33} [start] without returnbuf
2018-08-06 18:46:21.877: [ora.gipcd][4030613248]{0:0:33} [start] clsdmc_respget return: status=0, ecode=0
2018-08-06 18:46:21.877: [ora.gipcd][4030613248]{0:0:33} [start] getOracleHomeAttrib: oracle_home = /u01/app/11.2.0/grid
2018-08-06 18:46:21.878: [ora.gipcd][4030613248]{0:0:33} [start] PID 40407 from /u01/app/11.2.0/grid/gipc/init/ndg2.pid
2018-08-06 18:46:21.878: [ora.gipcd][4030613248]{0:0:33} [start] }DaemonAgent::start
2018-08-06 18:46:21.878: [ora.gipcd][4030613248]{0:0:33} [start] (:CLSN00107:) clsn_agent::start }
2018-08-06 18:46:21.878: [ AGFW][4030613248]{0:0:33} Command: start for resource: ora.gipcd 1 1 completed with status: SUCCESS
2018-08-06 18:46:21.879: [ AGFW][3823101696]{0:0:33} Agent sending reply for: RESOURCE_START[ora.gipcd 1 1] ID 4098:208
2018-08-06 18:46:21.880: [ora.gipcd][4030613248]{0:0:33} [check] clsdmc_respget return: status=0, ecode=0
2018-08-06 18:46:21.881: [ USRTHRD][4030613248]{0:0:33} Thread:[DaemonCheck:gipcd]start {
2018-08-06 18:46:21.881: [ USRTHRD][4030613248]{0:0:33} Thread:[DaemonCheck:gipcd]start }
2018-08-06 18:46:21.882: [ AGFW][3823101696]{0:0:33} ora.gipcd 1 1 state changed from: STARTING to: ONLINE
2018-08-06 18:46:21.882: [ AGFW][3823101696]{0:0:33} Started implicit monitor for [ora.gipcd 1 1] interval=30000 delay=30000
2018-08-06 18:46:21.882: [ AGFW][3823101696]{0:0:33} Agent sending last reply for: RESOURCE_START[ora.gipcd 1 1] ID 4098:208
2018-08-06 18:46:21.882: [CLSFRAME][4047623968] TM [MultiThread] is changing desired thread # to 4. Current # is 3
2018-08-06 18:46:48.796: [ora.mdnsd][4030613248]{0:0:33} [check] clsdmc_respget return: status=0, ecode=0
2018-08-06 18:46:50.829: [ora.gpnpd][4030613248]{0:0:33} [check] clsdmc_respget return: status=0, ecode=0
2018-08-06 18:46:51.883: [ora.gipcd][4030613248]{0:0:33} [check] clsdmc_respget return: status=0, ecode=0
2018-08-06 18:47:17.715: [ AGFW][3823101696]{0:0:33} Agent received the message: AGENT_HB[Engine] ID 12293:303
2018-08-06 18:47:18.798: [ora.mdnsd][4030613248]{0:0:33} [check] clsdmc_respget return: status=0, ecode=0
2018-08-06 18:47:20.832: [ora.gpnpd][4030613248]{0:0:33} [check] clsdmc_respget return: status=0, ecode=0
2018-08-06 18:47:21.886: [ora.gipcd][4030613248]{0:0:33} [check] clsdmc_respget return: status=0, ecode=0
2018-08-06 18:47:47.721: [ AGFW][3823101696]{0:0:33} Agent received the message: AGENT_HB[Engine] ID 12293:311
2018-08-06 18:47:48.804: [ora.mdnsd][4030613248]{0:0:33} [check] clsdmc_respget return: status=0, ecode=0
2018-08-06 18:47:50.837: [ora.gpnpd][4030613248]{0:0:33} [check] clsdmc_respget return: status=0, ecode=0
2018-08-06 18:47:51.891: [ora.gipcd][4030613248]{0:0:33} [check] clsdmc_respget return: status=0, ecode=0
2018-08-06 18:48:17.726: [ AGFW][3823101696]{0:0:33} Agent received the message: AGENT_HB[Engine] ID 12293:319
2018-08-06 18:48:18.810: [ora.mdnsd][4030613248]{0:0:33} [check] clsdmc_respget return: status=0, ecode=0
2018-08-06 18:48:20.843: [ora.gpnpd][4030613248]{0:0:33} [check] clsdmc_respget return: status=0, ecode=0
2018-08-06 18:48:21.897: [ora.gipcd][4030613248]{0:0:33} [check] clsdmc_respget return: status=0, ecode=0
2018-08-06 18:48:40.982: [ AGFW][3823101696]{0:0:33} Agent received the message: RESOURCE_STOP[ora.gipcd 1 1] ID 4099:385
2018-08-06 18:48:40.983: [ AGFW][3823101696]{0:0:33} Preparing STOP command for: ora.gipcd 1 1
2018-08-06 18:48:40.983: [ AGFW][3823101696]{0:0:33} ora.gipcd 1 1 state changed from: ONLINE to: STOPPING
2018-08-06 18:48:40.984: [ora.gipcd][4030613248]{0:0:33} [stop] (:CLSN00108:) clsn_agent::stop {
2018-08-06 18:48:40.984: [ora.gipcd][4030613248]{0:0:33} [stop] getOracleHomeAttrib: oracle_home = /u01/app/11.2.0/grid
2018-08-06 18:48:40.985: [ora.gipcd][4030613248]{0:0:33} [stop] PID 40407 from /u01/app/11.2.0/grid/gipc/init/ndg2.pid
2018-08-06 18:48:40.985: [ora.gipcd][4030613248]{0:0:33} [stop] CLSDM Based stop action
2018-08-06 18:48:40.986: [ora.gipcd][4030613248]{0:0:33} [stop] Using Timeout value of 18000 for stop message
2018-08-06 18:48:40.989: [ora.gipcd][4030613248]{0:0:33} [stop] clsdmc_respget return: status=0, ecode=0
2018-08-06 18:48:41.299: [ USRTHRD][3800114944]{0:0:33} Thread:[DaemonCheck:gipcd]Daemon Select Thread exiting
2018-08-06 18:48:41.299: [ USRTHRD][3800114944]{0:0:33} Thread:[DaemonCheck:gipcd]Skipping Agent Initiated a check action
2018-08-06 18:48:41.299: [ USRTHRD][3800114944]{0:0:33} Thread:[DaemonCheck:gipcd]isRunning is reset to false here
2018-08-06 18:48:41.991: [ora.gipcd][4030613248]{0:0:33} [stop] (:CLSN00108:) clsn_agent::stop }
2018-08-06 18:48:41.991: [ AGFW][4030613248]{0:0:33} Command: stop for resource: ora.gipcd 1 1 completed with status: SUCCESS
2018-08-06 18:48:41.992: [ AGFW][3823101696]{0:0:33} Agent sending reply for: RESOURCE_STOP[ora.gipcd 1 1] ID 4099:385
2018-08-06 18:48:42.159: [ COMMCRS][3805947648]clsc_connect: (0x7f0bd819a660) no listener at (ADDRESS=(PROTOCOL=ipc)(KEY=ndg2DBG_GIPCD))
[ clsdmc][4030613248]Fail to connect (ADDRESS=(PROTOCOL=ipc)(KEY=ndg2DBG_GIPCD)) with status 9
2018-08-06 18:48:42.159: [ora.gipcd][4030613248]{0:0:33} [check] Error = error 9 encountered when connecting to GIPCD
2018-08-06 18:48:42.159: [ora.gipcd][4030613248]{0:0:33} [check] Calling PID check for daemon
2018-08-06 18:48:42.160: [ora.gipcd][4030613248]{0:0:33} [check] Process id 40407 translated to
2018-08-06 18:48:42.326: [ COMMCRS][3805947648]clsc_connect: (0x7f0bd819a4e0) no listener at (ADDRESS=(PROTOCOL=ipc)(KEY=ndg2DBG_GIPCD))
[ clsdmc][4030613248]Fail to connect (ADDRESS=(PROTOCOL=ipc)(KEY=ndg2DBG_GIPCD)) with status 9
2018-08-06 18:48:42.326: [ora.gipcd][4030613248]{0:0:33} [check] Error = error 9 encountered when connecting to GIPCD
2018-08-06 18:48:42.326: [ AGFW][3823101696]{0:0:33} ora.gipcd 1 1 state changed from: STOPPING to: OFFLINE
2018-08-06 18:48:42.327: [ AGFW][3823101696]{0:0:33} Agent sending last reply for: RESOURCE_STOP[ora.gipcd 1 1] ID 4099:385
2018-08-06 18:48:42.341: [ AGFW][3823101696]{0:0:33} Agent received the message: RESOURCE_STOP[ora.gpnpd 1 1] ID 4099:403
2018-08-06 18:48:42.341: [ AGFW][3823101696]{0:0:33} Preparing STOP command for: ora.gpnpd 1 1
2018-08-06 18:48:42.341: [ AGFW][3823101696]{0:0:33} ora.gpnpd 1 1 state changed from: ONLINE to: STOPPING
2018-08-06 18:48:42.342: [ora.gpnpd][4030613248]{0:0:33} [stop] (:CLSN00108:) clsn_agent::stop {
2018-08-06 18:48:42.342: [ora.gpnpd][4030613248]{0:0:33} [stop] getOracleHomeAttrib: oracle_home = /u01/app/11.2.0/grid
2018-08-06 18:48:42.343: [ora.gpnpd][4030613248]{0:0:33} [stop] PID 40386 from /u01/app/11.2.0/grid/gpnp/init/ndg2.pid
2018-08-06 18:48:42.343: [ora.gpnpd][4030613248]{0:0:33} [stop] CLSDM Based stop action
2018-08-06 18:48:42.344: [ora.gpnpd][4030613248]{0:0:33} [stop] Using Timeout value of 18000 for stop message
2018-08-06 18:48:42.346: [ora.gpnpd][4030613248]{0:0:33} [stop] clsdmc_respget return: status=0, ecode=0
2018-08-06 18:48:42.951: [ USRTHRD][3808048896]{0:0:33} Thread:[DaemonCheck:gpnpd]Daemon Select Thread exiting
2018-08-06 18:48:42.951: [ USRTHRD][3808048896]{0:0:33} Thread:[DaemonCheck:gpnpd]Skipping Agent Initiated a check action
2018-08-06 18:48:42.951: [ USRTHRD][3808048896]{0:0:33} Thread:[DaemonCheck:gpnpd]isRunning is reset to false here
2018-08-06 18:48:43.347: [ora.gpnpd][4030613248]{0:0:33} [stop] (:CLSN00108:) clsn_agent::stop }
2018-08-06 18:48:43.347: [ AGFW][4030613248]{0:0:33} Command: stop for resource: ora.gpnpd 1 1 completed with status: SUCCESS
2018-08-06 18:48:43.348: [ AGFW][3823101696]{0:0:33} Agent sending reply for: RESOURCE_STOP[ora.gpnpd 1 1] ID 4099:403
2018-08-06 18:48:43.516: [ COMMCRS][3813881600]clsc_connect: (0x7f0bd8132e70) no listener at (ADDRESS=(PROTOCOL=ipc)(KEY=ndg2DBG_GPNPD))
[ clsdmc][4030613248]Fail to connect (ADDRESS=(PROTOCOL=ipc)(KEY=ndg2DBG_GPNPD)) with status 9
2018-08-06 18:48:43.516: [ora.gpnpd][4030613248]{0:0:33} [check] Error = error 9 encountered when connecting to GPNPD
2018-08-06 18:48:43.516: [ora.gpnpd][4030613248]{0:0:33} [check] Calling PID check for daemon
2018-08-06 18:48:43.516: [ora.gpnpd][4030613248]{0:0:33} [check] Process id 40386 translated to
2018-08-06 18:48:43.682: [ COMMCRS][3813881600]clsc_connect: (0x7f0bd8132dd0) no listener at (ADDRESS=(PROTOCOL=ipc)(KEY=ndg2DBG_GPNPD))
[ clsdmc][4030613248]Fail to connect (ADDRESS=(PROTOCOL=ipc)(KEY=ndg2DBG_GPNPD)) with status 9
2018-08-06 18:48:43.682: [ora.gpnpd][4030613248]{0:0:33} [check] Error = error 9 encountered when connecting to GPNPD
2018-08-06 18:48:43.683: [ AGFW][3823101696]{0:0:33} ora.gpnpd 1 1 state changed from: STOPPING to: OFFLINE
2018-08-06 18:48:43.683: [ AGFW][3823101696]{0:0:33} Agent sending last reply for: RESOURCE_STOP[ora.gpnpd 1 1] ID 4099:403
2018-08-06 18:48:43.689: [ AGFW][3823101696]{0:0:33} Agent received the message: RESOURCE_STOP[ora.mdnsd 1 1] ID 4099:415
2018-08-06 18:48:43.689: [ AGFW][3823101696]{0:0:33} Preparing STOP command for: ora.mdnsd 1 1
2018-08-06 18:48:43.689: [ AGFW][3823101696]{0:0:33} ora.mdnsd 1 1 state changed from: ONLINE to: STOPPING
2018-08-06 18:48:43.690: [ora.mdnsd][4030613248]{0:0:33} [stop] (:CLSN00108:) clsn_agent::stop {
2018-08-06 18:48:43.690: [ora.mdnsd][4030613248]{0:0:33} [stop] getOracleHomeAttrib: oracle_home = /u01/app/11.2.0/grid
2018-08-06 18:48:43.691: [ora.mdnsd][4030613248]{0:0:33} [stop] PID 40375 from /u01/app/11.2.0/grid/mdns/init/ndg2.pid
2018-08-06 18:48:43.691: [ora.mdnsd][4030613248]{0:0:33} [stop] CLSDM Based stop action
2018-08-06 18:48:43.692: [ora.mdnsd][4030613248]{0:0:33} [stop] Using Timeout value of 18000 for stop message
2018-08-06 18:48:43.694: [ora.mdnsd][4030613248]{0:0:33} [stop] clsdmc_respget return: status=0, ecode=0
2018-08-06 18:48:47.822: [ USRTHRD][3815982848]{0:0:33} Thread:[DaemonCheck:mdnsd]Daemon Select Thread exiting
2018-08-06 18:48:47.822: [ USRTHRD][3815982848]{0:0:33} Thread:[DaemonCheck:mdnsd]Skipping Agent Initiated a check action
2018-08-06 18:48:47.822: [ USRTHRD][3815982848]{0:0:33} Thread:[DaemonCheck:mdnsd]isRunning is reset to false here
2018-08-06 18:48:48.696: [ora.mdnsd][4030613248]{0:0:33} [stop] (:CLSN00108:) clsn_agent::stop }
2018-08-06 18:48:48.696: [ AGFW][4030613248]{0:0:33} Command: stop for resource: ora.mdnsd 1 1 completed with status: SUCCESS
2018-08-06 18:48:48.697: [ AGFW][3823101696]{0:0:33} Agent sending reply for: RESOURCE_STOP[ora.mdnsd 1 1] ID 4099:415
2018-08-06 18:48:48.865: [ COMMCRS][4034815744]clsc_connect: (0x7f0bd80397a0) no listener at (ADDRESS=(PROTOCOL=ipc)(KEY=ndg2DBG_MDNSD))
[ clsdmc][4030613248]Fail to connect (ADDRESS=(PROTOCOL=ipc)(KEY=ndg2DBG_MDNSD)) with status 9
2018-08-06 18:48:48.865: [ora.mdnsd][4030613248]{0:0:33} [check] Error = error 9 encountered when connecting to MDNSD
2018-08-06 18:48:48.865: [ora.mdnsd][4030613248]{0:0:33} [check] Calling PID check for daemon
2018-08-06 18:48:48.865: [ora.mdnsd][4030613248]{0:0:33} [check] Process id 40375 translated to
2018-08-06 18:48:49.032: [ COMMCRS][4034815744]clsc_connect: (0x7f0bd8132bb0) no listener at (ADDRESS=(PROTOCOL=ipc)(KEY=ndg2DBG_MDNSD))
[ clsdmc][4030613248]Fail to connect (ADDRESS=(PROTOCOL=ipc)(KEY=ndg2DBG_MDNSD)) with status 9
2018-08-06 18:48:49.032: [ora.mdnsd][4030613248]{0:0:33} [check] Error = error 9 encountered when connecting to MDNSD
2018-08-06 18:48:49.033: [ AGFW][3823101696]{0:0:33} ora.mdnsd 1 1 state changed from: STOPPING to: OFFLINE
2018-08-06 18:48:49.033: [ AGFW][3823101696]{0:0:33} Agent sending last reply for: RESOURCE_STOP[ora.mdnsd 1 1] ID 4099:415
2018-08-06 18:48:49.033: [ AGFW][3823101696]{0:0:33} Agent has no resources to be monitored, Shutting down ..
2018-08-06 18:48:49.033: [ AGFW][3823101696]{0:0:33} Agent sending message to PE: AGENT_SHUTDOWN_REQUEST[Proxy] ID 20486:111
2018-08-06 18:48:49.036: [ AGFW][3823101696]{0:0:33} Agent is shutting down.
2018-08-06 18:48:49.036: [ AGFW][3823101696]{0:0:33} Agent is exiting with exit code: 1
2018-08-06 18:49:00.937: [ AGENT][1476831008] Logging level for Module: allcomp 0
2018-08-06 18:49:00.937: [ AGENT][1476831008] Logging level for Module: default 0
2018-08-06 18:49:00.937: [ AGENT][1476831008] Logging level for Module: AGENT 1
2018-08-06 18:49:00.937: [ AGENT][1476831008] Logging level for Module: AGFW 1
2018-08-06 18:49:00.937: [ AGENT][1476831008] Logging level for Module: CLSFRAME 0
2018-08-06 18:49:00.937: [ AGENT][1476831008] Logging level for Module: CRSCOMM 0
2018-08-06 18:49:00.937: [ AGENT][1476831008] Logging level for Module: CRSTIMER 0
2018-08-06 18:49:00.937: [ AGENT][1476831008] Logging level for Module: USRTHRD 1
2018-08-06 18:49:00.937: [ AGFW][1476831008] Starting the agent: /u01/app/11.2.0/grid/log/ndg2/agent/ohasd/oraagent_grid/
2018-08-06 18:49:00.937: [ AGENT][1476831008] Agent framework initialized, Process Id = 43707
2018-08-06 18:49:00.939: [ USRTHRD][1476831008] ConnectionPool::initMutex
2018-08-06 18:49:00.939: [ USRTHRD][1476831008] Process::convertPidToString pid = 43707
2018-08-06 18:49:00.939: [ AGFW][1476831008] SERVER IPC CONNECT STR: (ADDRESS=(PROTOCOL=IPC)(KEY=OHASD_IPC_SOCKET_11))
2018-08-06 18:49:00.939: [ AGFW][1476831008] Agent' version is: 2
2018-08-06 18:49:00.940: [CLSFRAME][1476831008] Inited lsf context 0x22b8240
2018-08-06 18:49:00.940: [CLSFRAME][1476831008] Initing CLS Framework messaging
2018-08-06 18:49:00.940: [CLSFRAME][1476831008] New Framework state: 2
2018-08-06 18:49:00.940: [CLSFRAME][1476831008] M2M is starting...
2018-08-06 18:49:00.940: [ CRSCOMM][1476831008] Ipc: Starting send thread
2018-08-06 18:49:00.940: [ CRSCOMM][1468225280] Ipc: sendWork thread started.
2018-08-06 18:49:00.942: [ CRSCOMM][1476831008] Connected to server running as user: root
2018-08-06 18:49:00.942: [ CRSCOMM][1466124032] IpcC: IPC Client thread started listening
2018-08-06 18:49:00.942: [ CRSCOMM][1466124032] IpcC: Received member number of 15
2018-08-06 18:49:00.942: [ CRSCOMM][1466124032] IpcC: Member data received
2018-08-06 18:49:00.943: [CLSFRAME][1466124032] New IPC Member:{Relative|Node:0|Process:0|Type:2}:OHASD:ndg2 username=root
2018-08-06 18:49:00.943: [CLSFRAME][1466124032] New process connected to us ID:{Relative|Node:0|Process:0|Type:2} Info:OHASD:ndg2
2018-08-06 18:49:00.943: [CLSFRAME][1476831008] Tints initialized with nodeId: 0 procId: 15
2018-08-06 18:49:00.943: [CLSFRAME][1476831008] Starting thread model named: MultiThread
2018-08-06 18:49:00.943: [CLSFRAME][1476831008] Starting thread model named: TimerSharedTM
2018-08-06 18:49:00.943: [CLSFRAME][1476831008] New Framework state: 3
2018-08-06 18:49:00.944: [ AGFW][1476831008] Agent Framework started successfully
2018-08-06 18:49:00.944: [ AGFW][1455617792]{0:15:2} Agfw engine module has enabled...
2018-08-06 18:49:00.945: [CLSFRAME][1455617792]{0:15:2} Module Enabling is complete
2018-08-06 18:49:00.945: [CLSFRAME][1455617792]{0:15:2} New Framework state: 6
2018-08-06 18:49:00.946: [CLSFRAME][1476831008] M2M is now powered by a doWork() thread.
2018-08-06 18:49:00.946: [ AGFW][1455617792]{0:15:2} Agent is started with userid: grid , expected user: grid
2018-08-06 18:49:00.946: [ CLSVER][1455617792]{0:15:2} Static Version 11.2.0.4.0
2018-08-06 18:49:00.946: [ AGFW][1455617792]{0:15:2} Agent sending message to PE: AGENT_HANDSHAKE[Proxy] ID 20484:11
2018-08-06 18:49:00.952: [ AGFW][1455617792]{0:15:2} Agent received the message: RESTYPE_ADD[ora.daemon.type] ID 8196:508
2018-08-06 18:49:00.953: [ AGFW][1455617792]{0:15:2} Agent does not have the type: ora.daemon.type
2018-08-06 18:49:00.953: [ AGFW][1455617792]{0:15:2} Agent do not have any action entries defined for type: ora.daemon.type
2018-08-06 18:49:00.953: [ AGFW][1455617792]{0:15:2} Could not find any base type named: cluster_resourcefor type: ora.daemon.type
2018-08-06 18:49:00.953: [ AGFW][1455617792]{0:15:2} Could not find any base type entry points for type: ora.daemon.type, Assuming script entry points.
2018-08-06 18:49:00.953: [ AGFW][1455617792]{0:15:2} Could not find the action entry: START
2018-08-06 18:49:00.953: [ AGFW][1455617792]{0:15:2} AGFW assuming START entry point defined in script.
2018-08-06 18:49:00.953: [ AGFW][1455617792]{0:15:2} Could not find the action entry: STOP
2018-08-06 18:49:00.953: [ AGFW][1455617792]{0:15:2} AGFW assuming STOP entry point defined in script.
2018-08-06 18:49:00.953: [ AGFW][1455617792]{0:15:2} Could not find the action entry: CHECK
2018-08-06 18:49:00.953: [ AGFW][1455617792]{0:15:2} AGFW assuming CHECK entry point defined in script.
2018-08-06 18:49:00.953: [ AGFW][1455617792]{0:15:2} Could not find the action entry: CLEAN
2018-08-06 18:49:00.953: [ AGFW][1455617792]{0:15:2} AGFW assuming CLEAN entry point defined in script.
2018-08-06 18:49:00.953: [ AGFW][1455617792]{0:15:2} Added new restype: ora.daemon.type
2018-08-06 18:49:00.954: [ AGFW][1455617792]{0:15:2} Agent sending last reply for: RESTYPE_ADD[ora.daemon.type] ID 8196:508
2018-08-06 18:49:00.954: [ AGFW][1455617792]{0:15:2} Agent received the message: RESTYPE_ADD[ora.asm.type] ID 8196:509
2018-08-06 18:49:00.954: [ AGFW][1455617792]{0:15:2} Added new restype: ora.asm.type
2018-08-06 18:49:00.955: [ AGFW][1455617792]{0:15:2} Agent sending last reply for: RESTYPE_ADD[ora.asm.type] ID 8196:509
2018-08-06 18:49:00.955: [ AGFW][1455617792]{0:15:2} Agent received the message: RESTYPE_ADD[ora.evm.type] ID 8196:510
2018-08-06 18:49:00.955: [ AGFW][1455617792]{0:15:2} Added new restype: ora.evm.type
2018-08-06 18:49:00.956: [ AGFW][1455617792]{0:15:2} Agent sending last reply for: RESTYPE_ADD[ora.evm.type] ID 8196:510
2018-08-06 18:49:00.956: [ AGFW][1455617792]{0:15:2} Agent received the message: RESTYPE_ADD[ora.gipc.type] ID 8196:511
2018-08-06 18:49:00.956: [ AGFW][1455617792]{0:15:2} Added new restype: ora.gipc.type
2018-08-06 18:49:00.957: [ AGFW][1455617792]{0:15:2} Agent sending last reply for: RESTYPE_ADD[ora.gipc.type] ID 8196:511
2018-08-06 18:49:00.957: [ AGFW][1455617792]{0:15:2} Agent received the message: RESTYPE_ADD[ora.gpnp.type] ID 8196:512
2018-08-06 18:49:00.957: [ AGFW][1455617792]{0:15:2} Added new restype: ora.gpnp.type
2018-08-06 18:49:00.958: [ AGFW][1455617792]{0:15:2} Agent sending last reply for: RESTYPE_ADD[ora.gpnp.type] ID 8196:512
2018-08-06 18:49:00.958: [ AGFW][1455617792]{0:15:2} Agent received the message: RESTYPE_ADD[ora.haip.type] ID 8196:513
2018-08-06 18:49:00.959: [ AGFW][1455617792]{0:15:2} Added new restype: ora.haip.type
2018-08-06 18:49:00.959: [ AGFW][1455617792]{0:15:2} Agent sending last reply for: RESTYPE_ADD[ora.haip.type] ID 8196:513
2018-08-06 18:49:00.960: [ AGFW][1455617792]{0:15:2} Agent received the message: RESTYPE_ADD[ora.mdns.type] ID 8196:514
2018-08-06 18:49:00.960: [ AGFW][1455617792]{0:15:2} Added new restype: ora.mdns.type
2018-08-06 18:49:00.961: [ AGFW][1455617792]{0:15:2} Agent sending last reply for: RESTYPE_ADD[ora.mdns.type] ID 8196:514
2018-08-06 18:49:00.961: [ AGFW][1455617792]{0:15:2} Agent received the message: RESOURCE_ADD[ora.gipcd 1 1] ID 4356:515
2018-08-06 18:49:00.961: [ AGFW][1455617792]{0:15:2} Added new resource: ora.gipcd 1 1 to the agfw
2018-08-06 18:49:00.962: [ AGFW][1455617792]{0:15:2} Agent sending last reply for: RESOURCE_ADD[ora.gipcd 1 1] ID 4356:515
2018-08-06 18:49:00.962: [ AGFW][1455617792]{0:15:2} Agent received the message: RESOURCE_ADD[ora.gpnpd 1 1] ID 4356:516
2018-08-06 18:49:00.962: [ AGFW][1455617792]{0:15:2} Added new resource: ora.gpnpd 1 1 to the agfw
2018-08-06 18:49:00.962: [ AGFW][1455617792]{0:15:2} Agent sending last reply for: RESOURCE_ADD[ora.gpnpd 1 1] ID 4356:516
2018-08-06 18:49:00.963: [ AGFW][1455617792]{0:15:2} Agent received the message: RESOURCE_ADD[ora.mdnsd 1 1] ID 4356:517
2018-08-06 18:49:00.963: [ AGFW][1455617792]{0:15:2} Added new resource: ora.mdnsd 1 1 to the agfw
2018-08-06 18:49:00.963: [ AGFW][1455617792]{0:15:2} Agent sending last reply for: RESOURCE_ADD[ora.mdnsd 1 1] ID 4356:517
2018-08-06 18:49:00.963: [ AGFW][1455617792]{0:0:154} Agent received the message: RESOURCE_START[ora.mdnsd 1 1] ID 4098:518
2018-08-06 18:49:00.963: [ AGFW][1455617792]{0:0:154} Preparing START command for: ora.mdnsd 1 1
2018-08-06 18:49:00.963: [ AGFW][1455617792]{0:0:154} ora.mdnsd 1 1 state changed from: UNKNOWN to: STARTING
2018-08-06 18:49:00.964: [ora.mdnsd][1457719040]{0:0:154} [start] (:CLSN00107:) clsn_agent::start {
2018-08-06 18:49:00.964: [ora.mdnsd][1457719040]{0:0:154} [start] __IS_HASD_AGENT=TRUE
2018-08-06 18:49:00.965: [ora.mdnsd][1457719040]{0:0:154} [start] getOracleHomeAttrib: oracle_home = /u01/app/11.2.0/grid
2018-08-06 18:49:00.965: [ora.mdnsd][1457719040]{0:0:154} [start] Utils::execCmd 1 USR_ORA_ENV: oracleHome:/u01/app/11.2.0/grid CrsHome:/u01/app/11.2.0/grid
2018-08-06 18:49:00.965: [ora.mdnsd][1457719040]{0:0:154} [start] Adding Environment Variables ORA_DAEMON_LOGGING_LEVELS=MDNS=3
2018-08-06 18:49:00.965: [ora.mdnsd][1457719040]{0:0:154} [start] Adding Environment Variables ORA_DAEMON_TRACING_LEVELS=MDNS=3
2018-08-06 18:49:00.965: [ora.mdnsd][1457719040]{0:0:154} [start] Adding Environment Variables _ORA_AGENT_ACTION=TRUE
2018-08-06 18:49:00.965: [ora.mdnsd][1457719040]{0:0:154} [start] Adding Environment Variables __IS_HASD_AGENT=
2018-08-06 18:49:00.965: [ora.mdnsd][1457719040]{0:0:154} [start] Utils:execCmd action = 1 flags = 5 ohome = (null) cmdname = mdnsd.
2018-08-06 18:49:00.965: [ora.mdnsd][1457719040]{0:0:154} [start] getOracleHomeAttrib: oracle_home = /u01/app/11.2.0/grid
2018-08-06 18:49:00.968: [ora.mdnsd][1457719040]{0:0:154} [start] execCmd ret = 0
2018-08-06 18:49:01.969: [ora.mdnsd][1457719040]{0:0:154} [start] without returnbuf
2018-08-06 18:49:01.973: [ora.mdnsd][1457719040]{0:0:154} [start] clsdmc_respget return: status=0, ecode=0
2018-08-06 18:49:01.973: [ora.mdnsd][1457719040]{0:0:154} [start] getOracleHomeAttrib: oracle_home = /u01/app/11.2.0/grid
2018-08-06 18:49:01.974: [ora.mdnsd][1457719040]{0:0:154} [start] PID 43719 from /u01/app/11.2.0/grid/mdns/init/ndg2.pid
2018-08-06 18:49:01.974: [ora.mdnsd][1457719040]{0:0:154} [start] }DaemonAgent::start
2018-08-06 18:49:01.974: [ora.mdnsd][1457719040]{0:0:154} [start] (:CLSN00107:) clsn_agent::start }
2018-08-06 18:49:01.974: [ AGFW][1457719040]{0:0:154} Command: start for resource: ora.mdnsd 1 1 completed with status: SUCCESS
2018-08-06 18:49:01.975: [CLSFRAME][1476831008] TM [MultiThread] is changing desired thread # to 3. Current # is 2
2018-08-06 18:49:01.976: [ AGFW][1455617792]{0:0:154} Agent sending reply for: RESOURCE_START[ora.mdnsd 1 1] ID 4098:518
2018-08-06 18:49:01.976: [ora.mdnsd][1457719040]{0:0:154} [check] clsdmc_respget return: status=0, ecode=0
2018-08-06 18:49:01.978: [ USRTHRD][1457719040]{0:0:154} Thread:[DaemonCheck:mdnsd]start {
2018-08-06 18:49:01.978: [ USRTHRD][1457719040]{0:0:154} Thread:[DaemonCheck:mdnsd]start }
2018-08-06 18:49:01.978: [ AGFW][1455617792]{0:0:154} ora.mdnsd 1 1 state changed from: STARTING to: ONLINE
2018-08-06 18:49:01.978: [ AGFW][1455617792]{0:0:154} Started implicit monitor for [ora.mdnsd 1 1] interval=30000 delay=30000
2018-08-06 18:49:01.979: [ AGFW][1455617792]{0:0:154} Agent sending last reply for: RESOURCE_START[ora.mdnsd 1 1] ID 4098:518
2018-08-06 18:49:02.145: [ AGFW][1455617792]{0:0:162} Agent received the message: RESOURCE_START[ora.gpnpd 1 1] ID 4098:536
2018-08-06 18:49:02.145: [ AGFW][1455617792]{0:0:162} Preparing START command for: ora.gpnpd 1 1
2018-08-06 18:49:02.145: [ AGFW][1455617792]{0:0:162} ora.gpnpd 1 1 state changed from: UNKNOWN to: STARTING
2018-08-06 18:49:02.146: [ora.gpnpd][1457719040]{0:0:162} [start] (:CLSN00107:) clsn_agent::start {
2018-08-06 18:49:02.146: [ora.gpnpd][1457719040]{0:0:162} [start] __IS_HASD_AGENT=TRUE
2018-08-06 18:49:02.146: [ora.gpnpd][1457719040]{0:0:162} [start] getOracleHomeAttrib: oracle_home = /u01/app/11.2.0/grid
2018-08-06 18:49:02.146: [ora.gpnpd][1457719040]{0:0:162} [start] Utils::execCmd 1 USR_ORA_ENV: oracleHome:/u01/app/11.2.0/grid CrsHome:/u01/app/11.2.0/grid
2018-08-06 18:49:02.146: [ora.gpnpd][1457719040]{0:0:162} [start] Adding Environment Variables ORA_DAEMON_LOGGING_LEVELS=GPNP=1,GIPC=1,RD=1,CLSXSIG=1,CLSXSEC=1,OCRAPI=1,OCRCLI=1,OCRMSG=0
2018-08-06 18:49:02.146: [ora.gpnpd][1457719040]{0:0:162} [start] Adding Environment Variables ORA_DAEMON_TRACING_LEVELS=GPNP=0,GIPC=0,RD=0,CLSXSIG=0,CLSXSEC=0,OCRAPI=0,OCRCLI=0,OCRMSG=0
2018-08-06 18:49:02.146: [ora.gpnpd][1457719040]{0:0:162} [start] Adding Environment Variables _ORA_AGENT_ACTION=TRUE
2018-08-06 18:49:02.146: [ora.gpnpd][1457719040]{0:0:162} [start] Adding Environment Variables __IS_HASD_AGENT=
2018-08-06 18:49:02.146: [ora.gpnpd][1457719040]{0:0:162} [start] Utils:execCmd action = 1 flags = 5 ohome = (null) cmdname = gpnpd.
2018-08-06 18:49:02.147: [ora.gpnpd][1457719040]{0:0:162} [start] getOracleHomeAttrib: oracle_home = /u01/app/11.2.0/grid
2018-08-06 18:49:02.150: [ora.gpnpd][1457719040]{0:0:162} [start] execCmd ret = 0
2018-08-06 18:49:03.150: [ora.gpnpd][1457719040]{0:0:162} [start] without returnbuf
2018-08-06 18:49:03.154: [ora.gpnpd][1457719040]{0:0:162} [start] clsdmc_respget return: status=0, ecode=0
2018-08-06 18:49:03.154: [ora.gpnpd][1457719040]{0:0:162} [start] getOracleHomeAttrib: oracle_home = /u01/app/11.2.0/grid
2018-08-06 18:49:03.155: [ora.gpnpd][1457719040]{0:0:162} [start] PID 43732 from /u01/app/11.2.0/grid/gpnp/init/ndg2.pid
2018-08-06 18:49:03.155: [ora.gpnpd][1457719040]{0:0:162} [start] }DaemonAgent::start
2018-08-06 18:49:03.155: [ora.gpnpd][1457719040]{0:0:162} [start] (:CLSN00107:) clsn_agent::start }
2018-08-06 18:49:03.155: [ AGFW][1457719040]{0:0:162} Command: start for resource: ora.gpnpd 1 1 completed with status: SUCCESS
2018-08-06 18:49:03.157: [ AGFW][1455617792]{0:0:162} Agent sending reply for: RESOURCE_START[ora.gpnpd 1 1] ID 4098:536
2018-08-06 18:49:03.157: [ora.gpnpd][1457719040]{0:0:162} [check] clsdmc_respget return: status=0, ecode=0
2018-08-06 18:49:03.158: [ USRTHRD][1457719040]{0:0:162} Thread:[DaemonCheck:gpnpd]start {
2018-08-06 18:49:03.158: [ USRTHRD][1457719040]{0:0:162} Thread:[DaemonCheck:gpnpd]start }
2018-08-06 18:49:03.159: [ AGFW][1455617792]{0:0:162} ora.gpnpd 1 1 state changed from: STARTING to: ONLINE
2018-08-06 18:49:03.159: [ AGFW][1455617792]{0:0:162} Started implicit monitor for [ora.gpnpd 1 1] interval=30000 delay=30000
2018-08-06 18:49:03.159: [ AGFW][1455617792]{0:0:162} Agent sending last reply for: RESOURCE_START[ora.gpnpd 1 1] ID 4098:536
2018-08-06 18:49:03.595: [ AGFW][1455617792]{0:0:163} Agent received the message: RESOURCE_START[ora.gipcd 1 1] ID 4098:547
2018-08-06 18:49:03.595: [ AGFW][1455617792]{0:0:163} Preparing START command for: ora.gipcd 1 1
2018-08-06 18:49:03.595: [ AGFW][1455617792]{0:0:163} ora.gipcd 1 1 state changed from: UNKNOWN to: STARTING
2018-08-06 18:49:03.596: [ora.gipcd][1457719040]{0:0:163} [start] (:CLSN00107:) clsn_agent::start {
2018-08-06 18:49:03.597: [ora.gipcd][1457719040]{0:0:163} [start] __IS_HASD_AGENT=TRUE
2018-08-06 18:49:03.597: [ora.gipcd][1457719040]{0:0:163} [start] getOracleHomeAttrib: oracle_home = /u01/app/11.2.0/grid
2018-08-06 18:49:03.597: [ora.gipcd][1457719040]{0:0:163} [start] Utils::execCmd 1 USR_ORA_ENV: oracleHome:/u01/app/11.2.0/grid CrsHome:/u01/app/11.2.0/grid
2018-08-06 18:49:03.597: [ora.gipcd][1457719040]{0:0:163} [start] Adding Environment Variables ORA_DAEMON_LOGGING_LEVELS=CLNTCOMM=2,NODECOMM=2,MONTCOMM=2,GIPCD=2,GIPCDNDE=2,GIPCDCLT=2,GIPCDMON=2
2018-08-06 18:49:03.597: [ora.gipcd][1457719040]{0:0:163} [start] Adding Environment Variables ORA_DAEMON_TRACING_LEVELS=CLNTCOMM=2,NODECOMM=2,MONTCOMM=2,GIPCD=2,GIPCDNDE=2,GIPCDCLT=2,GIPCDMON=2
2018-08-06 18:49:03.597: [ora.gipcd][1457719040]{0:0:163} [start] Adding Environment Variables _ORA_AGENT_ACTION=TRUE
2018-08-06 18:49:03.597: [ora.gipcd][1457719040]{0:0:163} [start] Adding Environment Variables __IS_HASD_AGENT=
2018-08-06 18:49:03.597: [ora.gipcd][1457719040]{0:0:163} [start] Utils:execCmd action = 1 flags = 5 ohome = (null) cmdname = gipcd.
2018-08-06 18:49:03.597: [ora.gipcd][1457719040]{0:0:163} [start] getOracleHomeAttrib: oracle_home = /u01/app/11.2.0/grid
2018-08-06 18:49:03.601: [ora.gipcd][1457719040]{0:0:163} [start] execCmd ret = 0
2018-08-06 18:49:04.601: [ora.gipcd][1457719040]{0:0:163} [start] without returnbuf
2018-08-06 18:49:04.605: [ora.gipcd][1457719040]{0:0:163} [start] clsdmc_respget return: status=0, ecode=0
2018-08-06 18:49:04.606: [ora.gipcd][1457719040]{0:0:163} [start] getOracleHomeAttrib: oracle_home = /u01/app/11.2.0/grid
2018-08-06 18:49:04.606: [ora.gipcd][1457719040]{0:0:163} [start] PID 43760 from /u01/app/11.2.0/grid/gipc/init/ndg2.pid
2018-08-06 18:49:04.606: [ora.gipcd][1457719040]{0:0:163} [start] }DaemonAgent::start
2018-08-06 18:49:04.606: [ora.gipcd][1457719040]{0:0:163} [start] (:CLSN00107:) clsn_agent::start }
2018-08-06 18:49:04.606: [ AGFW][1457719040]{0:0:163} Command: start for resource: ora.gipcd 1 1 completed with status: SUCCESS
2018-08-06 18:49:04.608: [ AGFW][1455617792]{0:0:163} Agent sending reply for: RESOURCE_START[ora.gipcd 1 1] ID 4098:547
2018-08-06 18:49:04.609: [ora.gipcd][1457719040]{0:0:163} [check] clsdmc_respget return: status=0, ecode=0
2018-08-06 18:49:04.610: [ USRTHRD][1457719040]{0:0:163} Thread:[DaemonCheck:gipcd]start {
2018-08-06 18:49:04.610: [ USRTHRD][1457719040]{0:0:163} Thread:[DaemonCheck:gipcd]start }
2018-08-06 18:49:04.611: [ AGFW][1455617792]{0:0:163} ora.gipcd 1 1 state changed from: STARTING to: ONLINE
2018-08-06 18:49:04.611: [ AGFW][1455617792]{0:0:163} Started implicit monitor for [ora.gipcd 1 1] interval=30000 delay=30000
2018-08-06 18:49:04.611: [ AGFW][1455617792]{0:0:163} Agent sending last reply for: RESOURCE_START[ora.gipcd 1 1] ID 4098:547
2018-08-06 18:49:04.611: [CLSFRAME][1476831008] TM [MultiThread] is changing desired thread # to 4. Current # is 3
2018-08-06 18:49:31.995: [ora.mdnsd][1457719040]{0:0:154} [check] clsdmc_respget return: status=0, ecode=0
2018-08-06 18:49:33.169: [ora.gpnpd][1457719040]{0:0:162} [check] clsdmc_respget return: status=0, ecode=0
2018-08-06 18:49:34.622: [ora.gipcd][1457719040]{0:0:163} [check] clsdmc_respget return: status=0, ecode=0
2018-08-06 18:49:57.733: [ AGFW][1455617792]{0:0:210} Agent received the message: RESOURCE_ADD[ora.asm 1 1] ID 4356:711
2018-08-06 18:49:57.734: [ AGFW][1455617792]{0:0:210} Added new resource: ora.asm 1 1 to the agfw
2018-08-06 18:49:57.734: [ AGFW][1455617792]{0:0:210} Agent sending last reply for: RESOURCE_ADD[ora.asm 1 1] ID 4356:711
2018-08-06 18:49:57.739: [ AGFW][1455617792]{0:0:210} Agent received the message: RESOURCE_START[ora.asm 1 1] ID 4098:713
2018-08-06 18:49:57.739: [ AGFW][1455617792]{0:0:210} Preparing START command for: ora.asm 1 1
2018-08-06 18:49:57.739: [ AGFW][1455617792]{0:0:210} ora.asm 1 1 state changed from: UNKNOWN to: STARTING
2018-08-06 18:49:57.740: [ora.asm][1457719040]{0:0:210} [start] (:CLSN00107:) clsn_agent::start {
2018-08-06 18:49:57.740: [ora.asm][1457719040]{0:0:210} [start] __IS_HASD_AGENT = TRUE
2018-08-06 18:49:57.740: [ora.asm][1457719040]{0:0:210} [start] DgpAgent::DgpAgent: enter {
2018-08-06 18:49:57.740: [ora.asm][1457719040]{0:0:210} [start] DgpAgent::DgpAgent: resname ora.dummyOcrDg.dg compId dummyOcrDg asmCommonAgent 3813dcb8
2018-08-06 18:49:57.741: [ora.asm][1457719040]{0:0:210} [start] DgpAgent::DgpAgent: exit }
2018-08-06 18:49:57.741: [ora.asm][1457719040]{0:0:210} [start] AsmAgent::AsmAgent Constructor resName ora.asm compId +ASM
2018-08-06 18:49:57.741: [ora.asm][1457719040]{0:0:210} [start] AsmAgent::refresh
2018-08-06 18:49:57.741: [ora.asm][1457719040]{0:0:210} [start] AsmAgent::refresh ORACLE_HOME = /u01/app/11.2.0/grid
2018-08-06 18:49:57.741: [ora.asm][1457719040]{0:0:210} [start] AsmAgent:getOracleSid 2 oracle_sid =
2018-08-06 18:49:57.741: [ora.asm][1457719040]{0:0:210} [start] AsmAgent:getOracleSid 4 oracle_sid =
2018-08-06 18:49:57.753: [ora.asm][1457719040]{0:0:210} [start] Node 0 doesn't exist
2018-08-06 18:49:57.753: [ora.asm][1457719040]{0:0:210} [start] AsmAgent::getOracleSid: Exception IntException
2018-08-06 18:49:57.753: [ora.asm][1457719040]{0:0:210} [start] AsmAgent::getOracleSidAttrib getCssNodeName Error: Agents: clssnsqlnum ret = 12:
2018-08-06 18:49:57.753: [ora.asm][1457719040]{0:0:210} [start] AsmAgent:getOracleSid 5 oracle_sid = +ASM2
2018-08-06 18:49:57.753: [ora.asm][1457719040]{0:0:210} [start] AsmAgent:getOracleSid oracle_sid = +ASM2
2018-08-06 18:49:57.753: [ora.asm][1457719040]{0:0:210} [start] AsmAgent::refresh ORACLE_SID = +ASM2
2018-08-06 18:49:57.753: [ora.asm][1457719040]{0:0:210} [start] CssData Constructor groupName:HB+ASM cssRegistrationType:0 memno:-1
2018-08-06 18:49:57.753: [ USRTHRD][1457719040]{0:0:210} CssData::initMutex &m_cssDataLock:3816dd08
2018-08-06 18:49:57.756: [ora.asm][1457719040]{0:0:210} [start] CssGroup::regis registration of groupName:HB+ASM mbrid:-1 m_grpNum:-1 regType:0 succeeded
2018-08-06 18:49:57.756: [ora.asm][1457719040]{0:0:210} [start] CssData::Constructor regis succeeded groupName:HB+ASM memno:-1
2018-08-06 18:49:57.756: [ora.asm][1457719040]{0:0:210} [start] CssData::Constructor m_pCssGroup:3816bbc0 group HB+ASM
2018-08-06 18:49:57.756: [ora.asm][1457719040]{0:0:210} [start] InstAgent::init m_groupName:HB+ASM m_pCssData 3816cc40
2018-08-06 18:49:57.756: [ora.asm][1457719040]{0:0:210} [start] getOracleHomeAttrib: oracle_home = /u01/app/11.2.0/grid
2018-08-06 18:49:57.756: [ora.asm][1457719040]{0:0:210} [start] ConnectionPool::ConnectionPool 2 m_oracleHome:/u01/app/11.2.0/grid, m_oracleSid:+ASM2, m_usrOraEnv:
2018-08-06 18:49:57.757: [ora.asm][1457719040]{0:0:210} [start] InstAgent::start {
2018-08-06 18:49:57.757: [ora.asm][1457719040]{0:0:210} [start] ConnectionPool::stopConnection
2018-08-06 18:49:57.757: [ora.asm][1457719040]{0:0:210} [start] ConnectionPool::removeConnection connection count 0
2018-08-06 18:49:57.757: [ora.asm][1457719040]{0:0:210} [start] ConnectionPool::removeConnection freed 0
2018-08-06 18:49:57.757: [ora.asm][1457719040]{0:0:210} [start] ConnectionPool::stopConnection sid +ASM2 status 1
2018-08-06 18:49:57.757: [ USRTHRD][1457719040]{0:0:210} ConnectionPool::~ConnectionPool m_oracleHome:/u01/app/11.2.0/grid, m_oracleSid:+ASM2, m_usrOraEnv:
2018-08-06 18:49:57.757: [ora.asm][1457719040]{0:0:210} [start] AsmAgent::refresh
2018-08-06 18:49:57.757: [ora.asm][1457719040]{0:0:210} [start] AsmAgent::refresh ORACLE_HOME = /u01/app/11.2.0/grid
2018-08-06 18:49:57.757: [ora.asm][1457719040]{0:0:210} [start] AsmAgent:getOracleSid 2 oracle_sid =
2018-08-06 18:49:57.757: [ora.asm][1457719040]{0:0:210} [start] AsmAgent:getOracleSid 4 oracle_sid =
2018-08-06 18:49:57.758: [ora.asm][1457719040]{0:0:210} [start] Node 0 doesn't exist
2018-08-06 18:49:57.758: [ora.asm][1457719040]{0:0:210} [start] AsmAgent::getOracleSid: Exception IntException
2018-08-06 18:49:57.758: [ora.asm][1457719040]{0:0:210} [start] AsmAgent::getOracleSidAttrib getCssNodeName Error: Agents: clssnsqlnum ret = 12:
2018-08-06 18:49:57.758: [ora.asm][1457719040]{0:0:210} [start] AsmAgent:getOracleSid 5 oracle_sid = +ASM2
2018-08-06 18:49:57.758: [ora.asm][1457719040]{0:0:210} [start] AsmAgent:getOracleSid oracle_sid = +ASM2
2018-08-06 18:49:57.758: [ora.asm][1457719040]{0:0:210} [start] AsmAgent::refresh ORACLE_SID = +ASM2
2018-08-06 18:49:57.758: [ora.asm][1457719040]{0:0:210} [start] getOracleHomeAttrib: oracle_home = /u01/app/11.2.0/grid
2018-08-06 18:49:57.758: [ora.asm][1457719040]{0:0:210} [start] ConnectionPool::ConnectionPool 2 m_oracleHome:/u01/app/11.2.0/grid, m_oracleSid:+ASM2, m_usrOraEnv:
2018-08-06 18:49:57.758: [ora.asm][1457719040]{0:0:210} [start] updating GEN_USR_ORA_INST_NAME to +ASM2
2018-08-06 18:49:57.758: [ora.asm][1457719040]{0:0:210} [start] clsnUtils::setResAttrib nonPerX current value GEN_USR_ORA_INST_NAME value
2018-08-06 18:49:57.758: [ora.asm][1457719040]{0:0:210} [start] setResAttrib cmdid 0x0101 checktype 0xffff
2018-08-06 18:49:57.758: [ora.asm][1457719040]{0:0:210} [start] setResAttrib calling clsagfw_modify_attribute attr GEN_USR_ORA_INST_NAME value +ASM2
2018-08-06 18:49:57.759: [ AGFW][1457719040]{0:0:210} Sending modify attr msg [GEN_USR_ORA_INST_NAME:+ASM2] for start for resource: ora.asm 1 1
2018-08-06 18:49:57.759: [ora.asm][1457719040]{0:0:210} [start] setResAttrib clsagfw_modify_attribute attr GEN_USR_ORA_INST_NAME value +ASM2 retCode 1
2018-08-06 18:49:57.759: [ora.asm][1457719040]{0:0:210} [start] sModifyConfig for +ASM
2018-08-06 18:49:57.759: [ora.asm][1457719040]{0:0:210} [start] getOracleHomeAttrib: oracle_home = /u01/app/11.2.0/grid
2018-08-06 18:49:57.759: [ora.asm][1457719040]{0:0:210} [start] sclsnInstAgent::sUpdateOratab oratab is /etc/oratab
2018-08-06 18:49:57.759: [ AGFW][1455617792]{0:0:210} Agent sending reply for: RESOURCE_START[ora.asm 1 1] ID 4098:713
2018-08-06 18:49:57.760: [ora.asm][1457719040]{0:0:210} [start] ConfigFile::setAltName altName = +ASM
2018-08-06 18:49:57.760: [ora.asm][1457719040]{0:0:210} [start] ConfigFile::setAltValue altValue = /u01/app/11.2.0/grid:N
2018-08-06 18:49:57.760: [ora.asm][1457719040]{0:0:210} [start] sclsnInstAgent::sUpdateOratab CssLock
2018-08-06 18:49:57.764: [ora.asm][1457719040]{0:0:210} [start] AsmAgent:getOracleSid 2 oracle_sid =
2018-08-06 18:49:57.764: [ora.asm][1457719040]{0:0:210} [start] AsmAgent:getOracleSid 4 oracle_sid =
2018-08-06 18:49:57.765: [ora.asm][1457719040]{0:0:210} [start] Node 0 doesn't exist
2018-08-06 18:49:57.765: [ora.asm][1457719040]{0:0:210} [start] AsmAgent::getOracleSid: Exception IntException
2018-08-06 18:49:57.765: [ora.asm][1457719040]{0:0:210} [start] AsmAgent::getOracleSidAttrib getCssNodeName Error: Agents: clssnsqlnum ret = 12:
2018-08-06 18:49:57.765: [ora.asm][1457719040]{0:0:210} [start] AsmAgent:getOracleSid 5 oracle_sid = +ASM2
2018-08-06 18:49:57.765: [ora.asm][1457719040]{0:0:210} [start] AsmAgent:getOracleSid oracle_sid = +ASM2
2018-08-06 18:49:57.765: [ora.asm][1457719040]{0:0:210} [start] ConfigFile::getAltEntry altEntry =
2018-08-06 18:49:57.765: [ora.asm][1457719040]{0:0:210} [start] ConfigFile::getValue name +asm2 value
2018-08-06 18:49:57.767: [ora.asm][1457719040]{0:0:210} [start] ConfigFile::updateInPlace file /etc/oratab is updated
2018-08-06 18:49:57.768: [ora.asm][1457719040]{0:0:210} [start] sclsnInstAgent::sUpdateOratab file updated with dbName +ASM2 value /u01/app/11.2.0/grid:N
2018-08-06 18:49:57.768: [ora.asm][1457719040]{0:0:210} [start] sclsnInstAgent::sUpdateOratab CSS unlock
2018-08-06 18:49:57.771: [ora.asm][1457719040]{0:0:210} [start] getResAttrib: attrib name USR_ORA_OPI value false len 5
2018-08-06 18:49:57.771: [ USRTHRD][1457719040]{0:0:210} InstConnection::initMutex AttachLock 00ae3210 DetachLock 00ae3228
2018-08-06 18:49:57.771: [ora.asm][1457719040]{0:0:210} [start] clsnInstConnection::makeConnectStr UsrOraEnv m_oracleHome /u01/app/11.2.0/grid Crshome /u01/app/11.2.0/grid
2018-08-06 18:49:57.771: [ora.asm][1457719040]{0:0:210} [start] makeConnectStr = (DESCRIPTION=(ADDRESS=(PROTOCOL=beq)(PROGRAM=/u01/app/11.2.0/grid/bin/oracle)(ARGV0=oracle+ASM2)(ENVS='ORACLE_HOME=/u01/app/11.2.0/grid,ORACLE_SID=+ASM2')(ARGS='(DESCRIPTION=(LOCAL=YES)(ADDRESS=(PROTOCOL=beq)))'))(CONNECT_DATA=(SID=+ASM2)))
2018-08-06 18:49:57.776: [ora.asm][1457719040]{0:0:210} [start] Container:start oracle home /u01/app/11.2.0/grid
2018-08-06 18:49:57.776: [ora.asm][1457719040]{0:0:210} [start] InstConnection::connectInt: server not attached
2018-08-06 18:49:57.777: [ AGFW][1455617792]{0:0:210} Agent received the message: RESOURCE_MODIFY_ATTR[ora.asm 1 1] ID 4355:717
2018-08-06 18:49:57.802: [ora.asm][1457719040]{0:0:210} [start] InstConnection:connectInt connected
2018-08-06 18:49:57.802: [ora.asm][1457719040]{0:0:210} [start] InstAgent::startup
2018-08-06 18:50:01.991: [ora.mdnsd][1451607808]{0:0:154} [check] clsdmc_respget return: status=0, ecode=0
2018-08-06 18:50:03.174: [ora.gpnpd][1451607808]{0:0:162} [check] clsdmc_respget return: status=0, ecode=0
2018-08-06 18:50:04.627: [ora.gipcd][1451607808]{0:0:163} [check] clsdmc_respget return: status=0, ecode=0
2018-08-06 18:50:30.919: [ AGFW][1455617792]{0:0:154} Agent received the message: AGENT_HB[Engine] ID 12293:724
2018-08-06 18:50:32.002: [ora.mdnsd][1451607808]{0:0:154} [check] clsdmc_respget return: status=0, ecode=0
2018-08-06 18:50:33.176: [ora.gpnpd][1428621056]{0:0:162} [check] clsdmc_respget return: status=0, ecode=0
2018-08-06 18:50:34.629: [ora.gipcd][1428621056]{0:0:163} [check] clsdmc_respget return: status=0, ecode=0
2018-08-06 18:51:00.925: [ AGFW][1455617792]{0:0:154} Agent received the message: AGENT_HB[Engine] ID 12293:734
2018-08-06 18:51:02.008: [ora.mdnsd][1428621056]{0:0:154} [check] clsdmc_respget return: status=0, ecode=0
2018-08-06 18:51:03.182: [ora.gpnpd][1428621056]{0:0:162} [check] clsdmc_respget return: status=0, ecode=0
2018-08-06 18:51:04.635: [ora.gipcd][1428621056]{0:0:163} [check] clsdmc_respget return: status=0, ecode=0
2018-08-06 18:51:32.009: [ora.mdnsd][1428621056]{0:0:154} [check] clsdmc_respget return: status=0, ecode=0
2018-08-06 18:51:33.192: [ora.gpnpd][1428621056]{0:0:162} [check] clsdmc_respget return: status=0, ecode=0
2018-08-06 18:51:34.636: [ora.gipcd][1428621056]{0:0:163} [check] clsdmc_respget return: status=0, ecode=0
2018-08-06 18:51:58.853: [ora.asm][1457719040]{0:0:210} [start] ORA-03113: end-of-file on communication channel
Process ID: 0
Session ID: 0 Serial number: 0
2018-08-06 18:51:58.853: [ora.asm][1457719040]{0:0:210} [start] InstAgent::start: 1 errcode 3113
2018-08-06 18:51:58.853: [ora.asm][1457719040]{0:0:210} [start] InstAgent::start: untrapped error
2018-08-06 18:51:58.853: [ora.asm][1457719040]{0:0:210} [start] InstAgent::start: 2 errcode 3113
2018-08-06 18:51:58.853: [ USRTHRD][1457719040]{0:0:210} InstConnection:~InstConnection: this 38178e70
2018-08-06 18:51:58.854: [ora.asm][1457719040]{0:0:210} [start] clean {
2018-08-06 18:51:58.854: [ora.asm][1457719040]{0:0:210} [start] InstAgent::stop_option stop mode immediate option 1
2018-08-06 18:51:58.854: [ora.asm][1457719040]{0:0:210} [start] InstAgent::stop {
2018-08-06 18:51:58.854: [ora.asm][1457719040]{0:0:210} [start] getResAttrib: attrib name USR_ORA_OPI value false len 5
2018-08-06 18:51:58.854: [ora.asm][1457719040]{0:0:210} [start] InstAgent::stop original reason system do shutdown abort
2018-08-06 18:51:58.854: [ora.asm][1457719040]{0:0:210} [start] ConnectionPool::resetConnection s_statusOfConnectionMap 00ae9760
2018-08-06 18:51:58.854: [ora.asm][1457719040]{0:0:210} [start] ConnectionPool::resetConnection sid +ASM2 status 2
2018-08-06 18:51:58.854: [ora.asm][1457719040]{0:0:210} [start] Gimh::check OH /u01/app/11.2.0/grid SID +ASM2
2018-08-06 18:51:58.854: [ora.asm][1457719040]{0:0:210} [start] Gimh::check condition changes to (GIMH_NEXT_NUM) 0,1,7 exists
2018-08-06 18:51:58.854: [ora.asm][1457719040]{0:0:210} [start] (:CLSN00006:)AsmAgent::check failed gimh state 0
2018-08-06 18:51:58.854: [ora.asm][1457719040]{0:0:210} [start] AsmAgent::check ocrCheck 1 m_OcrOnline 0 m_OcrTimer 0
2018-08-06 18:51:58.855: [ora.asm][1457719040]{0:0:210} [start] DgpAgent::initOcrDgpSet { entry
2018-08-06 18:51:58.855: [ora.asm][1457719040]{0:0:210} [start] DgpAgent::initOcrDgpSet procr_get_conf: retval [0] configured [1] local only [0] error buffer []
2018-08-06 18:51:58.855: [ora.asm][1457719040]{0:0:210} [start] DgpAgent::initOcrDgpSet procr_get_conf: OCR loc [0], Disk Group : [+OCR]
2018-08-06 18:51:58.855: [ora.asm][1457719040]{0:0:210} [start] DgpAgent::initOcrDgpSet m_ocrDgpSet 3813df68 dgName OCR
2018-08-06 18:51:58.855: [ora.asm][1457719040]{0:0:210} [start] DgpAgent::initOcrDgpSet ocrret 0 found 1
2018-08-06 18:51:58.855: [ora.asm][1457719040]{0:0:210} [start] DgpAgent::initOcrDgpSet ocrDgpSet OCR
2018-08-06 18:51:58.855: [ora.asm][1457719040]{0:0:210} [start] DgpAgent::initOcrDgpSet exi