On node mdb5, I have:
# crsctl check cluster
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online
On node mdb6, I have:
# crsctl check cluster
CRS-4535: Cannot communicate with Cluster Ready Services
CRS-4530: Communications failure contacting Cluster Synchronization Services daemon
CRS-4534: Cannot communicate with Event Manager
# ps -eaf | grep grid
root 3124 1 0 Jun15 ? 00:02:05 /ds4-trenaz/opt/grid/11.2.0/bin/ohasd.bin reboot
oracle 3236 1 0 Jun15 ? 00:00:16 /ds4-trenaz/opt/grid/11.2.0/bin/oraagent.bin
oracle 3248 1 0 Jun15 ? 00:00:01 /ds4-trenaz/opt/grid/11.2.0/bin/mdnsd.bin
oracle 3258 1 0 Jun15 ? 00:00:19 /ds4-trenaz/opt/grid/11.2.0/bin/gpnpd.bin
oracle 3270 1 0 Jun15 ? 00:01:13 /ds4-trenaz/opt/grid/11.2.0/bin/gipcd.bin
root 3272 1 0 Jun15 ? 00:00:08 /ds4-trenaz/opt/grid/11.2.0/bin/orarootagent.bin
root 3286 1 0 Jun15 ? 00:08:45 /ds4-trenaz/opt/grid/11.2.0/bin/osysmond.bin
root 3362 1 0 Jun15 ? 00:01:51 /ds4-trenaz/opt/grid/11.2.0/bin/ologgerd -M -d /ds4-trenaz/opt/grid/11.2.0/crf/db/mdb6
root 4763 1 0 00:35 ? 00:00:54 /ds4-trenaz/opt/grid/11.2.0/bin/cssdmonitor
root 9036 28417 0 19:35 pts/1 00:00:00 grep grid
If I shutdown crs on node mdb5, then I can fully startup crs on node mdb6.
I am using NFS as for OCR, and the mount options are shown below according to Oracle documentation.
# ocrcheck
Status of Oracle Cluster Registry is as follows :
Version : 3
Total space (kbytes) : 262120
Used space (kbytes) : 2440
Available space (kbytes) : 259680
ID : 138062961
Device/File Name : /ds7-trenaz/nfs3/ocrLocations
Device/File integrity check succeeded
Device/File not configured
Device/File not configured
Device/File not configured
Device/File not configured
Cluster registry integrity check succeeded
Logical corruption check succeeded
# mount | grep ds7-trenaz
10.10.1.30:/export/rac0_nfs on /ds7-trenaz type nfs (rw,bg,hard,nointr,rsize=32768,wsize=32768,tcp,noac,vers=3,timeo=600,actimeo=0,addr=10.10.1.30)
What is the problem?