Grid Version : 11.2.0.3.6
Platform : Oracle Enterprise Linux 6.2
In our 2-Node RAC, Node2 got evicted. Once Node2 booted up CRS didn't start up. I couldn't find anything significant in Grid alert.log , ocssd.log or crsd.log.
In node2, I was able to do fdisk -l on all LUNs in the OCR_VOTE diskgroup. After few hours of headache and escalations we discovered that LUNs were not actually accesible to the clusterware in Node2 although fdisk -l was correctly showing the partition.
When the cluster was down, I wanted to check if voting disk was actually accessible to the CRS ( GI ), but I couldn't (as shown below).
# ./crsctl start crs
CRS-4640: Oracle High Availability Services is already active
CRS-4000: Command Start failed, or completed with errors.
# ./crsctl query css votedisk
Unable to communicate with the Cluster Synchronization Services daemon.
How can I check if the voting disk is accessible to the CRS in a node when the CRS is down ?