Database Software

Folks,

Hello. I am installing Oracle 11gR2 RAC using 2 VMs (main VM rac1 and slave VM rac2) with Oracle Linux 5.6 according to the website http://appsdbaworkshop.blogspot.com/2011/10/11gr2-rac-on-linux-56-using-vmware.html

Grid and RAC database have been installed successfully for both VMs rac1 and rac2.
I am using the slave VM rac2 to test Grid and RAC database because rac1 disk is full.
The problem is that OCR file is not available or currupted in the slave VM rac2. To find out its reasons, I check Permission on ocr disk as below:

[ora11g@rac2 bin]$ pwd
/u02/11g_db/ora11g/racdb/bin

[ora11g@rac2 bin]$ srvctl start asm

PRCR-1070 : Failed to check if resource ora.asm is registered
Cannot communicate with crsd

[ora11g@rac2 rac2]$ pwd
/u01/app/grid/log/rac2

[ora11g@rac2 rac2]$ cat alertrac2.log

Last lines:
[u01/app/grid/bin/cssdagent(5779)]CRS-5822:Agent '/u01/app/grid/bin/cssdagent_root' disconnected from server. Details at (:CRSAGF00117:) in /u01/app/grid/log/rac2/agent/ohasd/oracssdagent_root/oracssdagent_root.log.
2012-03-20 13:44:55.914
[ohasd(5149)]CRS-2112:The OLR service started on node rac2.
2012-03-20 13:44:58.588
[ohasd(5149)]CRS-8017:location: /etc/oracle/lastgasp has 72 reboot advisory log files, 0 were announced and 0 errors occurred
2012-03-20 13:45:07.555
[ohasd(5149)]CRS-2772:Server 'rac2' has been assigned to pool 'Free'.
2012-03-20 13:45:10.108
[ohasd(5149)]CRS-2302:Cannot get GPnP profile. Error CLSGPNP_NO_DAEMON (GPNPD daemon is not running).
2012-03-20 13:45:10.251
[gpnpd(5368)]CRS-2328:GPNPD started on node rac2.
2012-03-20 13:45:13.037
[cssd(5443)]CRS-1713:CSSD daemon is started in clustered mode
2012-03-20 13:45:37.132
[cssd(5443)]CRS-1707:Lease acquisition for node rac2 number 2 completed
2012-03-20 13:45:37.727
[cssd(5443)]CRS-1605:CSSD voting file is online: ORCL:ASMDISK3; details in /u01/app/grid/log/rac2/cssd/ocssd.log.
2012-03-20 13:45:37.986
[cssd(5443)]CRS-1625:Node rac1, number 1, was manually shut down
2012-03-20 13:45:37.991
[cssd(5443)]CRS-1605:CSSD voting file is online: ORCL:ASMDISK2; details in /u01/app/grid/log/rac2/cssd/ocssd.log.
2012-03-20 13:45:38.633
[cssd(5443)]CRS-1605:CSSD voting file is online: ORCL:ASMDISK1; details in /u01/app/grid/log/rac2/cssd/ocssd.log.
2012-03-20 13:45:56.956
[cssd(5443)]CRS-1601:CSSD Reconfiguration complete. Active nodes are rac2 .
2012-03-20 13:46:00.557
[ctssd(5834)]CRS-2403:The Cluster Time Synchronization Service on host rac2 is in observer mode.
2012-03-20 13:46:00.576
[ctssd(5834)]CRS-2407:The new Cluster Time Synchronization Service reference node is host rac2.
2012-03-20 13:46:01.000
[ctssd(5834)]CRS-2401:The Cluster Time Synchronization Service started on host rac2.
2012-03-20 13:46:11.097
[crsd(5856)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/app/grid/log/rac2/crsd/crsd.log.
2012-03-20 13:46:12.085
[ohasd(5149)]CRS-2765:Resource 'ora.crsd' has failed on server 'rac2'.
2012-03-20 13:46:13.338
[crsd(5925)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/app/grid/log/rac2/crsd/crsd.log.
2012-03-20 13:46:14.217
[ohasd(5149)]CRS-2765:Resource 'ora.crsd' has failed on server 'rac2'.
2012-03-20 13:46:15.438
[crsd(5940)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/app/grid/log/rac2/crsd/crsd.log.
2012-03-20 13:46:16.313
[ohasd(5149)]CRS-2765:Resource 'ora.crsd' has failed on server 'rac2'.
2012-03-20 13:46:17.539
[crsd(5955)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/app/grid/log/rac2/crsd/crsd.log.
2012-03-20 13:46:18.392
[ohasd(5149)]CRS-2765:Resource 'ora.crsd' has failed on server 'rac2'.
2012-03-20 13:46:19.537
[crsd(5988)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/app/grid/log/rac2/crsd/crsd.log.
2012-03-20 13:46:20.468
[ohasd(5149)]CRS-2765:Resource 'ora.crsd' has failed on server 'rac2'.
2012-03-20 13:46:22.636
[crsd(6003)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/app/grid/log/rac2/crsd/crsd.log.
2012-03-20 13:46:23.615
[ohasd(5149)]CRS-2765:Resource 'ora.crsd' has failed on server 'rac2'.
2012-03-20 13:46:24.781
[crsd(6022)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/app/grid/log/rac2/crsd/crsd.log.
2012-03-20 13:46:25.713
[ohasd(5149)]CRS-2765:Resource 'ora.crsd' has failed on server 'rac2'.
2012-03-20 13:46:26.885
[crsd(6037)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/app/grid/log/rac2/crsd/crsd.log.
2012-03-20 13:46:27.799
[ohasd(5149)]CRS-2765:Resource 'ora.crsd' has failed on server 'rac2'.
2012-03-20 13:46:29.021
[crsd(6052)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/app/grid/log/rac2/crsd/crsd.log.
2012-03-20 13:46:29.925
[ohasd(5149)]CRS-2765:Resource 'ora.crsd' has failed on server 'rac2'.
2012-03-20 13:46:31.136
[crsd(6067)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/app/grid/log/rac2/crsd/crsd.log.
2012-03-20 13:46:32.040
[ohasd(5149)]CRS-2765:Resource 'ora.crsd' has failed on server 'rac2'.
2012-03-20 13:46:33.247
[crsd(6082)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/app/grid/log/rac2/crsd/crsd.log.
2012-03-20 13:46:34.172
[ohasd(5149)]CRS-2765:Resource 'ora.crsd' has failed on server 'rac2'.
2012-03-20 13:46:34.173
[ohasd(5149)]CRS-2771:Maximum restart attempts reached for resource 'ora.crsd'; will not restart.
[ora11g@rac2 rac2]$

From the output of alertrac2.log, we have seen ASM disk group is inaccessible. Thus, my question is:

How to solve the issue "ASM disk group is inaccessible " in the slave VM rac2 ?


Thanks.