Hallo All,
i hope you can help me. We have a 2 node rac. the first node cannot be started up because of:
[cssd(16558)]CRS-1714:Unable to discover any voting files, retrying discovery in 15 seconds; Details at (:CSSNM00070:) in /pkg/app/11.2.0/grid/log/defr2elvhms01/cssd/ocssd.log
2015-09-28 14:45:19.038:
[cssd(16558)]CRS-1714:Unable to discover any voting files, retrying discovery in 15 seconds; Details at (:CSSNM00070:) in /pkg/app/11.2.0/grid/log/defr2elvhms01/cssd/ocssd.log
2015-09-28 14:45:34.059:
[cssd(16558)]CRS-1714:Unable to discover any voting files, retrying discovery in 15 seconds; Details at (:CSSNM00070:) in /pkg/app/11.2.0/grid/log/defr2elvhms01/cssd/ocssd.log
the crs finds the OCR disks, it is visible it the logfile:
2015-09-28 14:46:49.120: [ SKGFD][2107098880]Lib :ASM:/opt/oracle/extapi/64/asm/orcl/1/libasm.so: closing handle 0x7fec68140800 for disk :ORCL:REDO:
2015-09-28 14:46:49.120: [ CSSD][2107098880]clssnmvDiskVerify: discovered a potential voting file
2015-09-28 14:46:49.120: [ SKGFD][2107098880]Handle 0x7fec68140dd0 from lib :ASM:/opt/oracle/extapi/64/asm/orcl/1/libasm.so: for disk :ORCL:OCR1:
2015-09-28 14:46:49.121: [ CSSD][2107098880]clssnmvDiskVerify: TOC format mismatch expected(0x634c7373 0x546f636b), found(0x434c5366 0x0000)
2015-09-28 14:46:49.121: [ SKGFD][2107098880]Lib :ASM:/opt/oracle/extapi/64/asm/orcl/1/libasm.so: closing handle 0x7fec68140dd0 for disk :ORCL:OCR1:
2015-09-28 14:46:49.121: [ CSSD][2107098880]clssnmvDiskVerify: Successful discovery of 0 disks
2015-09-28 14:46:49.121: [ CSSD][2107098880]clssnmCompleteInitVFDiscovery: Completing initial voting file discovery
2015-09-28 14:46:49.121: [ CSSD][2107098880]clssnmvFindInitialConfigs: No voting files found
2015-09-28 14:46:49.121: [ CSSD][2107098880](:CSSNM00070:)clssnmCompleteInitVFDiscovery: Voting file not found. Retrying discovery in 15 seconds
The failing node can be started up in exclusive mode and there I am able to connect to asm but of course without disks. When I am trying to mount diskgroups I get the followings:
SQL> alter diskgroup data mount;
alter diskgroup data mount
*
ERROR at line 1:
ORA-15032: not all alterations performed
ORA-15017: diskgroup "DATA" cannot be mounted
ORA-15063: ASM discovered an insufficient number of disks for diskgroup "DATA"
ORA-15085: ASM disk "" has inconsistent sector size.
we seem to experiencing similar issue as written:
After SAN Firmware Upgrade, ASM Diskgroups ( Using ASMLIB) Cannot Be Mounted Due To ORA-15085: ASM disk "" has inconsistent sector size. (Doc ID 1500460.1)
kernel cannot be updated so setting the ORACLEASM_USE_LOGICAL_BLOCK_SIZE is not possible.
What we don't understand why the failing node has different physical / logical block size. Why the oracle linux on the failing node do recognise different value? If it was the same, probably the cluster could start up:
[root@defr2elvhms02 ~]# rpm -qa | grep -i asm
oracleasmlib-2.0.4-1.el6.x86_64
oracleasm-support-2.1.8-1.el6.x86_64
[root@defr2elvhms02 ~]# uname -a
Linux defr2elvhms02 2.6.32-400.37.1.el6uek.x86_64 #1 SMP Thu Feb 5 14:58:47 PST 2015 x86_64 x86_64 x86_64 GNU/Linux
[root@defr2elvhms02 ~]#
[root@defr2elvhms02 ~]# oracleasm querydisk -d OCR1
Disk "OCR1" is a valid ASM disk on device [8,1]
[root@defr2elvhms02 ~]# oracleasm querydisk -d OCR2
Disk "OCR2" is a valid ASM disk on device [8,17]
[root@defr2elvhms02 ~]# oracleasm querydisk -d OCR3
Disk "OCR3" is a valid ASM disk on device [8,33]
[root@defr2elvhms02 ~]# ls -l /dev/sda1
brw-rw----. 1 root disk 8, 1 Sep 29 16:21 /dev/sda1
[root@defr2elvhms02 ~]# ls -l /dev/sdb1
brw-rw----. 1 root disk 8, 17 Sep 29 16:21 /dev/sdb1
[root@defr2elvhms02 ~]# ls -l /dev/sdc1
brw-rw----. 1 root disk 8, 33 Sep 29 16:21 /dev/sdc1
[root@defr2elvhms02 ~]# fdisk -l /dev/sda
Disk /dev/sda: 10.7 GB, 10737418240 bytes
64 heads, 32 sectors/track, 10240 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk identifier: 0x20700d2b
Device Boot Start End Blocks Id System
/dev/sda1 10 10240 10476544 83 Linux
[root@defr2elvhms02 ~]# fdisk -l /dev/sda1
Disk /dev/sda1: 10.7 GB, 10727981056 bytes
64 heads, 32 sectors/track, 10231 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk identifier: 0x00000000
[root@defr2elvhms02 ~]# fdisk -l /dev/sdb
Disk /dev/sdb: 10.7 GB, 10737418240 bytes
64 heads, 32 sectors/track, 10240 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk identifier: 0x62515b34
Device Boot Start End Blocks Id System
/dev/sdb1 10 10240 10476544 83 Linux
[root@defr2elvhms02 ~]# fdisk -l /dev/sdb1
Disk /dev/sdb1: 10.7 GB, 10727981056 bytes
64 heads, 32 sectors/track, 10231 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk identifier: 0x00000000
[root@defr2elvhms02 ~]# fdisk -l /dev/sdc
Disk /dev/sdc: 10.7 GB, 10737418240 bytes
64 heads, 32 sectors/track, 10240 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk identifier: 0xc254acd9
Device Boot Start End Blocks Id System
/dev/sdc1 10 10240 10476544 83 Linux
[root@defr2elvhms02 ~]# fdisk -l /dev/sdc1
Disk /dev/sdc1: 10.7 GB, 10727981056 bytes
64 heads, 32 sectors/track, 10231 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk identifier: 0x00000000
-------------------------------------------------------------------------------
-------------------------------------------------------------------------------
[root@defr2elvhms01 ~]# uname -a
Linux defr2elvhms01 2.6.32-400.37.1.el6uek.x86_64 #1 SMP Thu Feb 5 14:58:47 PST 2015 x86_64 x86_64 x86_64 GNU/Linux
[root@defr2elvhms01 ~]# rpm -qa | grep -i asm
oracleasmlib-2.0.4-1.el6.x86_64
oracleasm-support-2.1.8-1.el6.x86_64
[root@defr2elvhms01 ~]# oracleasm querydisk -d OCR1
Disk "OCR1" is a valid ASM disk on device [8,1]
[root@defr2elvhms01 ~]# oracleasm querydisk -d OCR2
Disk "OCR2" is a valid ASM disk on device [8,17]
[root@defr2elvhms01 ~]# oracleasm querydisk -d OCR3
Disk "OCR3" is a valid ASM disk on device [8,33]
[root@defr2elvhms01 ~]# ls -l /dev/sdb1
brw-rw----. 1 root disk 8, 17 Sep 29 15:32 /dev/sdb1
[root@defr2elvhms01 ~]# ls -l /dev/sda1
brw-rw----. 1 root disk 8, 1 Sep 29 15:32 /dev/sda1
[root@defr2elvhms01 ~]# ls -l /dev/sdb1
brw-rw----. 1 root disk 8, 17 Sep 29 15:32 /dev/sdb1
[root@defr2elvhms01 ~]# ls -l /dev/sdc1
brw-rw----. 1 root disk 8, 33 Sep 29 15:32 /dev/sdc1
[root@defr2elvhms01 ~]# fdisk -l /dev/sda
Disk /dev/sda: 10.7 GB, 10737418240 bytes
64 heads, 32 sectors/track, 10240 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 65536 bytes
Disk identifier: 0x20700d2b
Device Boot Start End Blocks Id System
/dev/sda1 10 10240 10476544 83 Linux
[root@defr2elvhms01 ~]# fdisk -l /dev/sda1
Disk /dev/sda1: 10.7 GB, 10727981056 bytes
64 heads, 32 sectors/track, 10231 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 65536 bytes
Disk identifier: 0x00000000
[root@defr2elvhms01 ~]# fdisk -l /dev/sdb
Disk /dev/sdb: 10.7 GB, 10737418240 bytes
64 heads, 32 sectors/track, 10240 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 65536 bytes
Disk identifier: 0x62515b34
Device Boot Start End Blocks Id System
/dev/sdb1 10 10240 10476544 83 Linux
[root@defr2elvhms01 ~]# fdisk -l /dev/sdb1
Disk /dev/sdb1: 10.7 GB, 10727981056 bytes
64 heads, 32 sectors/track, 10231 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 65536 bytes
Disk identifier: 0x00000000
[root@defr2elvhms01 ~]# fdisk -l /dev/sdc
Disk /dev/sdc: 10.7 GB, 10737418240 bytes
64 heads, 32 sectors/track, 10240 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 65536 bytes
Disk identifier: 0xc254acd9
Device Boot Start End Blocks Id System
/dev/sdc1 10 10240 10476544 83 Linux
[root@defr2elvhms01 ~]# fdisk -l /dev/sdc1
Disk /dev/sdc1: 10.7 GB, 10727981056 bytes
64 heads, 32 sectors/track, 10231 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 65536 bytes
Disk identifier: 0x00000000
thank you for help