Database Software

Hi All,

Pardon me in case the below error has been encountered previously. While performing the runcluvfy checks i am facing the sharedness of the disk could not be determined. Kindly assist.

Below are the complete configuration details :
OS - OEL 6.1 , NODE1,NODE2

Grid infrastructure - 11.2.0.3


NODE1 : Oracle RPM installed: rpm -qa |grep -i oracleasm

oracleasmlib-2.0.4-1.el6.x86_64
oracleasm-support-2.1.5-1.el6.x86_64



NODE2: Oracle RPM installed: rpm -qa |grep oracleasm
oracleasmlib-2.0.4-1.el6.x86_64
oracleasm-support-2.1.5-1.el6.x86_64


NODE1 :
id grid
uid=60000(grid) gid=11001(oinstall) groups=8500(dba),59031(asmadmin),59032(asmdba),59033(asmoper),11001(oinstall)

NODE2 :
id grid
uid=60000(grid) gid=11001(oinstall) groups=8500(dba),59031(asmadmin),59032(asmdba),59033(asmoper),11001(oinstall)


Storage provided as LUNS
Disk Size
/dev/sda 4294 MB


[root@NODE1 ]# ls -tlr /dev/sd[a-n]
brw-rw---- 1 root disk 8, 0 Feb 21 23:37 /dev/sda


[root@NODE2 vijaynk]# ls -tlr /dev/sd[a-n]
brw-rw---- 1 root disk 8, 0 Feb 22 00:09 /dev/sda


Configured oracleasm both on NODE1 and NODE2
/usr/sbin/oracleasm configure -i

Configuring the Oracle ASM library driver.
Default user to own the driver interface [grid]: grid
Default group to own the driver interface [asmadmin]: asmadmin
Start Oracle ASM library driver on boot (y/n) [y]: Y
Scan for Oracle ASM disks on boot (y/n) [y]: Y
Writing Oracle ASM library driver configuration: done



Loaded the oracleasm
[root@NODE1]# /usr/sbin/oracleasm init
[root@NODE1]]# /usr/sbin/oracleasm status
Checking if ASM is loaded: yes
Checking if /dev/oracleasm is mounted: yes


Formatted first disk.
[root@NODE1 disks]# fdisk /dev/sda
Command (m for help): p
Disk /dev/sda: 4294 MB, 4294967296 bytes
133 heads, 62 sectors/track, 1017 cylinders
Units = cylinders of 8246 * 512 = 4221952 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk identifier: 0xd8c4f16a
Device Boot Start End Blocks Id System
Command (m for help): n
Command action
e extended
p primary partition (1-4)
p
Partition number (1-4): 1
First cylinder (1-1017, default 1):
Using default value 1
Last cylinder, cylinders or size{K,M,G} (1-1017, default 1017):
Using default value 1017
Command (m for help): p
Device Boot Start End Blocks Id System
/dev/sda1 1 1017 4193060 83 Linux
Command (m for help): w
The partition table has been altered!
Calling ioctl() to re-read partition table.
Syncing disks.
[root@NODE1 disks]# partprobe /dev/sda


Created ASM disk DISK1
[root@NODE1 disks]# /usr/sbin/oracleasm createdisk DISK1 /dev/sda1
Writing disk header: done
Instantiating disk: done
[root@NODE1 disks]# /usr/sbin/oracleasm listdisks
DISK1

[root@NODE1 disks]# ls -ltr /dev/oracleasm/disks/
total 0
brw-rw---- 1 grid asmadmin 8, 1 Feb 22 00:21 DISK1


Verified if the DISK2
[root@NODE2 vijaynk]# /usr/sbin/oracleasm init
[root@NODE2 vijaynk]# /usr/sbin/oracleasm scandisks
Reloading disk partitions: done
Cleaning any stale ASM disks...
Scanning system for ASM disks...
Instantiating disk "DISK1"
[root@NODE2 vijaynk]# /usr/sbin/oracleasm listdisks
DISK1



Did even Disk Discovery:
[root@NODE1 disks]# /usr/sbin/oracleasm-discover
Using ASMLib from /opt/oracle/extapi/64/asm/orcl/1/libasm.so
[ASM Library - Generic Linux, version 2.0.4 (KABI_V2)]
Discovered disk: ORCL:DISK1 [8386120 blocks (4293693440 bytes), maxio 512]

[root@NODE2 vijaynk]# /usr/sbin/oracleasm-discover
Using ASMLib from /opt/oracle/extapi/64/asm/orcl/1/libasm.so
[ASM Library - Generic Linux, version 2.0.4 (KABI_V2)]
Discovered disk: ORCL:DISK1 [8386120 blocks (4293693440 bytes), maxio 512]


Please Suggest on the highlighted error message. I refereed the following link to perform the pre checks.
http://docs.oracle.com/cd/E14072_01/rac.112/e10717/cvu.htm#CJGDBBII


*./runcluvfy.sh stage -pre crsinst -n NODE1,NODE2 -r 11gR2 -asm -asmdev /dev/sda1 –verbose*

################CLUVFY LOG##################
Performing pre-checks for cluster services setup

Check: Package existence for "cvuqdisk"
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
NODE2 cvuqdisk-1.0.9-1 cvuqdisk-1.0.9-1 passed
NODE1 cvuqdisk-1.0.9-1 cvuqdisk-1.0.9-1 passed
Result: Package existence check passed for "cvuqdisk"
.............|
.............|===> Apart from the below checks rest all passed.
.............|
Checking Devices for ASM...


ERROR: /dev/sda1
NODE2:Unable to determine the sharedness of /dev/sda on nodes:
NODE1,NODE2
Checking for shared devices...
PRVF-5149 : WARNING: Storage "/dev/sda1" is not shared on all nodes
UDev attributes check for ASM Disks started...
ERROR:
PRVF-9802 : Attempt to get udev info from node "NODE2" failed
ERROR:
PRVF-9802 : Attempt to get udev info from node "NODE1" failed
Result: UDev attributes check failed for ASM Disks
Result: Devices check for ASM failed
Pre-check for cluster services setup was unsuccessful on all the nodes.
############################################


Thanks,

Vijay