Hello there,
2 nodes RAC setup:
Oracle Linux 8.5
Public network: 192.168.68.0
Private network: 10.0.0.0
DNS and NTP are all setup correctly
All host names/IPs (include SCAN) are resolved correctly
ASM disks use shared iSCSI share from TrueNAS. TrueNAS is on 192.168.68.0 network
From either node I can scan and list ASM disks after disks are created:
[grid@orarac1 ~]$ sudo oracleasm listdisks
ASMDISK_DATA1
ASMDISK_FRA1
ASMDISK_OCR1
[grid@orarac1 ~]$ sudo ls -l /dev/oracleasm/disks/
total 0
brw-rw---- 1 grid asmadmin 8, 33 Jul 9 17:17 ASMDISK_DATA1
brw-rw---- 1 grid asmadmin 8, 34 Jul 9 17:17 ASMDISK_FRA1
brw-rw---- 1 grid asmadmin 8, 35 Jul 9 17:17 ASMDISK_OCR1
Now when I launch grid installer as grid user from node 1 (orarac1), installer is not able to discover ASM disks. Yes, I changed discover path to /dev/oracleasm/disks, still not working.
I got this Network Interface options in earlier step:
Notice there are 5 options for each Interface: Public, Private, ASM, ASM & Private, Do Not Use
In my case, ens18 and ens19 are Public network (192.168.68.0); ens20 is Private network (10.0.0.0). virbr0 is ignorable virtual bridge. I tried the following options, none working.
ens18 for Public, ens20 for ASM&Private
ens18 for Public, ens19 for ASM, ens20 for Private (Oracle complains that public network and private network should be on different subnet for this option))
Since Oracle doesn't have 'ASM & Public' option, doesn't this mean ASM storage has to be on the same network as Private network?
Keep in TrueNAS is located in 192.168.68.0 network, and my Private network in 10.0.0.0
Is this the reason installer didn't discover the disks?
Thanks!