TCP connectivity of subnet check failed, execuion of runcluvfy.sh,RAC
895680Feb 3 2012 — edited Apr 19 2013Hi,
runcluvfy.sh script fails on Linux node. Below are the details of checks which failed:
[grid@rac1 grid]$ ./runcluvfy.sh stage -pre crsinst -n rac1,rac2 -verbose
Performing pre-checks for cluster services setup
Checking node reachability...
Check: Node reachability from node "rac1"
Destination Node Reachable?
------------------------------------ ------------------------
rac2 yes
rac1 yes
Result: Node reachability check passed from node "rac1"
Checking user equivalence...
Check: User equivalence for user "grid"
Node Name Comment
------------------------------------ ------------------------
rac2 passed
rac1 passed
Result: User equivalence check passed for user "grid"
Checking node connectivity...
Checking hosts config file...
Node Name Status Comment
------------ ------------------------ ------------------------
rac2 passed
rac1 passed
Verification of the hosts config file successful
Interface information for node "rac2"
Name IP Address Subnet Gateway Def. Gateway HW Address MTU
------ --------------- --------------- --------------- --------------- ----------------- ------
eth0 192.168.2.102 192.168.2.0 0.0.0.0 192.168.2.1 08:00:27:5E:16:D3 1500
eth1 10.10.10.51 10.10.10.0 0.0.0.0 192.168.2.1 08:00:27:44:48:6D 1500
Interface information for node "rac1"
Name IP Address Subnet Gateway Def. Gateway HW Address MTU
------ --------------- --------------- --------------- --------------- ----------------- ------
eth0 192.168.2.101 192.168.2.0 0.0.0.0 192.168.2.1 08:00:27:81:9D:76 1500
eth1 10.10.10.50 10.10.10.0 0.0.0.0 192.168.2.1 08:00:27:12:5F:F4 1500
Check: Node connectivity of subnet "192.168.2.0"
Source Destination Connected?
------------------------------ ------------------------------ ----------------
rac2:eth0 rac1:eth0 yes
Result: Node connectivity passed for subnet "192.168.2.0" with node(s) rac2,rac1
Check: TCP connectivity of subnet "192.168.2.0"
Source Destination Connected?
------------------------------ ------------------------------ ----------------
rac1:192.168.2.101 rac2:192.168.2.102 failed
Result: TCP connectivity check failed for subnet "192.168.2.0"
Check: Node connectivity of subnet "10.10.10.0"
Source Destination Connected?
------------------------------ ------------------------------ ----------------
rac2:eth1 rac1:eth1 yes
Result: Node connectivity passed for subnet "10.10.10.0" with node(s) rac2,rac1
Check: TCP connectivity of subnet "10.10.10.0"
Source Destination Connected?
------------------------------ ------------------------------ ----------------
rac1:10.10.10.50 rac2:10.10.10.51 failed
Result: TCP connectivity check failed for subnet "10.10.10.0"
Interfaces found on subnet "192.168.2.0" that are likely candidates for VIP are:
rac2 eth0:192.168.2.102
rac1 eth0:192.168.2.101
Interfaces found on subnet "10.10.10.0" that are likely candidates for a private interconnect are:
rac2 eth1:10.10.10.51
rac1 eth1:10.10.10.50
Result: Node connectivity check passed
********************************************************************************************************************************
Here are the 2 Virtual machine details:
VM used: Oracle Virtual box 4.0.10
Cluster Version: 11g R2
Linux version: RHEL5.3
No of node: 2
Node details:
Node 1 hostname: rac1
Public ip (eth0): 192.168.2.101
Subnet mask: 255.255.255.0
Default gateway: 192.168.2.1
Private ip (eth1): 10.10.10.50
Subnet mask: 255.255.255.0
Default gateway: none
Node 2 hostname : rac2
Public ip (eth0): 192.168.2.102
Subnet mask: 255.255.255.0
Default gateway: 192.168.2.1
Private ip (eth1): 10.10.10.51
Subnet mask: 255.255.255.0
Default gateway: none
Contents of /etc/hosts:(DNS is not configured)
127.0.0.1 rac2.mydomain.com rac2 localhost.localdomain localhost
::1 localhost6.localdomain6 localhost6
# Public
192.168.2.101 rac1.mydomain.com rac1
192.168.2.102 rac2.mydomain.com rac2
# Private
10.10.10.50 rac1-priv.mydomain.com rac1-priv
10.10.10.51 rac2-priv.mydomain.com rac2-priv
# Virtual
192.168.2.111 rac1-vip.mydomain.com rac1-vip
192.168.2.112 rac2-vip.mydomain.com rac2-vip
# SCAN
192.168.2.201 rac-scan.mydomain.com rac-scan
192.168.2.202 rac-scan.mydomain.com rac-scan
192.168.2.203 rac-scan.mydomain.com rac-scan
SSH connectivity:
*[oracle@rac1 ~]$ ssh rac2*
Last login: Fri Feb 3 23:10:06 2012 from rac1.mydomain.com
*[grid@rac2 ~]$ ssh rac1*
Last login: Fri Feb 3 23:05:27 2012 from rac2.mydomain.com
Ping command status:
On RAC2:
*[grid@rac2 ~]$ ping rac1*
PING rac1.mydomain.com (192.168.2.101) 56(84) bytes of data.
64 bytes from rac1.mydomain.com (192.168.2.101): icmp_seq=1 ttl=64 time=0.460 ms
64 bytes from rac1.mydomain.com (192.168.2.101): icmp_seq=2 ttl=64 time=0.307 ms
64 bytes from rac1.mydomain.com (192.168.2.101): icmp_seq=3 ttl=64 time=0.425 ms
--- rac1.mydomain.com ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 1998ms
rtt min/avg/max/mdev = 0.307/0.397/0.460/0.067 ms
*[grid@rac2 ~]$ ping rac1-priv*
PING rac1-priv.mydomain.com (10.10.10.50) 56(84) bytes of data.
64 bytes from rac1-priv.mydomain.com (10.10.10.50): icmp_seq=1 ttl=64 time=50.6 ms
64 bytes from rac1-priv.mydomain.com (10.10.10.50): icmp_seq=2 ttl=64 time=0.751 ms
--- rac1-priv.mydomain.com ping statistics ---
2 packets transmitted, 2 received, 0% packet loss, time 1001ms
rtt min/avg/max/mdev = 0.751/25.703/50.656/24.953 ms
*[grid@rac2 ~]$ ping rac2*
PING rac2.mydomain.com (127.0.0.1) 56(84) bytes of data.
64 bytes from rac2.mydomain.com (127.0.0.1): icmp_seq=1 ttl=64 time=0.084 ms
64 bytes from rac2.mydomain.com (127.0.0.1): icmp_seq=2 ttl=64 time=0.065 ms
--- rac2.mydomain.com ping statistics ---
2 packets transmitted, 2 received, 0% packet loss, time 999ms
rtt min/avg/max/mdev = 0.065/0.074/0.084/0.012 ms
*[grid@rac2 ~]$ ping rac2-priv*
PING rac2-priv.mydomain.com (10.10.10.51) 56(84) bytes of data.
64 bytes from rac2-priv.mydomain.com (10.10.10.51): icmp_seq=1 ttl=64 time=0.039 ms
64 bytes from rac2-priv.mydomain.com (10.10.10.51): icmp_seq=2 ttl=64 time=0.080 ms
--- rac2-priv.mydomain.com ping statistics ---
2 packets transmitted, 2 received, 0% packet loss, time 1006ms
rtt min/avg/max/mdev = 0.039/0.059/0.080/0.021 ms
On RAC1 node:
*[oracle@rac1 ~]$ ping rac2*
PING rac2.mydomain.com (192.168.2.102) 56(84) bytes of data.
64 bytes from rac2.mydomain.com (192.168.2.102): icmp_seq=1 ttl=64 time=0.428 ms
64 bytes from rac2.mydomain.com (192.168.2.102): icmp_seq=2 ttl=64 time=0.387 ms
--- rac2.mydomain.com ping statistics ---
2 packets transmitted, 2 received, 0% packet loss, time 1003ms
rtt min/avg/max/mdev = 0.387/0.407/0.428/0.028 ms
*[oracle@rac1 ~]$ ping rac2-priv*
PING rac2-priv.mydomain.com (10.10.10.51) 56(84) bytes of data.
64 bytes from rac2-priv.mydomain.com (10.10.10.51): icmp_seq=1 ttl=64 time=0.552 ms
64 bytes from rac2-priv.mydomain.com (10.10.10.51): icmp_seq=2 ttl=64 time=0.528 ms
--- rac2-priv.mydomain.com ping statistics ---
2 packets transmitted, 2 received, 0% packet loss, time 1003ms
rtt min/avg/max/mdev = 0.528/0.540/0.552/0.012 ms
*[oracle@rac1 ~]$ ping rac1*
PING rac1.mydomain.com (127.0.0.1) 56(84) bytes of data.
64 bytes from rac1.mydomain.com (127.0.0.1): icmp_seq=1 ttl=64 time=0.042 ms
64 bytes from rac1.mydomain.com (127.0.0.1): icmp_seq=2 ttl=64 time=0.039 ms
--- rac1.mydomain.com ping statistics ---
2 packets transmitted, 2 received, 0% packet loss, time 999ms
rtt min/avg/max/mdev = 0.039/0.040/0.042/0.006 ms
*[oracle@rac1 ~]$ ping rac1-priv*
PING rac1-priv.mydomain.com (10.10.10.50) 56(84) bytes of data.
64 bytes from rac1-priv.mydomain.com (10.10.10.50): icmp_seq=1 ttl=64 time=0.095 ms
64 bytes from rac1-priv.mydomain.com (10.10.10.50): icmp_seq=2 ttl=64 time=0.035 ms
--- rac1-priv.mydomain.com ping statistics ---
2 packets transmitted, 2 received, 0% packet loss, time 999ms
rtt min/avg/max/mdev = 0.035/0.065/0.095/0.030 ms
Grid user:
[grid@rac1 grid]$ id
uid=1100(grid) gid=1000(oinstall) groups=1000(oinstall),1020(asmadmin),1021(asmdba),1022(asmoper),1031(dba)
Database user:
[oracle@rac1 ~]$ id
uid=1101(oracle) gid=1000(oinstall) groups=1000(oinstall),1021(asmdba),1031(dba)
SSH is configured properly for both Grid and Oracle user though here i have provided o/p of only Grid user.
Ping also works fine on both the nodes then why TCP connectivity check is failing?
What I have missed in my Linux nodes configuration?
Regards,
Purnima Johari