Hello All!
I created this thread because I keep having issues trying to install the 11gr2 grid infrastructure on Oracle Linux 6.1, CentOS 6, and Fedora 15 using an NFS share. I keep getting the same errors over and over again and I've tried all of the tricks that I could find in previous threads. They include:
1) Changing the runlevel to 3 or 5 (telinit)
2) disabling IPv6 (was never enabled)
3) reconfigured HAS using the following command
--delete
<GridHome>/perl/bin/perl -I<GridHome>/perl/lib -I<GridHome>/crs/install <GridHome>/crs/install/roothas.pl -delete -force
--install
<GridHome>/perl/bin/perl -I<GridHome>/perl/lib -I<GridHome>/crs/install <GridHome>/crs/install/roothas.pl
Absolutely NOTHING has worked. I promise you that Ive done all the google searching I could do. I am hoping someone else has run into this issue and maybe has some insight as to what I can do.
Below is a dump of all of the information related to the attempted install.
#########################################################################################################
# ROOT.SH keeps failing no matter what I try
#########################################################################################################
Error First run of root.sh:
----------------------------
/u01/app/11.2.0/grid/bin/clscfg.bin: error while loading shared libraries: libcap.so.1: cannot open shared object file: No such file or directory
Failed to create keys in the OLR, rc = 127, 32512
[root@yin ~]# yum install libcap.i686
[root@yang ~]# yum install libcap.i686
[root@yin ~]# cp /lib64/libcap.so.2 /lib64/libcap.so.1
[root@yang ~]# cp /lib64/libcap.so.2 /lib64/libcap.so.1
Error Second run of root.sh
----------------------------
[root@yin ~]# /u01/app/11.2.0/grid/root.sh
Running Oracle 11g root.sh script...
The following environment variables are set as:
ORACLE_OWNER= oracle
ORACLE_HOME= /u01/app/11.2.0/grid
Enter the full pathname of the local bin directory: [usr/local/bin]:
The file "dbhome" already exists in /usr/local/bin. Overwrite it? (y/n)
[n]:
The file "oraenv" already exists in /usr/local/bin. Overwrite it? (y/n)
[n]:
The file "coraenv" already exists in /usr/local/bin. Overwrite it? (y/n)
[n]:
Entries will be added to the /etc/oratab file as needed by
Database Configuration Assistant when a database is created
Finished running generic part of root.sh script.
Now product-specific root actions will be performed.
2011-09-08 04:45:44: Parsing the host name
2011-09-08 04:45:44: Checking for super user privileges
2011-09-08 04:45:44: User has super user privileges
Using configuration parameter file: /u01/app/11.2.0/grid/crs/install/crsconfig_params
LOCAL ADD MODE
Creating OCR keys for user 'root', privgrp 'root'..
Operation successful.
root wallet
root wallet cert
root cert export
peer wallet
profile reader wallet
pa wallet
peer wallet keys
pa wallet keys
peer cert request
pa cert request
peer cert
pa cert
peer root cert TP
profile reader root cert TP
pa root cert TP
peer pa cert TP
pa peer cert TP
profile reader pa cert TP
profile reader peer cert TP
peer user cert
pa user cert
Adding daemon to inittab
CRS-4124: Oracle High Availability Services startup failed.
CRS-4000: Command Start failed, or completed with errors.
ohasd failed to start: Inappropriate ioctl for device
ohasd failed to start at /u01/app/11.2.0/grid/crs/install/rootcrs.pl line 443.
#LINE 443
# Start OHASD service/daemon
trace ("Starting ohasd");
start_service ("ohasd") or die "ohasd failed to start";
#########################################################################################################
# LOGS
#########################################################################################################
[root@yin yin]# cat /u01/app/11.2.0/grid/log/yin/alertyin.log
Oracle Database 11g Clusterware Release 11.2.0.1.0 - Production Copyright 1996, 2009 Oracle. All rights reserved.
2011-09-08 04:33:10.093
[client(9660)]CRS-2106:The OLR location /u01/app/11.2.0/grid/cdata/yin.olr is inaccessible. Details in /u01/app/11.2.0/grid/log/yin/client/ocrconfig_9660.log.
2011-09-08 04:33:10.904
[client(9660)]CRS-2101:The OLR was formatted using version 3.
[client(9810)]CRS-10001:ADVM/ACFS is not supported on centos-release-6-0.el6.centos.5.x86_64
[client(9812)]CRS-10001:ACFS-9201: Not Supported
2011-09-08 04:46:09.222
[client(9938)]CRS-2106:The OLR location /u01/app/11.2.0/grid/cdata/yin.olr is inaccessible. Details in /u01/app/11.2.0/grid/log/yin/client/ocrconfig_9938.log.
2011-09-08 04:46:10.099
[client(9938)]CRS-2101:The OLR was formatted using version 3.
[root@yin yin]# cat /u01/app/11.2.0/grid/log/yin/client/ocrconfig_9938.log
Oracle Database 11g Clusterware Release 11.2.0.1.0 - Production Copyright 1996, 2009 Oracle. All rights reserved.
2011-09-08 04:46:09.172: [ OCRCONF][3325355776]ocrconfig starts...
2011-09-08 04:46:09.176: [ OCRCONF][3325355776]Upgrading OCR data
2011-09-08 04:46:09.184: [ OCROSD][3325355776]utread:3: Problem reading buffer d7b000 buflen 4096 retval 0 phy_offset 102400 retry 0
2011-09-08 04:46:09.184: [ OCROSD][3325355776]utread:3: Problem reading buffer d7b000 buflen 4096 retval 0 phy_offset 102400 retry 1
2011-09-08 04:46:09.185: [ OCROSD][3325355776]utread:3: Problem reading buffer d7b000 buflen 4096 retval 0 phy_offset 102400 retry 2
2011-09-08 04:46:09.185: [ OCROSD][3325355776]utread:3: Problem reading buffer d7b000 buflen 4096 retval 0 phy_offset 102400 retry 3
2011-09-08 04:46:09.185: [ OCROSD][3325355776]utread:3: Problem reading buffer d7b000 buflen 4096 retval 0 phy_offset 102400 retry 4
2011-09-08 04:46:09.186: [ OCROSD][3325355776]utread:3: Problem reading buffer d7b000 buflen 4096 retval 0 phy_offset 102400 retry 5
2011-09-08 04:46:09.186: [ OCRRAW][3325355776]propriogid:1_1: Failed to read the whole bootblock. Assumes invalid format.
2011-09-08 04:46:09.186: [ OCRRAW][3325355776]proprioini: all disks are not OCR/OLR formatted
2011-09-08 04:46:09.186: [ OCRRAW][3325355776]proprinit: Could not open raw device
2011-09-08 04:46:09.186: [ default][3325355776]a_init:7!: Backend init unsuccessful : [26]
2011-09-08 04:46:09.188: [ OCRCONF][3325355776]Exporting OCR data to [OCRUPGRADEFILE]
2011-09-08 04:46:09.191: [ OCRAPI][3325355776]a_init:7!: Backend init unsuccessful : [33]
2011-09-08 04:46:09.192: [ OCRCONF][3325355776]There was no previous version of OCR. error:[PROCL-33: Oracle Local Registry is not configured]
2011-09-08 04:46:09.199: [ OCROSD][3325355776]utread:3: Problem reading buffer d7b000 buflen 4096 retval 0 phy_offset 102400 retry 0
2011-09-08 04:46:09.199: [ OCROSD][3325355776]utread:3: Problem reading buffer d7b000 buflen 4096 retval 0 phy_offset 102400 retry 1
2011-09-08 04:46:09.200: [ OCROSD][3325355776]utread:3: Problem reading buffer d7b000 buflen 4096 retval 0 phy_offset 102400 retry 2
2011-09-08 04:46:09.200: [ OCROSD][3325355776]utread:3: Problem reading buffer d7b000 buflen 4096 retval 0 phy_offset 102400 retry 3
2011-09-08 04:46:09.200: [ OCROSD][3325355776]utread:3: Problem reading buffer d7b000 buflen 4096 retval 0 phy_offset 102400 retry 4
2011-09-08 04:46:09.201: [ OCROSD][3325355776]utread:3: Problem reading buffer d7b000 buflen 4096 retval 0 phy_offset 102400 retry 5
2011-09-08 04:46:09.201: [ OCRRAW][3325355776]propriogid:1_1: Failed to read the whole bootblock. Assumes invalid format.
2011-09-08 04:46:09.201: [ OCRRAW][3325355776]proprioini: all disks are not OCR/OLR formatted
2011-09-08 04:46:09.201: [ OCRRAW][3325355776]proprinit: Could not open raw device
2011-09-08 04:46:09.201: [ default][3325355776]a_init:7!: Backend init unsuccessful : [26]
2011-09-08 04:46:09.209: [ OCROSD][3325355776]utread:3: Problem reading buffer d7b000 buflen 4096 retval 0 phy_offset 102400 retry 0
2011-09-08 04:46:09.209: [ OCROSD][3325355776]utread:3: Problem reading buffer d7b000 buflen 4096 retval 0 phy_offset 102400 retry 1
2011-09-08 04:46:09.209: [ OCROSD][3325355776]utread:3: Problem reading buffer d7b000 buflen 4096 retval 0 phy_offset 102400 retry 2
2011-09-08 04:46:09.210: [ OCROSD][3325355776]utread:3: Problem reading buffer d7b000 buflen 4096 retval 0 phy_offset 102400 retry 3
2011-09-08 04:46:09.210: [ OCROSD][3325355776]utread:3: Problem reading buffer d7b000 buflen 4096 retval 0 phy_offset 102400 retry 4
2011-09-08 04:46:09.210: [ OCROSD][3325355776]utread:3: Problem reading buffer d7b000 buflen 4096 retval 0 phy_offset 102400 retry 5
2011-09-08 04:46:09.211: [ OCRRAW][3325355776]propriogid:1_1: Failed to read the whole bootblock. Assumes invalid format.
2011-09-08 04:46:09.211: [ OCROSD][3325355776]utread:3: Problem reading buffer d7b000 buflen 4096 retval 0 phy_offset 102400 retry 0
2011-09-08 04:46:09.211: [ OCROSD][3325355776]utread:3: Problem reading buffer d7b000 buflen 4096 retval 0 phy_offset 102400 retry 1
2011-09-08 04:46:09.212: [ OCROSD][3325355776]utread:3: Problem reading buffer d7b000 buflen 4096 retval 0 phy_offset 102400 retry 2
2011-09-08 04:46:09.212: [ OCROSD][3325355776]utread:3: Problem reading buffer d7b000 buflen 4096 retval 0 phy_offset 102400 retry 3
2011-09-08 04:46:09.212: [ OCROSD][3325355776]utread:3: Problem reading buffer d7b000 buflen 4096 retval 0 phy_offset 102400 retry 4
2011-09-08 04:46:09.213: [ OCROSD][3325355776]utread:3: Problem reading buffer d7b000 buflen 4096 retval 0 phy_offset 102400 retry 5
2011-09-08 04:46:09.224: [ OCRRAW][3325355776]ibctx: Failed to read the whole bootblock. Assumes invalid format.
2011-09-08 04:46:09.224: [ OCRRAW][3325355776]proprinit:problem reading the bootblock or superbloc 22
2011-09-08 04:46:09.227: [ OCROSD][3325355776]utread:3: Problem reading buffer d7b000 buflen 4096 retval 0 phy_offset 102400 retry 0
2011-09-08 04:46:09.227: [ OCROSD][3325355776]utread:3: Problem reading buffer d7b000 buflen 4096 retval 0 phy_offset 102400 retry 1
2011-09-08 04:46:09.228: [ OCROSD][3325355776]utread:3: Problem reading buffer d7b000 buflen 4096 retval 0 phy_offset 102400 retry 2
2011-09-08 04:46:09.228: [ OCROSD][3325355776]utread:3: Problem reading buffer d7b000 buflen 4096 retval 0 phy_offset 102400 retry 3
2011-09-08 04:46:09.228: [ OCROSD][3325355776]utread:3: Problem reading buffer d7b000 buflen 4096 retval 0 phy_offset 102400 retry 4
2011-09-08 04:46:09.229: [ OCROSD][3325355776]utread:3: Problem reading buffer d7b000 buflen 4096 retval 0 phy_offset 102400 retry 5
2011-09-08 04:46:09.229: [ OCRRAW][3325355776]propriogid:1_1: Failed to read the whole bootblock. Assumes invalid format.
2011-09-08 04:46:10.100: [ OCRAPI][3325355776]a_init:6a: Backend init successful
2011-09-08 04:46:11.033: [ OCRCONF][3325355776]Initialized DATABASE keys
2011-09-08 04:46:11.037: [ OCRCONF][3325355776]Exiting [status=success]...
#########################################################################################################
# Server Information
#########################################################################################################
[root@yin ~]# cat /etc/redhat-release
redhat release 5
#CentOS Linux release 6.0 (Final)
[root@yang ~]# cat /etc/redhat-release
redhat release 5
#CentOS Linux release 6.0 (Final)
[root@yin ~]# runlevel
N 3
[root@yang ~]# runlevel
N 3
[root@yin ~]# cat /etc/hosts
127.0.0.1 localhost.localdomain localhost
#Public
192.168.0.11 yin.localdomain yin
192.168.0.13 yang.localdomain yang
#Private
192.168.1.11 yin-priv.localdomain yin-priv
192.168.1.13 yang-priv.localdomain yang-priv
#Virtual
192.168.0.110 yin-vip.localdomain yin-vip
192.168.0.130 yang-vip.localdomain yang-vip
# SCAN
192.168.0.201 rac-scan.localdomain rac-scan
#NAS
192.168.0.11 nas1.localdomain nas1
[root@yang ~]# cat /etc/hosts
127.0.0.1 localhost.localdomain localhost
#Public
192.168.0.11 yin.localdomain yin
192.168.0.13 yang.localdomain yang
#Private
192.168.1.11 yin-priv.localdomain yin-priv
192.168.1.13 yang-priv.localdomain yang-priv
#Virtual
192.168.0.110 yin-vip.localdomain yin-vip
192.168.0.130 yang-vip.localdomain yang-vip
# SCAN
192.168.0.201 rac-scan.localdomain rac-scan
#NAS
192.168.0.11 nas1.localdomain nas1
[root@yin ~]# df
Filesystem 1K-blocks Used Available Use% Mounted on
/dev/mapper/vg_yin-lv_root
51606140 4826400 44158300 10% /
tmpfs 1285480 0 1285480 0% /dev/shm
/dev/sda1 495844 60509 409735 13% /boot
/dev/mapper/vg_yin-lv_home
97128148 4650196 87544116 6% /home
nas1:/shared_config 51606144 4826400 44158304 10% /u01/shared_config
nas1:/shared_grid 51606144 4826400 44158304 10% /u01/app/11.2.0/grid
nas1:/shared_home 51606144 4826400 44158304 10% /u01/app/oracle/product/11.2.0/db_1
nas1:/shared_data 51606144 4826400 44158304 10% /u01/oradata
[root@yang ~]# df
Filesystem 1K-blocks Used Available Use% Mounted on
/dev/mapper/vg_yang-lv_root
51606140 1751768 47232932 4% /
/dev/sda1 495844 60824 409420 13% /boot
/dev/mapper/vg_yang-lv_home
96870116 192272 91757116 1% /home
shmfs 1536000 0 1536000 0% /dev/shm
nas1:/shared_config 51606144 4826400 44158304 10% /u01/shared_config
nas1:/shared_grid 51606144 4826400 44158304 10% /u01/app/11.2.0/grid
nas1:/shared_home 51606144 4826400 44158304 10% /u01/app/oracle/product/11.2.0/db_1
nas1:/shared_data 51606144 4826400 44158304 10% /u01/oradata
[root@yin ~]# id oracle
uid=1100(oracle) gid=1000(oinstall) groups=1200(dba),1000(oinstall)
[root@yang ~]# id oracle
uid=1100(oracle) gid=1000(oinstall) groups=1200(dba),1000(oinstall)
[root@yin u01]# cat /u01/app/11.2.0/grid/crs/install/crsconfig_params
# ==========================================================
# Copyright (c) 2001, 2009, Oracle and/or its affiliates.All rights reserved.
#
# crsconfig_params.sbs -
#
# ==========================================================
SILENT=false
ORACLE_OWNER=oracle
ORA_DBA_GROUP=oinstall
ORA_ASM_GROUP=dba
LANGUAGE_ID=AMERICAN_AMERICA.AL32UTF8
ORACLE_HOME=/u01/app/11.2.0/grid
ORACLE_BASE=/u01/app/oracle
JREDIR=/u01/app/11.2.0/grid/jdk/jre/
JLIBDIR=/u01/app/11.2.0/grid/jlib
NETCFGJAR_NAME=netcfg.jar
EWTJAR_NAME=ewt3.jar
JEWTJAR_NAME=jewt4.jar
SHAREJAR_NAME=share.jar
HELPJAR_NAME=help4.jar
EMBASEJAR_NAME=oemlt.jar
VNDR_CLUSTER=false
OCR_LOCATIONS=/u01/shared_config/ocr_configuration
CLUSTER_NAME=rac-scan
HOST_NAME_LIST=yin,yang
NODE_NAME_LIST=yin,yang
PRIVATE_NAME_LIST=
VOTING_DISKS=/u01/shared_config/voting_disk
#VF_DISCOVERY_STRING=%s_vfdiscoverystring%
ASM_UPGRADE=false
ASM_SPFILE=
ASM_DISK_GROUP=
ASM_DISCOVERY_STRING=
ASM_DISKS=
ASM_REDUNDANCY=
CRS_STORAGE_OPTION=2
CSS_LEASEDURATION=400
CRS_NODEVIPS='yin-vip/255.255.255.0/eth1,yang-vip/255.255.255.0/eth1'
NODELIST=yin,yang
NETWORKS="eth1"/192.168.0.0:public,"eth0"/192.168.1.0:cluster_interconnect
SCAN_NAME=rac-scan.localdomain
SCAN_PORT=1521
GPNP_PA=
OCFS_CONFIG=
# GNS consts
GNS_CONF=false
GNS_ADDR_LIST=
GNS_DOMAIN_LIST=
GNS_ALLOW_NET_LIST=
GNS_DENY_NET_LIST=
GNS_DENY_ITF_LIST=
#### Required by OUI add node
NEW_HOST_NAME_LIST=
NEW_NODE_NAME_LIST=
NEW_PRIVATE_NAME_LIST=
NEW_NODEVIPS='yin-vip/255.255.255.0/eth1,yang-vip/255.255.255.0/eth1'
############### OCR constants
# GPNPCONFIGDIR is handled differently in dev (T_HAS_WORK for all)
# GPNPGCONFIGDIR in dev expands to T_HAS_WORK_GLOBAL
GPNPCONFIGDIR=$ORACLE_HOME
GPNPGCONFIGDIR=$ORACLE_HOME
OCRLOC=
OLRLOC=
OCRID=
CLUSTER_GUID=
CLSCFG_MISSCOUNT=
#########################################################################################################
# Cluster Verify - only errors on i386 libs which can be safely ignored
#########################################################################################################