Hi,
I'm in the process of installing the Oracle Grid Infrastructure 12.1.0.2.0 on a two node environment that is running RHEL 6.7. I have successfully run root.sh on node 1. But when I try to run the root.sh script on node 2, it fails with the following error:
...
Now product-specific root actions will be performed.
Using configuration parameter file: /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/crs/install/crsconfig_params
2016/08/03 18:53:18 CLSRSC-4001: Installing Oracle Trace File Analyzer (TFA) Collector.
2016/08/03 18:54:10 CLSRSC-4002: Successfully installed Oracle Trace File Analyzer (TFA) Collector.
2016/08/03 18:54:17 CLSRSC-363: User ignored prerequisites during installation
2016/08/03 18:54:30 CLSRSC-507: The root script cannot proceed on this node fpgpfs1a because either the first-node operations have not completed on node fpgpfs1b or there was an error in obtaining the status of the first-node operations.
Died at /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/crs/install/crsutils.pm line 3692.
The command '/opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/perl/bin/perl -I/opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/perl/lib -I/opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/crs/install /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/crs/install/rootcrs.pl ' execution failed
This is the full rootcrs log file from running the the root.sh script on Node 2:
2016-08-03 18:51:53: Checking parameters from paramfile /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/crs/install/crsconfig_params to validate installer variables
2016-08-03 18:51:53: The configuration parameter file /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/crs/install/crsconfig_params is valid
2016-08-03 18:51:53: ### Printing the configuration values from files:
2016-08-03 18:51:53: /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/crs/install/crsconfig_params
2016-08-03 18:51:53: /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/crs/install/s_crsconfig_defs
2016-08-03 18:51:53: ASM_AU_SIZE=1
2016-08-03 18:51:53: ASM_CONFIG=local
2016-08-03 18:51:53: ASM_CREDENTIALS=
2016-08-03 18:51:53: ASM_DISCOVERY_STRING=/dev/d*
2016-08-03 18:51:53: ASM_DISKS=/dev/dasdc1,/dev/dasdd1,/dev/dasde1
2016-08-03 18:51:53: ASM_DISK_GROUP=DATA
2016-08-03 18:51:53: ASM_REDUNDANCY=NORMAL
2016-08-03 18:51:53: ASM_SPFILE=
2016-08-03 18:51:53: ASM_UPGRADE=false
2016-08-03 18:51:53: BIG_CLUSTER=false
2016-08-03 18:51:53: CLSCFG_MISSCOUNT=
2016-08-03 18:51:53: CLUSTER_GUID=
2016-08-03 18:51:53: CLUSTER_NAME=fpgpfs1-cluster
2016-08-03 18:51:53: CRFHOME="/opt/oracle/app/12.1.0/grid-fpgpfs1-cluster"
2016-08-03 18:51:53: CRS_LIMIT_CORE=unlimited
2016-08-03 18:51:53: CRS_LIMIT_MEMLOCK=unlimited
2016-08-03 18:51:53: CRS_LSNR_STACK=10240
2016-08-03 18:51:53: CRS_NODEVIPS="fpgpfs1b-vip.fpet.pokprv.stglabs.ibm.com/255.255.255.0/enccw0.0.0f00,fpgpfs1a-vip.fpet.pokprv.stglabs.ibm.com/255.255.255.0/enccw0.0.0f00"
2016-08-03 18:51:53: CRS_STORAGE_OPTION=1
2016-08-03 18:51:53: CSS_LEASEDURATION=400
2016-08-03 18:51:53: DIRPREFIX=
2016-08-03 18:51:53: DISABLE_OPROCD=0
2016-08-03 18:51:53: EXTERNAL_ORACLE=/opt/oracle
2016-08-03 18:51:53: EXTERNAL_ORACLE_BIN=/opt/oracle/bin
2016-08-03 18:51:53: GNS_ADDR_LIST=
2016-08-03 18:51:53: GNS_ALLOW_NET_LIST=
2016-08-03 18:51:53: GNS_CONF=false
2016-08-03 18:51:53: GNS_CREDENTIALS=
2016-08-03 18:51:53: GNS_DENY_ITF_LIST=
2016-08-03 18:51:53: GNS_DENY_NET_LIST=
2016-08-03 18:51:53: GNS_DOMAIN_LIST=
2016-08-03 18:51:53: GNS_TYPE=
2016-08-03 18:51:53: GPNPCONFIGDIR=/opt/oracle/app/12.1.0/grid-fpgpfs1-cluster
2016-08-03 18:51:53: GPNPGCONFIGDIR=/opt/oracle/app/12.1.0/grid-fpgpfs1-cluster
2016-08-03 18:51:53: GPNP_PA=
2016-08-03 18:51:53: HOST_NAME_LIST=fpgpfs1b,fpgpfs1a
2016-08-03 18:51:53: HUB_NODE_LIST=
2016-08-03 18:51:53: HUB_NODE_VIPS=
2016-08-03 18:51:53: HUB_SIZE=-1
2016-08-03 18:51:53: ID=/etc/init.d
2016-08-03 18:51:53: INIT=/sbin/init
2016-08-03 18:51:53: INITCTL=/sbin/initctl
2016-08-03 18:51:53: INSTALL_NODE=fpgpfs1b.fpet.pokprv.stglabs.ibm.com
2016-08-03 18:51:53: ISROLLING=true
2016-08-03 18:51:53: IT=/etc/inittab
2016-08-03 18:51:53: JLIBDIR=/opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/jlib
2016-08-03 18:51:53: JREDIR=/opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/jdk/jre/
2016-08-03 18:51:53: LANGUAGE_ID=AMERICAN_AMERICA.AL32UTF8
2016-08-03 18:51:53: LISTENER_USERNAME=oracle
2016-08-03 18:51:53: MGMT_DB=false
2016-08-03 18:51:53: MSGFILE=/var/adm/messages
2016-08-03 18:51:53: NETWORKS="eth1"/10.20.82.0:cluster_interconnect,"enccw0.0.0f00"/10.20.72.0:public
2016-08-03 18:51:53: NEW_HOST_NAME_LIST=
2016-08-03 18:51:53: NEW_NODEVIPS="fpgpfs1b-vip.fpet.pokprv.stglabs.ibm.com/255.255.255.0/enccw0.0.0f00,fpgpfs1a-vip.fpet.pokprv.stglabs.ibm.com/255.255.255.0/enccw0.0.0f00"
2016-08-03 18:51:53: NEW_NODE_NAME_LIST=
2016-08-03 18:51:53: NEW_PRIVATE_NAME_LIST=
2016-08-03 18:51:53: NODELIST=fpgpfs1b,fpgpfs1a
2016-08-03 18:51:53: NODE_NAME_LIST=fpgpfs1b,fpgpfs1a
2016-08-03 18:51:53: OCRCONFIG=/etc/oracle/ocr.loc
2016-08-03 18:51:53: OCRCONFIGDIR=/etc/oracle
2016-08-03 18:51:53: OCRID=
2016-08-03 18:51:53: OCRLOC=ocr.loc
2016-08-03 18:51:53: OCR_LOCATIONS=NO_VAL
2016-08-03 18:51:53: OLASTGASPDIR=/etc/oracle/lastgasp
2016-08-03 18:51:53: OLD_CRS_HOME=
2016-08-03 18:51:53: OLRCONFIG=/etc/oracle/olr.loc
2016-08-03 18:51:53: OLRCONFIGDIR=/etc/oracle
2016-08-03 18:51:53: OLRLOC=olr.loc
2016-08-03 18:51:53: OPROCDCHECKDIR=/etc/oracle/oprocd/check
2016-08-03 18:51:53: OPROCDDIR=/etc/oracle/oprocd
2016-08-03 18:51:53: OPROCDFATALDIR=/etc/oracle/oprocd/fatal
2016-08-03 18:51:53: OPROCDSTOPDIR=/etc/oracle/oprocd/stop
2016-08-03 18:51:53: ORACLE_BASE=/opt/oracle/app/oracle
2016-08-03 18:51:53: ORACLE_HOME=/opt/oracle/app/12.1.0/grid-fpgpfs1-cluster
2016-08-03 18:51:53: ORACLE_OWNER=oracle
2016-08-03 18:51:53: ORA_ASM_GROUP=oinstall
2016-08-03 18:51:53: ORA_DBA_GROUP=oinstall
2016-08-03 18:51:53: PING_TARGETS=
2016-08-03 18:51:53: PRIVATE_NAME_LIST=
2016-08-03 18:51:53: RCALLDIR=/etc/rc.d/rc0.d /etc/rc.d/rc1.d /etc/rc.d/rc2.d /etc/rc.d/rc3.d /etc/rc.d/rc4.d /etc/rc.d/rc5.d /etc/rc.d/rc6.d
2016-08-03 18:51:53: RCKDIR=/etc/rc.d/rc0.d /etc/rc.d/rc1.d /etc/rc.d/rc2.d /etc/rc.d/rc4.d /etc/rc.d/rc6.d
2016-08-03 18:51:53: RCSDIR=/etc/rc.d/rc3.d /etc/rc.d/rc5.d
2016-08-03 18:51:53: RC_KILL=K15
2016-08-03 18:51:53: RC_KILL_OLD=K96
2016-08-03 18:51:53: RC_KILL_OLD2=K19
2016-08-03 18:51:53: RC_START=S96
2016-08-03 18:51:53: REUSEDG=false
2016-08-03 18:51:53: RIM_NODE_LIST=
2016-08-03 18:51:53: SCAN_NAME=fpgpfs1-cluster
2016-08-03 18:51:53: SCAN_PORT=1521
2016-08-03 18:51:53: SCRBASE=/etc/oracle/scls_scr
2016-08-03 18:51:53: SILENT=false
2016-08-03 18:51:53: SO_EXT=so
2016-08-03 18:51:53: SRVCFGLOC=srvConfig.loc
2016-08-03 18:51:53: SRVCONFIG=/var/opt/oracle/srvConfig.loc
2016-08-03 18:51:53: SRVCONFIGDIR=/var/opt/oracle
2016-08-03 18:51:53: SYSTEMCTL=/usr/bin/systemctl
2016-08-03 18:51:53: SYSTEMD_SYSTEM_DIR=/etc/systemd/system
2016-08-03 18:51:53: TZ=America/New_York
2016-08-03 18:51:53: UPSTART_INIT_DIR=/etc/init
2016-08-03 18:51:53: USER_IGNORED_PREREQ=true
2016-08-03 18:51:53: VNDR_CLUSTER=false
2016-08-03 18:51:53: VOTING_DISKS=NO_VAL
2016-08-03 18:51:53: ### Printing other configuration values ###
2016-08-03 18:51:53: CLSCFG_EXTRA_PARMS=
2016-08-03 18:51:53: HAS_GROUP=oinstall
2016-08-03 18:51:53: HAS_USER=root
2016-08-03 18:51:53: HOST=fpgpfs1a
2016-08-03 18:51:53: OLR_DIRECTORY=/opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/cdata
2016-08-03 18:51:53: OLR_LOCATION=/opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/cdata/fpgpfs1a.olr
2016-08-03 18:51:53: ORA_CRS_HOME=/opt/oracle/app/12.1.0/grid-fpgpfs1-cluster
2016-08-03 18:51:53: SIHA=0
2016-08-03 18:51:53: SUCC_REBOOT=0
2016-08-03 18:51:53: SUPERUSER=root
2016-08-03 18:51:53: addfile=/opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/crs/install/crsconfig_addparams
2016-08-03 18:51:53: cluutil_trc_suff_pp=0
2016-08-03 18:51:53: crscfg_trace=1
2016-08-03 18:51:53: crscfg_trace_file=/opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/cfgtoollogs/crsconfig/rootcrs_fpgpfs1a_2016-08-03_06-51-53PM.log
2016-08-03 18:51:53: old_nodevips=
2016-08-03 18:51:53: osdfile=/opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/crs/install/s_crsconfig_defs
2016-08-03 18:51:53: parameters_valid=1
2016-08-03 18:51:53: paramfile=/opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/crs/install/crsconfig_params
2016-08-03 18:51:53: platform_family=unix
2016-08-03 18:51:53: pp_srvctl_trc_suff=0
2016-08-03 18:51:53: srvctl_trc_suff=0
2016-08-03 18:51:53: srvctl_trc_suff_pp=0
2016-08-03 18:51:53: stackStartLevel=11
2016-08-03 18:51:53: user_is_superuser=1
2016-08-03 18:51:53: ### Printing of configuration values complete ###
2016-08-03 18:51:53: Save the ASM password file location: +DATA/orapwASM
2016-08-03 18:51:53: Performing few checks before running scripts
2016-08-03 18:51:53: Attempt to get current working directory
2016-08-03 18:51:53: Running as user oracle: pwd
2016-08-03 18:51:53: s_run_as_user2: Running /bin/su oracle -c ' echo CLSRSC_START; pwd '
2016-08-03 18:51:53: Removing file /tmp/fileTIzBgf
2016-08-03 18:51:53: Successfully removed file: /tmp/fileTIzBgf
2016-08-03 18:51:53: pipe exit code: 0
2016-08-03 18:51:53: /bin/su successfully executed
2016-08-03 18:51:53: The current working directory: /root
2016-08-03 18:51:53: Pre-checkes for running scripts passed
2016-08-03 18:51:53: Instantiating scripts in GI home: /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster
2016-08-03 18:51:53: SRC FILE: /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/crs/sbs/crsconfig_dirs.sbs; DST PATH: /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/crs/utl/fpgpfs1a/crsconfig_dirs
2016-08-03 18:51:53: SRC FILE: /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/crs/sbs/crsconfig_fileperms.sbs; DST PATH: /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/crs/utl/fpgpfs1a/crsconfig_fileperms
2016-08-03 18:51:53: Resetting ACFS wrapper scripts
2016-08-03 18:51:53: Set CRS_ADR_DISABLE to stop CLSB initializing ADR
2016-08-03 18:51:53: Enable CLSB to initialize ADR
2016-08-03 18:51:53: skipping set file perm for acfs file /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/bin/acfsdriverstate. File does not exist
2016-08-03 18:51:53: skipping set file perm for acfs file /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/bin/acfsload. File does not exist
2016-08-03 18:51:53: skipping set file perm for acfs file /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/bin/acfsregistrymount. File does not exist
2016-08-03 18:51:53: skipping set file perm for acfs file /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/bin/acfsroot. File does not exist
2016-08-03 18:51:53: skipping set file perm for acfs file /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/bin/acfssinglefsmount. File does not exist
2016-08-03 18:51:53: skipping set file perm for acfs file /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/bin/acfsrepl_apply. File does not exist
2016-08-03 18:51:53: skipping set file perm for acfs file /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/bin/acfsrepl_apply.bin. File does not exist
2016-08-03 18:51:53: skipping set file perm for acfs file /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/bin/acfsreplcrs. File does not exist
2016-08-03 18:51:53: skipping set file perm for acfs file /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/lib/acfsreplcrs.pl. File does not exist
2016-08-03 18:51:53: skipping set file perm for acfs file /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/bin/acfsrepl_initializer. File does not exist
2016-08-03 18:51:53: skipping set file perm for acfs file /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/bin/acfsrepl_monitor. File does not exist
2016-08-03 18:51:53: skipping set file perm for acfs file /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/bin/acfsrepl_preapply. File does not exist
2016-08-03 18:51:53: skipping set file perm for acfs file /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/bin/acfsrepl_transport. File does not exist
2016-08-03 18:51:53: skipping set file perm for acfs file /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/lib/acfsdriverstate.pl. File does not exist
2016-08-03 18:51:53: skipping set file perm for acfs file /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/lib/acfsload.pl. File does not exist
2016-08-03 18:51:53: skipping set file perm for acfs file /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/lib/acfsregistrymount.pl. File does not exist
2016-08-03 18:51:53: skipping set file perm for acfs file /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/lib/acfsroot.pl. File does not exist
2016-08-03 18:51:53: skipping set file perm for acfs file /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/lib/acfssinglefsmount.pl. File does not exist
2016-08-03 18:51:53: skipping set file perm for acfs file /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/lib/acfstoolsdriver.sh. File does not exist
2016-08-03 18:51:53: skipping set file perm for acfs file /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/lib/libacfs12.so. File does not exist
2016-08-03 18:51:53: skipping set file perm for oka file /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/bin/okadriverstate. File does not exist
2016-08-03 18:51:53: skipping set file perm for oka file /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/bin/okaload. File does not exist
2016-08-03 18:51:53: skipping set file perm for oka file /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/bin/okaroot. File does not exist
2016-08-03 18:51:53: skipping set file perm for oka file /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/lib/okadriverstate.pl. File does not exist
2016-08-03 18:51:53: skipping set file perm for oka file /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/lib/okaload.pl. File does not exist
2016-08-03 18:51:53: skipping set file perm for oka file /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/lib/okaroot.pl. File does not exist
2016-08-03 18:51:53: skipping set file perm for oka file /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/lib/okatoolsdriver.sh. File does not exist
2016-08-03 18:51:53: skipping set file perm for afd file /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/bin/afddriverstate. File does not exist
2016-08-03 18:51:53: skipping set file perm for afd file /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/bin/afdload. File does not exist
2016-08-03 18:51:53: skipping set file perm for afd file /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/bin/afdroot. File does not exist
2016-08-03 18:51:53: skipping set file perm for afd file /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/lib/afddriverstate.pl. File does not exist
2016-08-03 18:51:53: skipping set file perm for afd file /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/lib/afdload.pl. File does not exist
2016-08-03 18:51:53: skipping set file perm for afd file /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/lib/afdroot.pl. File does not exist
2016-08-03 18:51:53: skipping set file perm for afd file /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/lib/afdtoolsdriver.sh. File does not exist
2016-08-03 18:51:53: saving current owner/permisssios of parent dir of /opt/oracle/app/12.1.0
2016-08-03 18:51:53: saving parent dir ACLs in /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/crs/install/ParentDirPerm_fpgpfs1a.txt
2016-08-03 18:51:53: Getting file permissions for /opt/oracle/app/12.1.0
2016-08-03 18:51:53: Getting file permissions for /opt/oracle/app
2016-08-03 18:51:53: Getting file permissions for /opt/oracle
2016-08-03 18:51:53: Getting file permissions for /opt
2016-08-03 18:51:53: writing /opt/oracle/app/12.1.0:root:oinstall:0755 to /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/crs/install/ParentDirPerm_fpgpfs1a.txt
2016-08-03 18:51:53: writing /opt/oracle/app:root:oinstall:0755 to /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/crs/install/ParentDirPerm_fpgpfs1a.txt
2016-08-03 18:51:53: writing /opt/oracle:root:oinstall:0755 to /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/crs/install/ParentDirPerm_fpgpfs1a.txt
2016-08-03 18:51:53: writing /opt:root:oinstall:0755 to /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/crs/install/ParentDirPerm_fpgpfs1a.txt
2016-08-03 18:53:18: /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/bin/acfsdriverstate not found
2016-08-03 18:53:18: Executing cmd: /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/bin/clsecho -p has -f clsrsc -m 4001
2016-08-03 18:53:18: Command output:
> CLSRSC-4001: Installing Oracle Trace File Analyzer (TFA) Collector.
>End Command output
2016-08-03 18:53:18: Executing cmd: /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/bin/clsecho -p has -f clsrsc -m 4001
2016-08-03 18:53:18: Command output:
> CLSRSC-4001: Installing Oracle Trace File Analyzer (TFA) Collector.
>End Command output
2016-08-03 18:53:18: CLSRSC-4001: Installing Oracle Trace File Analyzer (TFA) Collector.
2016-08-03 18:53:18: Executing cmd: /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/crs/install/tfa_setup -silent -crshome /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster
2016-08-03 18:54:10: Command output:
>
> Starting TFA installation
>
> Not able to find TFA binaries.
> Using JAVA_HOME : /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/jdk/jre
>
> Running Auto Setup for TFA as user root...
>
> Installing TFA now...
>
>
> TFA Will be Installed on fpgpfs1a...
>
> TFA will scan the following Directories
> ++++++++++++++++++++++++++++++++++++++++++++
>
> .-------------------------------------------------------------------------.
> | fpgpfs1a |
> +--------------------------------------------------------------+----------+
> | Trace Directory | Resource |
> +--------------------------------------------------------------+----------+
> | /opt/oraInventory/ContentsXML | INSTALL |
> | /opt/oraInventory/logs | INSTALL |
> | /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/OPatch/crs/log | CRS |
> | /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/cfgtoollogs | CFGTOOLS |
> | /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/crs/log | CRS |
> | /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/cv/log | CRS |
> | /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/evm/admin/log | CRS |
> | /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/evm/admin/logger | CRS |
> | /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/evm/log | CRS |
> | /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/install | INSTALL |
> | /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/log | CRS |
> | /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/network/log | CRS |
> | /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/oc4j/j2ee/home/l | DBWLM |
> | /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/opmn/logs | CRS |
> | /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/racg/log | CRS |
> | /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/rdbms/log | ASM |
> | /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/scheduler/log | CRS |
> | /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/srvm/log | CRS |
> | /opt/oracle/app/oracle/crsdata/fpgpfs1a/acfs | ACFS |
> | /opt/oracle/app/oracle/crsdata/fpgpfs1a/core | CRS |
> | /opt/oracle/app/oracle/crsdata/fpgpfs1a/crsconfig | CRS |
> | /opt/oracle/app/oracle/crsdata/fpgpfs1a/crsdiag | CRS |
> | /opt/oracle/app/oracle/crsdata/fpgpfs1a/cvu | CRS |
> | /opt/oracle/app/oracle/crsdata/fpgpfs1a/evm | CRS |
> | /opt/oracle/app/oracle/crsdata/fpgpfs1a/output | CRS |
> | /opt/oracle/app/oracle/crsdata/fpgpfs1a/trace | CRS |
> '--------------------------------------------------------------+----------'
>
>
> Installing TFA on fpgpfs1a:
> HOST: fpgpfs1a TFA_HOME: /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/tfa/fpgpfs1a/tfa_home
>
> .-----------------------------------------------------------------------------.
> | Host | Status of TFA | PID | Port | Version | Build ID |
> +----------+---------------+-------+------+------------+----------------------+
> | fpgpfs1a | RUNNING | 38690 | 5000 | 12.1.2.0.0 | 12120020140619094932 |
> '----------+---------------+-------+------+------------+----------------------'
>
> Running Inventory in All Nodes...
>
> Enabling Access for Non-root Users on fpgpfs1a...
>
> Adding default users and groups to TFA Access list...
>
> Summary of TFA Installation:
> .-----------------------------------------------------------------------------------------.
> | fpgpfs1a |
> +---------------------+-------------------------------------------------------------------+
> | Parameter | Value |
> +---------------------+-------------------------------------------------------------------+
> | Install location | /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/tfa/fpgpfs1a/tfa_home |
> | Repository location | /opt/oracle/app/oracle/tfa/repository |
> | Repository usage | 0 MB out of 10240 MB |
> '---------------------+-------------------------------------------------------------------'
>
>
> Installing oratop extension..
>
>
> TFA is successfully installed...
>
>
> Usage : /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/bin/tfactl <command> [options]
> <command> =
> start Starts TFA
> stop Stops TFA
> enable Enable TFA Auto restart
> disable Disable TFA Auto restart
> print Print requested details
> access Add or Remove or List TFA Users and Groups
> purge Delete collections from TFA repository
> directory Add or Remove or Modify directory in TFA
> host Add or Remove host in TFA
> diagcollect Collect logs from across nodes in cluster
> analyze List events summary and search strings in alert logs.
> set Turn ON/OFF or Modify various TFA features
> uninstall Uninstall TFA from this node
>
> For help with a command: /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/bin/tfactl <command> -help
>
>
>End Command output
2016-08-03 18:54:10: Executing cmd: /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/bin/clsecho -p has -f clsrsc -m 4002
2016-08-03 18:54:10: Command output:
> CLSRSC-4002: Successfully installed Oracle Trace File Analyzer (TFA) Collector.
>End Command output
2016-08-03 18:54:10: Executing cmd: /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/bin/clsecho -p has -f clsrsc -m 4002
2016-08-03 18:54:10: Command output:
> CLSRSC-4002: Successfully installed Oracle Trace File Analyzer (TFA) Collector.
>End Command output
2016-08-03 18:54:10: CLSRSC-4002: Successfully installed Oracle Trace File Analyzer (TFA) Collector.
2016-08-03 18:54:10: Executing cmd: /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/bin/sqlplus -V
2016-08-03 18:54:10: Command output:
>
> SQL*Plus: Release 12.1.0.2.0 Production
>
>End Command output
2016-08-03 18:54:10: Got CRS release version: 12.1.0.2.0
2016-08-03 18:54:10: ckpt: -ckpt -oraclebase /opt/oracle/app/oracle -chkckpt -name ROOTCRS_STACK
2016-08-03 18:54:10: Invoking "/opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/bin/cluutil -ckpt -oraclebase /opt/oracle/app/oracle -chkckpt -name ROOTCRS_STACK"
2016-08-03 18:54:10: trace file=/opt/oracle/app/oracle/crsdata/fpgpfs1a/crsconfig/cluutil1.log
2016-08-03 18:54:10: Running as user oracle: /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/bin/cluutil -ckpt -oraclebase /opt/oracle/app/oracle -chkckpt -name ROOTCRS_STACK
2016-08-03 18:54:10: s_run_as_user2: Running /bin/su oracle -c ' echo CLSRSC_START; /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/bin/cluutil -ckpt -oraclebase /opt/oracle/app/oracle -chkckpt -name ROOTCRS_STACK '
2016-08-03 18:54:11: Removing file /tmp/fileFw4EyO
2016-08-03 18:54:11: Successfully removed file: /tmp/fileFw4EyO
2016-08-03 18:54:11: pipe exit code: 0
2016-08-03 18:54:11: /bin/su successfully executed
2016-08-03 18:54:11: Invoking "/opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/bin/cluutil -ckpt -oraclebase /opt/oracle/app/oracle -chkckpt -name ROOTCRS_STACK -pname VERSION"
2016-08-03 18:54:11: trace file=/opt/oracle/app/oracle/crsdata/fpgpfs1a/crsconfig/cluutil2.log
2016-08-03 18:54:11: Running as user oracle: /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/bin/cluutil -ckpt -oraclebase /opt/oracle/app/oracle -chkckpt -name ROOTCRS_STACK -pname VERSION
2016-08-03 18:54:11: s_run_as_user2: Running /bin/su oracle -c ' echo CLSRSC_START; /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/bin/cluutil -ckpt -oraclebase /opt/oracle/app/oracle -chkckpt -name ROOTCRS_STACK -pname VERSION '
2016-08-03 18:54:13: Removing file /tmp/fileoibafS
2016-08-03 18:54:13: Successfully removed file: /tmp/fileoibafS
2016-08-03 18:54:13: pipe exit code: 0
2016-08-03 18:54:13: /bin/su successfully executed
2016-08-03 18:54:13: The property VERSION for checkpoint:ROOTCRS_STACK is there
2016-08-03 18:54:13: Invoking "/opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/bin/cluutil -ckpt -oraclebase /opt/oracle/app/oracle -listckpt -name ROOTCRS_STACK -pname VERSION"
2016-08-03 18:54:13: trace file=/opt/oracle/app/oracle/crsdata/fpgpfs1a/crsconfig/cluutil3.log
2016-08-03 18:54:13: Running as user oracle: /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/bin/cluutil -ckpt -oraclebase /opt/oracle/app/oracle -listckpt -name ROOTCRS_STACK -pname VERSION
2016-08-03 18:54:13: s_run_as_user2: Running /bin/su oracle -c ' echo CLSRSC_START; /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/bin/cluutil -ckpt -oraclebase /opt/oracle/app/oracle -listckpt -name ROOTCRS_STACK -pname VERSION '
2016-08-03 18:54:15: Removing file /tmp/filenr8EFJ
2016-08-03 18:54:15: Successfully removed file: /tmp/filenr8EFJ
2016-08-03 18:54:15: pipe exit code: 0
2016-08-03 18:54:15: /bin/su successfully executed
2016-08-03 18:54:15: Succeeded to get property value:VERSION=12.1.0.2.0
2016-08-03 18:54:15: version1 is 12.1.0.2.0
2016-08-03 18:54:15: version2 is 12.1.0.2.0
2016-08-03 18:54:15: Version match status is 1
2016-08-03 18:54:15: Setting isRerun to TRUE
2016-08-03 18:54:15: Invoking "/opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/bin/cluutil -ckpt -oraclebase /opt/oracle/app/oracle -chkckpt -name ROOTCRS_STACK -status"
2016-08-03 18:54:15: trace file=/opt/oracle/app/oracle/crsdata/fpgpfs1a/crsconfig/cluutil4.log
2016-08-03 18:54:15: Running as user oracle: /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/bin/cluutil -ckpt -oraclebase /opt/oracle/app/oracle -chkckpt -name ROOTCRS_STACK -status
2016-08-03 18:54:15: s_run_as_user2: Running /bin/su oracle -c ' echo CLSRSC_START; /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/bin/cluutil -ckpt -oraclebase /opt/oracle/app/oracle -chkckpt -name ROOTCRS_STACK -status '
2016-08-03 18:54:17: Removing file /tmp/fileuJ0t2Q
2016-08-03 18:54:17: Successfully removed file: /tmp/fileuJ0t2Q
2016-08-03 18:54:17: pipe exit code: 0
2016-08-03 18:54:17: /bin/su successfully executed
2016-08-03 18:54:17: The 'ROOTCRS_STACK' status is FAILED
2016-08-03 18:54:17: USER_IGNORED_PREREQ is set to 1
2016-08-03 18:54:17: Executing cmd: /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/bin/clsecho -p has -f clsrsc -m 363
2016-08-03 18:54:17: Command output:
> CLSRSC-363: User ignored prerequisites during installation
>End Command output
2016-08-03 18:54:17: Executing cmd: /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/bin/clsecho -p has -f clsrsc -m 363
2016-08-03 18:54:17: Command output:
> CLSRSC-363: User ignored prerequisites during installation
>End Command output
2016-08-03 18:54:17: CLSRSC-363: User ignored prerequisites during installation
2016-08-03 18:54:17: Invoking "/opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/bin/cluutil -ckpt -oraclebase /opt/oracle/app/oracle -chkckpt -name ROOTCRS_STACK -status"
2016-08-03 18:54:17: trace file=/opt/oracle/app/oracle/crsdata/fpgpfs1a/crsconfig/cluutil5.log
2016-08-03 18:54:17: Running as user oracle: /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/bin/cluutil -ckpt -oraclebase /opt/oracle/app/oracle -chkckpt -name ROOTCRS_STACK -status
2016-08-03 18:54:17: s_run_as_user2: Running /bin/su oracle -c ' echo CLSRSC_START; /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/bin/cluutil -ckpt -oraclebase /opt/oracle/app/oracle -chkckpt -name ROOTCRS_STACK -status '
2016-08-03 18:54:18: Removing file /tmp/filehmTbZi
2016-08-03 18:54:18: Successfully removed file: /tmp/filehmTbZi
2016-08-03 18:54:18: pipe exit code: 0
2016-08-03 18:54:18: /bin/su successfully executed
2016-08-03 18:54:18: The 'ROOTCRS_STACK' status is FAILED
2016-08-03 18:54:18: Saving the configuration parameter file data
2016-08-03 18:54:18: checkpoint status of ROOTCRS_STACK is FAIL
2016-08-03 18:54:18: ckpt: -ckpt -oraclebase /opt/oracle/app/oracle -chkckpt -name ROOTCRS_PARAM
2016-08-03 18:54:18: Invoking "/opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/bin/cluutil -ckpt -oraclebase /opt/oracle/app/oracle -chkckpt -name ROOTCRS_PARAM"
2016-08-03 18:54:18: trace file=/opt/oracle/app/oracle/crsdata/fpgpfs1a/crsconfig/cluutil6.log
2016-08-03 18:54:18: Running as user oracle: /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/bin/cluutil -ckpt -oraclebase /opt/oracle/app/oracle -chkckpt -name ROOTCRS_PARAM
2016-08-03 18:54:18: s_run_as_user2: Running /bin/su oracle -c ' echo CLSRSC_START; /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/bin/cluutil -ckpt -oraclebase /opt/oracle/app/oracle -chkckpt -name ROOTCRS_PARAM '
2016-08-03 18:54:20: Removing file /tmp/filerCmX5d
2016-08-03 18:54:20: Successfully removed file: /tmp/filerCmX5d
2016-08-03 18:54:20: pipe exit code: 0
2016-08-03 18:54:20: /bin/su successfully executed
2016-08-03 18:54:20: ckpt: -ckpt -oraclebase /opt/oracle/app/oracle -chkckpt -name ROOTCRS_PARAM
2016-08-03 18:54:20: Invoking "/opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/bin/cluutil -ckpt -oraclebase /opt/oracle/app/oracle -chkckpt -name ROOTCRS_PARAM"
2016-08-03 18:54:20: trace file=/opt/oracle/app/oracle/crsdata/fpgpfs1a/crsconfig/cluutil7.log
2016-08-03 18:54:20: Running as user oracle: /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/bin/cluutil -ckpt -oraclebase /opt/oracle/app/oracle -chkckpt -name ROOTCRS_PARAM
2016-08-03 18:54:20: s_run_as_user2: Running /bin/su oracle -c ' echo CLSRSC_START; /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/bin/cluutil -ckpt -oraclebase /opt/oracle/app/oracle -chkckpt -name ROOTCRS_PARAM '
2016-08-03 18:54:21: Removing file /tmp/filelXWf1y
2016-08-03 18:54:21: Successfully removed file: /tmp/filelXWf1y
2016-08-03 18:54:21: pipe exit code: 0
2016-08-03 18:54:21: /bin/su successfully executed
2016-08-03 18:54:21: Invoking "/opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/bin/cluutil -ckpt -oraclebase /opt/oracle/app/oracle -chkckpt -name ROOTCRS_PARAM -status"
2016-08-03 18:54:21: trace file=/opt/oracle/app/oracle/crsdata/fpgpfs1a/crsconfig/cluutil8.log
2016-08-03 18:54:21: Running as user oracle: /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/bin/cluutil -ckpt -oraclebase /opt/oracle/app/oracle -chkckpt -name ROOTCRS_PARAM -status
2016-08-03 18:54:21: s_run_as_user2: Running /bin/su oracle -c ' echo CLSRSC_START; /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/bin/cluutil -ckpt -oraclebase /opt/oracle/app/oracle -chkckpt -name ROOTCRS_PARAM -status '
2016-08-03 18:54:22: Removing file /tmp/filewQ0wL2
2016-08-03 18:54:22: Successfully removed file: /tmp/filewQ0wL2
2016-08-03 18:54:22: pipe exit code: 0
2016-08-03 18:54:22: /bin/su successfully executed
2016-08-03 18:54:22: The 'ROOTCRS_PARAM' status is SUCCESS
2016-08-03 18:54:22: AFD is not supported on this platform.
2016-08-03 18:54:22: Platform specific setup actions are done
2016-08-03 18:54:22: Oracle CRS home = /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster
2016-08-03 18:54:22: Host name = fpgpfs1a
2016-08-03 18:54:22: CRS user = oracle
2016-08-03 18:54:22: Oracle CRS home = /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster
2016-08-03 18:54:22: GPnP host = fpgpfs1a
2016-08-03 18:54:22: Oracle GPnP home = /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/gpnp
2016-08-03 18:54:22: Oracle GPnP local home = /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/gpnp/fpgpfs1a
2016-08-03 18:54:22: GPnP directories verified.
2016-08-03 18:54:22: Checking to see if Oracle CRS stack is already configured
2016-08-03 18:54:22: Oracle CRS stack is not configured yet
2016-08-03 18:54:22: ---Checking local gpnp setup...
2016-08-03 18:54:22: The setup file "/opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/gpnp/fpgpfs1a/profiles/peer/profile.xml" does not exist
2016-08-03 18:54:22: The setup file "/opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/gpnp/fpgpfs1a/wallets/peer/cwallet.sso" does not exist
2016-08-03 18:54:22: The setup file "/opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/gpnp/fpgpfs1a/wallets/prdr/cwallet.sso" does not exist
2016-08-03 18:54:22: chk gpnphome /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/gpnp/fpgpfs1a: profile_ok 0 wallet_ok 0 r/o_wallet_ok 0
2016-08-03 18:54:22: chk gpnphome /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/gpnp/fpgpfs1a: INVALID (bad profile/wallet)
2016-08-03 18:54:22: ---Checking cluster-wide gpnp setup...
2016-08-03 18:54:22: chk gpnphome /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/gpnp: profile_ok 1 wallet_ok 1 r/o_wallet_ok 1
2016-08-03 18:54:22: gpnptool: run /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/bin/gpnptool verify -p="/opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/gpnp/profiles/peer/profile.xml" -w="file:/opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/gpnp/wallets/peer" -wu=peer
2016-08-03 18:54:22: Running as user oracle: /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/bin/gpnptool verify -p="/opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/gpnp/profiles/peer/profile.xml" -w="file:/opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/gpnp/wallets/peer" -wu=peer
2016-08-03 18:54:22: s_run_as_user2: Running /bin/su oracle -c ' echo CLSRSC_START; /opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/bin/gpnptool verify -p="/opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/gpnp/profiles/peer/profile.xml" -w="file:/opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/gpnp/wallets/peer" -wu=peer '
2016-08-03 18:54:22: Removing file /tmp/filestokei
2016-08-03 18:54:22: Successfully removed file: /tmp/filestokei
2016-08-03 18:54:22: pipe exit code: 0
2016-08-03 18:54:22: /bin/su successfully executed
2016-08-03 18:54:22: gpnptool: rc=0
2016-08-03 18:54:22: gpnptool output:
Profile signature is valid.
2016-08-03 18:54:22: Profile "/opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/gpnp/profiles/peer/profile.xml" signature is VALID for wallet "file:/opt/oracle/app/12.1.0/grid-fpgpfs1-cluster/gpnp/wal