Hi Oracle Gurus
Oracle12c Grid 2 Node v12.1.0.2.0
RHEL 7
During Last Node Cluster - deconfigure I got below error.
[root@csm-clstrnode1 ~]# /u01/app/12.1.0.2/grid/perl/bin/perl /u01/app/12.1.0.2/grid/crs/install/rootcrs.pl -deconfig -force -verbose -lastnode
Using configuration parameter file: /u01/app/12.1.0.2/grid/crs/install/crsconfig_params
PRCR-1070 : Failed to check if resource ora.cvu is registered
CRS-0184 : Cannot communicate with the CRS daemon.
2016/09/03 23:49:03 CLSRSC-180: An error occurred while executing the command 'srvctl stop cvu -f' (error code 0)
PRCR-1070 : Failed to check if resource ora.cvu is registered
CRS-0184 : Cannot communicate with the CRS daemon.
2016/09/03 23:49:03 CLSRSC-180: An error occurred while executing the command 'srvctl remove cvu -f' (error code 0)
OC4J failed to stop
PRCR-1070 : Failed to check if resource ora.oc4j is registered
CRS-0184 : Cannot communicate with the CRS daemon.
OC4J could not be removed
PRCR-1070 : Failed to check if resource ora.oc4j is registered
CRS-0184 : Cannot communicate with the CRS daemon.
PRCR-1068 : Failed to query resources
CRS-0184 : Cannot communicate with the CRS daemon.
PRCR-1068 : Failed to query resources
CRS-0184 : Cannot communicate with the CRS daemon.
PRCR-1068 : Failed to query resources
CRS-0184 : Cannot communicate with the CRS daemon.
PRCR-1068 : Failed to query resources
CRS-0184 : Cannot communicate with the CRS daemon.
PRCR-1070 : Failed to check if resource ora.net1.network is registered
CRS-0184 : Cannot communicate with the CRS daemon.
PRCR-1070 : Failed to check if resource ora.helper is registered
CRS-0184 : Cannot communicate with the CRS daemon.
PRCR-1070 : Failed to check if resource ora.ons is registered
CRS-0184 : Cannot communicate with the CRS daemon.
CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'csm-clstrnode1'
CRS-2673: Attempting to stop 'ora.mdnsd' on 'csm-clstrnode1'
CRS-2673: Attempting to stop 'ora.gpnpd' on 'csm-clstrnode1'
CRS-2673: Attempting to stop 'ora.ctssd' on 'csm-clstrnode1'
CRS-2673: Attempting to stop 'ora.evmd' on 'csm-clstrnode1'
CRS-2677: Stop of 'ora.mdnsd' on 'csm-clstrnode1' succeeded
CRS-2677: Stop of 'ora.ctssd' on 'csm-clstrnode1' succeeded
CRS-2677: Stop of 'ora.gpnpd' on 'csm-clstrnode1' succeeded
CRS-2677: Stop of 'ora.evmd' on 'csm-clstrnode1' succeeded
CRS-2673: Attempting to stop 'ora.cssd' on 'csm-clstrnode1'
CRS-2677: Stop of 'ora.cssd' on 'csm-clstrnode1' succeeded
CRS-2673: Attempting to stop 'ora.gipcd' on 'csm-clstrnode1'
CRS-2677: Stop of 'ora.gipcd' on 'csm-clstrnode1' succeeded
CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'csm-clstrnode1' has completed
CRS-4133: Oracle High Availability Services has been stopped.
CRS-4123: Oracle High Availability Services has been started.
CRS-2672: Attempting to start 'ora.evmd' on 'csm-clstrnode1'
CRS-2672: Attempting to start 'ora.mdnsd' on 'csm-clstrnode1'
CRS-2676: Start of 'ora.mdnsd' on 'csm-clstrnode1' succeeded
CRS-2676: Start of 'ora.evmd' on 'csm-clstrnode1' succeeded
CRS-2672: Attempting to start 'ora.gpnpd' on 'csm-clstrnode1'
CRS-2676: Start of 'ora.gpnpd' on 'csm-clstrnode1' succeeded
CRS-2672: Attempting to start 'ora.cssdmonitor' on 'csm-clstrnode1'
CRS-2672: Attempting to start 'ora.gipcd' on 'csm-clstrnode1'
CRS-2676: Start of 'ora.cssdmonitor' on 'csm-clstrnode1' succeeded
CRS-2676: Start of 'ora.gipcd' on 'csm-clstrnode1' succeeded
CRS-2672: Attempting to start 'ora.cssd' on 'csm-clstrnode1'
CRS-2672: Attempting to start 'ora.diskmon' on 'csm-clstrnode1'
CRS-2676: Start of 'ora.diskmon' on 'csm-clstrnode1' succeeded
CRS-2676: Start of 'ora.cssd' on 'csm-clstrnode1' succeeded
2016/09/03 23:51:51 CLSRSC-115: Start of resource 'ora.asm' failed
[root@csm-clstrnode1 ~]# /u01/app/12.1.0.2/grid/perl/bin/perl /u01/app/12.1.0.2/grid/crs/install/rootcrs.pl -deconfig -force -verbose -lastnode
Using configuration parameter file: /u01/app/12.1.0.2/grid/crs/install/crsconfig_params
PRCR-1070 : Failed to check if resource ora.cvu is registered
CRS-0184 : Cannot communicate with the CRS daemon.
2016/09/03 23:49:03 CLSRSC-180: An error occurred while executing the command 'srvctl stop cvu -f' (error code 0)
PRCR-1070 : Failed to check if resource ora.cvu is registered
CRS-0184 : Cannot communicate with the CRS daemon.
2016/09/03 23:49:03 CLSRSC-180: An error occurred while executing the command 'srvctl remove cvu -f' (error code 0)
OC4J failed to stop
PRCR-1070 : Failed to check if resource ora.oc4j is registered
CRS-0184 : Cannot communicate with the CRS daemon.
OC4J could not be removed
PRCR-1070 : Failed to check if resource ora.oc4j is registered
CRS-0184 : Cannot communicate with the CRS daemon.
PRCR-1068 : Failed to query resources
CRS-0184 : Cannot communicate with the CRS daemon.
PRCR-1068 : Failed to query resources
CRS-0184 : Cannot communicate with the CRS daemon.
PRCR-1068 : Failed to query resources
CRS-0184 : Cannot communicate with the CRS daemon.
PRCR-1068 : Failed to query resources
CRS-0184 : Cannot communicate with the CRS daemon.
PRCR-1070 : Failed to check if resource ora.net1.network is registered
CRS-0184 : Cannot communicate with the CRS daemon.
PRCR-1070 : Failed to check if resource ora.helper is registered
CRS-0184 : Cannot communicate with the CRS daemon.
PRCR-1070 : Failed to check if resource ora.ons is registered
CRS-0184 : Cannot communicate with the CRS daemon.
CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'csm-clstrnode1'
CRS-2673: Attempting to stop 'ora.mdnsd' on 'csm-clstrnode1'
CRS-2673: Attempting to stop 'ora.gpnpd' on 'csm-clstrnode1'
CRS-2673: Attempting to stop 'ora.ctssd' on 'csm-clstrnode1'
CRS-2673: Attempting to stop 'ora.evmd' on 'csm-clstrnode1'
CRS-2677: Stop of 'ora.mdnsd' on 'csm-clstrnode1' succeeded
CRS-2677: Stop of 'ora.ctssd' on 'csm-clstrnode1' succeeded
CRS-2677: Stop of 'ora.gpnpd' on 'csm-clstrnode1' succeeded
CRS-2677: Stop of 'ora.evmd' on 'csm-clstrnode1' succeeded
CRS-2673: Attempting to stop 'ora.cssd' on 'csm-clstrnode1'
CRS-2677: Stop of 'ora.cssd' on 'csm-clstrnode1' succeeded
CRS-2673: Attempting to stop 'ora.gipcd' on 'csm-clstrnode1'
CRS-2677: Stop of 'ora.gipcd' on 'csm-clstrnode1' succeeded
CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'csm-clstrnode1' has completed
CRS-4133: Oracle High Availability Services has been stopped.
CRS-4123: Oracle High Availability Services has been started.
CRS-2672: Attempting to start 'ora.evmd' on 'csm-clstrnode1'
CRS-2672: Attempting to start 'ora.mdnsd' on 'csm-clstrnode1'
CRS-2676: Start of 'ora.mdnsd' on 'csm-clstrnode1' succeeded
CRS-2676: Start of 'ora.evmd' on 'csm-clstrnode1' succeeded
CRS-2672: Attempting to start 'ora.gpnpd' on 'csm-clstrnode1'
CRS-2676: Start of 'ora.gpnpd' on 'csm-clstrnode1' succeeded
CRS-2672: Attempting to start 'ora.cssdmonitor' on 'csm-clstrnode1'
CRS-2672: Attempting to start 'ora.gipcd' on 'csm-clstrnode1'
CRS-2676: Start of 'ora.cssdmonitor' on 'csm-clstrnode1' succeeded
CRS-2676: Start of 'ora.gipcd' on 'csm-clstrnode1' succeeded
CRS-2672: Attempting to start 'ora.cssd' on 'csm-clstrnode1'
CRS-2672: Attempting to start 'ora.diskmon' on 'csm-clstrnode1'
CRS-2676: Start of 'ora.diskmon' on 'csm-clstrnode1' succeeded
CRS-2676: Start of 'ora.cssd' on 'csm-clstrnode1' succeeded
2016/09/03 23:51:51 CLSRSC-115: Start of resource 'ora.asm' failed
2016/09/03 23:51:51 CLSRSC-558: failed to deconfigure ASM
Died at /u01/app/12.1.0.2/grid/crs/install/crsdeconfig.pm line 1039.
Died at /u01/app/12.1.0.2/grid/crs/install/crsdeconfig.pm line 1039.
Cluster Alert Logs
2016-09-04 08:55:16.522 [OCSSD(5410)]CRS-1625: Node csm-clstrnode2, number 2, was shut down
2016-09-04 08:55:50.112 [ORAROOTAGENT(5668)]CRS-5818: Aborted command 'start' for resource 'ora.cluster_interconnect.haip'. Details at (:CRSAGF00113:) {0:9:3} in /u01/app/oracle/diag/crs/csm-clstrnode1/crs/trace/ohasd_orarootagent_root.trc.
2016-09-04 08:55:50.220 [ORAROOTAGENT(5668)]CRS-5017: The resource action "ora.cluster_interconnect.haip start" encountered the following error:
2016-09-04 08:55:50.220+Start action for HAIP aborted. For details refer to "(:CLSN00107:)" in "/u01/app/oracle/diag/crs/csm-clstrnode1/crs/trace/ohasd_orarootagent_root.trc".
2016-09-04 08:55:54.114 [OHASD(4912)]CRS-2757: Command 'Start' timed out waiting for response from the resource 'ora.cluster_interconnect.haip'. Details at (:CRSPE00163:) {0:9:3} in /u01/app/oracle/diag/crs/csm-clstrnode1/crs/trace/ohasd.trc.
if anybody have faced same error. appreciated for any suggestion or guidelines to resolve the issue.
Regards
Hitgon