Environment Details:
2 Node Rac.
DB version -12.2.0.1(OCT 2019 RU)
OS- Oracle Linux 7.4
I am trying to apply APRIL 2020 RU on my grid infrastructure. By mistake I unzipped patch with oracle user instead of grid. Because of which patching failed.
Below is error log for patching.
[root@XXXX ~]# /u01/app/12.2.0/grid/OPatch/opatchauto apply /u01/patch/30783652/30920127
OPatchauto session is initiated at Sat Jun 27 09:50:38 2020
System initialization log file is /u01/app/12.2.0/grid/cfgtoollogs/opatchautodb/systemconfig2020-06-27_09-50-41AM.log.
Session log file is /u01/app/12.2.0/grid/cfgtoollogs/opatchauto/opatchauto2020-06-27_09-53-51AM.log
The id for this session is EZX3
Executing OPatch prereq operations to verify patch applicability on home /u01/app/12.2.0/grid
Executing OPatch prereq operations to verify patch applicability on home /u01/app/oracle/product/12.2.0/dbhome_1
Patch applicability verified successfully on home /u01/app/oracle/product/12.2.0/dbhome_1
Patch applicability verified successfully on home /u01/app/12.2.0/grid
Verifying SQL patch applicability on home /u01/app/oracle/product/12.2.0/dbhome_1
SQL patch applicability verified successfully on home /u01/app/oracle/product/12.2.0/dbhome_1
Preparing to bring down database service on home /u01/app/oracle/product/12.2.0/dbhome_1
Successfully prepared home /u01/app/oracle/product/12.2.0/dbhome_1 to bring down database service
Bringing down CRS service on home /u01/app/12.2.0/grid
Prepatch operation log file location: /u01/app/grid/crsdata/XXXX/crsconfig/crspatch_XXXX_2020-06-27_09-55-03AM.log
CRS service brought down successfully on home /u01/app/12.2.0/grid
Performing prepatch operation on home /u01/app/oracle/product/12.2.0/dbhome_1
Perpatch operation completed successfully on home /u01/app/oracle/product/12.2.0/dbhome_1
Start applying binary patch on home /u01/app/oracle/product/12.2.0/dbhome_1
Binary patch applied successfully on home /u01/app/oracle/product/12.2.0/dbhome_1
Performing postpatch operation on home /u01/app/oracle/product/12.2.0/dbhome_1
Postpatch operation completed successfully on home /u01/app/oracle/product/12.2.0/dbhome_1
Start applying binary patch on home /u01/app/12.2.0/grid
Failed while applying binary patches on home /u01/app/12.2.0/grid
Execution of [OPatchAutoBinaryAction] patch action failed, check log for more details. Failures:
Patch Target : XXXX->/u01/app/12.2.0/grid Type[crs]
Details: [
---------------------------Patching Failed---------------------------------
Command execution failed during patching in home: /u01/app/12.2.0/grid, host: XXXX.
Command failed: /u01/app/12.2.0/grid/OPatch/opatchauto apply /u01/patch/30783652/30920127 -oh /u01/app/12.2.0/grid -target_type cluster -binary -invPtrLoc /u01/app/12.2.0/grid/oraInst.loc -jre /u01/app/12.2.0/grid/OPatch/jre -persistresult /u01/app/12.2.0/grid/opatchautocfg/db/sessioninfo/sessionresult_XXXX_crs_1.ser -analyzedresult /u01/app/12.2.0/grid/opatchautocfg/db/sessioninfo/sessionresult_analyze_XXXX_crs_1.ser
Command failure output:
==Following patches FAILED in apply:
Patch: /u01/patch/30783652/30920127/30882603
Log: /u01/app/12.2.0/grid/cfgtoollogs/opatchauto/core/opatch/opatch2020-06-27_10-04-29AM_1.log
Reason: Failed during Analysis: CheckPatchApplicable Failed, [ Prerequisite Status: FAILED, Prerequisite output:
The details are:
Patch 30882603:
Copy Action: Source File "/u01/patch/30783652/30920127/30882603/files/bin/ocrcheck.bin" does not exists or is not readable
'oracle.has.crs, 12.2.0.1.0': Cannot copy file from 'ocrcheck.bin' to '/u01/app/12.2.0/grid/bin/ocrcheck.bin'
Copy Action: Source File "/u01/patch/30783652/30920127/30882603/files/bin/ocrconfig.bin" does not exists or is not readable
'or ...
After fixing the cause of failure Run opatchauto resume
]
OPATCHAUTO-68061: The orchestration engine failed.
OPATCHAUTO-68061: The orchestration engine failed with return code 1
OPATCHAUTO-68061: Check the log for more details.
OPatchAuto failed.
OPatchauto session completed at Sat Jun 27 10:09:43 2020
Time taken to complete the session 19 minutes, 5 seconds
opatchauto failed with error code 42
While patch is appiled on oracle_home but on grid it only applied on ACFS.
[oracle@xxxxx$ opatch lspatches
30886680;Database Apr 2020 Release Update : 12.2.0.1.200414 (30886680)
30882603;OCW APR 2020 RELEASE UPDATE 12.2.0.1.200414 (30882603)
30133625;OJVM RELEASE UPDATE: 12.2.0.1.191015 (30133625)
OPatch succeeded.
[grid@xxxxx$ opatch lspatches
30869447;ACFS APR 2020 RELEASE UPDATE 12.2.0.1.200414 (30869447)
30138470;Database Oct 2019 Release Update : 12.2.0.1.191015 (30138470)
30122814;OCW OCT 2019 RELEASE UPDATE 12.2.0.1.191015 (30122814)
30093408;TOMCAT RELEASE UPDATE 12.2.0.1.0(ID:190208.0920) (30093408)
26839277;DBWLM RELEASE UPDATE 12.2.0.1.0(ID:170913) (26839277)
OPatch succeeded.
On Grid home I got below error
Patch 30882603:
Copy Action: Source File "/u01/patch/30783652/30920127/30882603/files/bin/ocrcheck.bin" does not exists or is not readable
'oracle.has.crs, 12.2.0.1.0': Cannot copy file from 'ocrcheck.bin' to '/u01/app/12.2.0/grid/bin/ocrcheck.bin'
Copy Action: Source File "/u01/patch/30783652/30920127/30882603/files/bin/ocrconfig.bin" does not exists or is not readable.
Again I unzipped the patch with grid user and ran below command (to apply patch on only grid home ),but no success.
[root@XXXX ~]# /u01/app/12.2.0/grid/OPatch/opatchauto apply /u01/patch/grid_patch/30783652/30920127 -oh /u01/app/12.2.0/grid
OPatchauto session is initiated at Sat Jun 27 12:42:55 2020
System initialization log file is /u01/app/12.2.0/grid/cfgtoollogs/opatchautodb/systemconfig2020-06-27_12-43-00PM.log.
Session log file is /u01/app/12.2.0/grid/cfgtoollogs/opatchauto/opatchauto2020-06-27_12-43-05PM.log
The id for this session is HGRF
OPATCHAUTO-72132: Grid is not running on the local host.
OPATCHAUTO-72132: Cannot start a new apply or rollback session when the local grid is not running.
OPATCHAUTO-72132: Please start grid service on the local host to start patching.
OPatchAuto failed.
When I tried to start CRS then I am getting below error on the node where I have started patching. Whereas on other node all services are up and running fine.
[root@XXXX ~]# /u01/app/12.2.0/grid/bin/crsctl check crs
CRS-4639: Could not contact Oracle High Availability Services
[root@XXXX ~]# /u01/app/12.2.0/grid/bin/crsctl start crs
CRS-6706: Oracle Clusterware Release patch level ('880704019') does not match Software patch level ('1678342655'). Oracle Clusterware cannot be started.
CRS-4000: Command Start failed, or completed with errors.