Scenario Overview :
We have 2 nde RAC 12.1.0.2.0 RAC setup on suse 12 SP5, While applying patch on UAT server, We successfully applied patch on node 1 , In process of applying patch on grid. Server got rebooted on 2nd node. We face error while apply patch again. so we try to run ./rootcrs.sh -patch. It started with some error. So we rollback grid patch on node 2 and apply it again.
Error:
/u01/app/12.1.0/grid/OPatch/auto/dbtmp/bootstrap_srv2/patchwork/crs/install/crsconfig_params
CRS-6706: Oracle Clusterware Release patch level ('1638706395') does not match Software patch level ('0'). Oracle Clusterware cannot be started.
CRS-4000: Command Start failed, or completed with errors.
2020/05/28 16:34:07 CLSRSC-117: Failed to start Oracle Clusterware stack
Scenario Output :
srv2:/u01/app/12.1.0/grid/OPatch # export ORACLE_HOME=/u01/app/12.1.0/grid/
srv2:/u01/app/12.1.0/grid/OPatch # export PATH=$ORACLE_HOME/OPatch:$PATH:$ORACLE_HOME/bin
srv2:/u01/app/12.1.0/grid/OPatch # export PATH=$ORACLE_HOME/perl/bin:$PATH
srv2:/u01/app/12.1.0/grid/OPatch # opatchauto apply /u01/24412235 -oh /u01/app/12.1.0/grid
OPatchauto session is initiated at Thu May 28 16:31:29 2020
System initialization log file is /u01/app/12.1.0/grid/cfgtoollogs/opatchautodb/systemconfig2020-05-28_04-31-34PM.log.
Session log file is /u01/app/12.1.0/grid/cfgtoollogs/opatchauto/opatchauto2020-05-28_04-33-04PM.log
The id for this session is DK3F
Executing OPatch prereq operations to verify patch applicability on home /u01/app/12.1.0/grid
Patch applicability verified successfully on home /u01/app/12.1.0/grid
Checking shared status of home.....
Bringing down CRS service on home /u01/app/12.1.0/grid
Prepatch operation log file location: /u01/app/12.1.0/grid/cfgtoollogs/crsconfig/crspatch_srv2_2020-05-28_04-34-05PM.log
Failed to bring down CRS service on home /u01/app/12.1.0/grid
Execution of [GIShutDownAction] patch action failed, check log for more details. Failures:
Patch Target : srv2->/u01/app/12.1.0/grid Type[crs]
Details: [
---------------------------Patching Failed---------------------------------
Command execution failed during patching in home: /u01/app/12.1.0/grid, host: srv2.
Command failed: /u01/app/12.1.0/grid/perl/bin/perl -I/u01/app/12.1.0/grid/perl/lib -I/u01/app/12.1.0/grid/OPatch/auto/dbtmp/bootstrap_srv2/patchwork/crs/install /u01/app/12.1.0/grid/OPatch/auto/dbtmp/bootstrap_srv2/patchwork/crs/install/rootcrs.pl -prepatch
Command failure output:
Using configuration parameter file: /u01/app/12.1.0/grid/OPatch/auto/dbtmp/bootstrap_srv2/patchwork/crs/install/crsconfig_params
CRS-6706: Oracle Clusterware Release patch level ('1638706395') does not match Software patch level ('0'). Oracle Clusterware cannot be started.
CRS-4000: Command Start failed, or completed with errors.
2020/05/28 16:34:07 CLSRSC-117: Failed to start Oracle Clusterware stack
After fixing the cause of failure Run opatchauto resume
]
OPATCHAUTO-68061: The orchestration engine failed.
OPATCHAUTO-68061: The orchestration engine failed with return code 1
OPATCHAUTO-68061: Check the log for more details.
OPatchAuto failed.
OPatchauto session completed at Thu May 28 16:34:08 2020
Time taken to complete the session 2 minutes, 39 seconds
opatchauto failed with error code 42
srv2:/u01/app/12.1.0/grid/OPatch # cd ..
- Go to directory /u01/app/12.1.0/grid/crs/install and run ./rootcrs.sh -patch
- (NOTE :Always check with metalink ), In my case it is working fine.
srv2:/u01/app/12.1.0/grid/crs/install # ./rootcrs.sh -patch
Using configuration parameter file: /u01/app/12.1.0/grid/crs/install/crsconfig_params
2020/05/28 17:01:42 CLSRSC-4015: Performing install or upgrade action for Oracle Trace File Analyzer (TFA) Collector.
2020/05/28 17:01:43 CLSRSC-4003: Successfully patched Oracle Trace File Analyzer (TFA) Collector.
CRS-4123: Oracle High Availability Services has been started.
CRS-4133: Oracle High Availability Services has been stopped.
CRS-4123: Starting Oracle High Availability Services-managed resources
CRS-2672: Attempting to start 'ora.mdnsd' on 'srv2'
CRS-2672: Attempting to start 'ora.evmd' on 'srv2'
CRS-2676: Start of 'ora.mdnsd' on 'srv2' succeeded
CRS-2676: Start of 'ora.evmd' on 'srv2' succeeded
CRS-2672: Attempting to start 'ora.gpnpd' on 'srv2'
CRS-2676: Start of 'ora.gpnpd' on 'srv2' succeeded
CRS-2672: Attempting to start 'ora.gipcd' on 'srv2'
CRS-2676: Start of 'ora.gipcd' on 'srv2' succeeded
CRS-2672: Attempting to start 'ora.cssdmonitor' on 'srv2'
CRS-2676: Start of 'ora.cssdmonitor' on 'srv2' succeeded
CRS-2672: Attempting to start 'ora.cssd' on 'srv2'
CRS-2672: Attempting to start 'ora.diskmon' on 'srv2'
CRS-2676: Start of 'ora.diskmon' on 'srv2' succeeded
CRS-2676: Start of 'ora.cssd' on 'srv2' succeeded
CRS-2672: Attempting to start 'ora.cluster_interconnect.haip' on 'srv2'
CRS-2672: Attempting to start 'ora.ctssd' on 'srv2'
CRS-2676: Start of 'ora.ctssd' on 'srv2' succeeded
CRS-2676: Start of 'ora.cluster_interconnect.haip' on 'srv2' succeeded
CRS-2672: Attempting to start 'ora.asm' on 'srv2'
CRS-5017: The resource action "ora.asm start" encountered the following error:
ORA-15135: cluster is not in the rolling patch
. For details refer to "(:CLSN00107:)" in "/u01/app/grid/diag/crs/srv1/crs/trace/ohasd_oraagent_grid.trc".
CRS-2674: Start of 'ora.asm' on 'srv1' failed
CRS-2679: Attempting to clean 'ora.asm' on 'srv1'
CRS-2681: Clean of 'ora.asm' on 'srv1' succeeded
CRS-4705: Start of Clusterware failed on node srv1.
CRS-4000: Command Start failed, or completed with errors.
ORA-15135: cluster is not in the rolling patch
. For details refer to "(:CLSN00107:)" in "/u01/app/grid/diag/crs/srv1/crs/trace/ohasd_oraagent_grid.trc".
CRS-2674: Start of 'ora.asm' on 'srv1' failed
CRS-2679: Attempting to clean 'ora.asm' on 'srv1'
CRS-2681: Clean of 'ora.asm' on 'srv1' succeeded
CRS-4705: Start of Clusterware failed on node srv1.
CRS-4000: Command Start failed, or completed with errors.
NOTE : got the error but while checking status all service are online on both nodes and able to connect both instance, As per my understanding patch not applied coorectly on 2nd doe due to this ASM unable to recognise and find conflict.
- srv1:/dev/oracleasm/disks # crsctl status resource -t
--------------------------------------------------------------------------------
Name Target State Server State details
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.CRS.dg
ONLINE ONLINE srv1 STABLE
ONLINE ONLINE srv2 STABLE
ora.DATA.dg
ONLINE ONLINE srv1 STABLE
ONLINE ONLINE srv2 STABLE
ora.FRA.dg
ONLINE ONLINE srv1 STABLE
ONLINE ONLINE srv2 STABLE
ora.LISTENER.lsnr
ONLINE ONLINE srv1 STABLE
ONLINE ONLINE srv2 STABLE
ora.asm
ONLINE ONLINE srv1 Started,STABLE
ONLINE ONLINE srv2 Started,STABLE
ora.net1.network
ONLINE ONLINE srv1 STABLE
ONLINE ONLINE srv2 STABLE
ora.ons
ONLINE ONLINE srv1 STABLE
ONLINE ONLINE srv2 STABLE
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.LISTENER_SCAN1.lsnr
1 ONLINE ONLINE srv2 STABLE
ora.LISTENER_SCAN2.lsnr
1 ONLINE ONLINE srv1 STABLE
ora.LISTENER_SCAN3.lsnr
1 ONLINE ONLINE srv1 STABLE
ora.MGMTLSNR
1 ONLINE ONLINE srv1 169.254.52.81 192.16
8.10.1,STABLE
ora.cvu
1 ONLINE ONLINE srv1 STABLE
ora.mgmtdb
1 ONLINE ONLINE srv1 Open,STABLE
ora.oc4j
1 ONLINE ONLINE srv1 STABLE
ora.rac.db
1 ONLINE ONLINE srv1 Open,STABLE
2 ONLINE ONLINE srv2 Open,STABLE
ora.rac.pretaf.svc
1 ONLINE ONLINE srv1 STABLE
ora.rac.pretaf_preconnect.svc
1 ONLINE ONLINE srv2 STABLE
ora.scan1.vip
1 ONLINE ONLINE srv2 STABLE
ora.scan2.vip
1 ONLINE ONLINE srv1 STABLE
ora.scan3.vip
1 ONLINE ONLINE srv1 STABLE
ora.srv1.vip
1 ONLINE ONLINE srv1 STABLE
ora.srv2.vip
1 ONLINE ONLINE srv2 STABLE
--------------------------------------------------------------------------------
srv1:/dev/oracleasm/disks #
- We stop and start clustreware again using command crsctl stop cluster -all and start it with crsctl start cluster -all, got the error below:
. For details refer to "(:CLSN00107:)" in "/u01/app/grid/diag/crs/srv1/crs/trace/ohasd_oraagent_grid.trc"
srv1:/u01/app/grid/diag/crs/srv1/crs/trace # crsctl start cluster -all
CRS-2672: Attempting to start 'ora.cssdmonitor' on 'srv1'
CRS-2672: Attempting to start 'ora.evmd' on 'srv1'
CRS-2672: Attempting to start 'ora.cssdmonitor' on 'srv2'
CRS-2672: Attempting to start 'ora.evmd' on 'srv2'
CRS-2676: Start of 'ora.cssdmonitor' on 'srv2' succeeded
CRS-2672: Attempting to start 'ora.cssd' on 'srv2'
CRS-2676: Start of 'ora.cssdmonitor' on 'srv1' succeeded
CRS-2672: Attempting to start 'ora.cssd' on 'srv1'
CRS-2672: Attempting to start 'ora.diskmon' on 'srv1'
CRS-2676: Start of 'ora.diskmon' on 'srv1' succeeded
CRS-2676: Start of 'ora.evmd' on 'srv1' succeeded
CRS-2672: Attempting to start 'ora.diskmon' on 'srv2'
CRS-2676: Start of 'ora.diskmon' on 'srv2' succeeded
CRS-2676: Start of 'ora.evmd' on 'srv2' succeeded
CRS-2676: Start of 'ora.cssd' on 'srv1' succeeded
CRS-2672: Attempting to start 'ora.ctssd' on 'srv1'
CRS-2672: Attempting to start 'ora.cluster_interconnect.haip' on 'srv1'
CRS-2676: Start of 'ora.cssd' on 'srv2' succeeded
CRS-2672: Attempting to start 'ora.ctssd' on 'srv2'
CRS-2676: Start of 'ora.ctssd' on 'srv1' succeeded
CRS-2672: Attempting to start 'ora.cluster_interconnect.haip' on 'srv2'
CRS-2676: Start of 'ora.ctssd' on 'srv2' succeeded
CRS-2676: Start of 'ora.cluster_interconnect.haip' on 'srv1' succeeded
CRS-2672: Attempting to start 'ora.asm' on 'srv1'
CRS-2676: Start of 'ora.cluster_interconnect.haip' on 'srv2' succeeded
CRS-2672: Attempting to start 'ora.asm' on 'srv2'
CRS-2676: Start of 'ora.asm' on 'srv2' succeeded
CRS-2672: Attempting to start 'ora.storage' on 'srv2'
CRS-2676: Start of 'ora.storage' on 'srv2' succeeded
CRS-2672: Attempting to start 'ora.crsd' on 'srv2'
CRS-2676: Start of 'ora.crsd' on 'srv2' succeeded
CRS-5017: The resource action "ora.asm start" encountered the following error:
ORA-15135: cluster is not in the rolling patch
. For details refer to "(:CLSN00107:)" in "/u01/app/grid/diag/crs/srv1/crs/trace/ohasd_oraagent_grid.trc".
CRS-2674: Start of 'ora.asm' on 'srv1' failed
CRS-2679: Attempting to clean 'ora.asm' on 'srv1'
CRS-2681: Clean of 'ora.asm' on 'srv1' succeeded
CRS-4705: Start of Clusterware failed on node srv1.
CRS-4000: Command Start failed, or completed with errors.
srv1:/u01/app/grid/diag/crs/srv1/crs/trace #
- Rollback grid patch on node 2 and apply patch again
srv2:/u01/app/12.1.0/grid/OPatch # ./opatchauto rollback /u01/24412235
OPatchauto session is initiated at Fri May 29 16:08:57 2020
System initialization log file is /u01/app/12.1.0/grid/cfgtoollogs/opatchautodb/systemconfig2020-05-29_04-09-00PM.log.
Session log file is /u01/app/12.1.0/grid/cfgtoollogs/opatchauto/opatchauto2020-05-29_04-10-32PM.log
The id for this session is YHDM
Executing OPatch prereq operations to verify patch applicability on home /u01/app/12.1.0/grid
Executing OPatch prereq operations to verify patch applicability on home /u01/app/oracle/product/12.1.0/db_1
Patch applicability verified successfully on home /u01/app/oracle/product/12.1.0/db_1
Patch applicability verified successfully on home /u01/app/12.1.0/grid
Verifying SQL patch applicability on home /u01/app/oracle/product/12.1.0/db_1
"/bin/sh -c 'cd /u01/app/oracle/product/12.1.0/db_1; ORACLE_HOME=/u01/app/oracle/product/12.1.0/db_1 ORACLE_SID=RAC2 /u01/app/oracle/product/12.1.0/db_1/OPatch/datapatch -prereq -verbose'" command failed with errors. Please refer to logs for more details. SQL changes, if any, can be analyzed by manually retrying the same command.
SQL patch applicability verified successfully on home /u01/app/oracle/product/12.1.0/db_1
Preparing to bring down database service on home /u01/app/oracle/product/12.1.0/db_1
Successfully prepared home /u01/app/oracle/product/12.1.0/db_1 to bring down database service
Bringing down CRS service on home /u01/app/12.1.0/grid
Prepatch operation log file location: /u01/app/12.1.0/grid/cfgtoollogs/crsconfig/crspatch_srv2_2020-05-29_04-11-57PM.log
CRS service brought down successfully on home /u01/app/12.1.0/grid
Start rolling back binary patch on home /u01/app/12.1.0/grid
Binary patch rolled back successfully on home /u01/app/12.1.0/grid
Starting CRS service on home /u01/app/12.1.0/grid
Postpatch operation log file location: /u01/app/12.1.0/grid/cfgtoollogs/crsconfig/crspatch_srv2_2020-05-29_04-18-16PM.log
CRS service started successfully on home /u01/app/12.1.0/grid
Preparing home /u01/app/oracle/product/12.1.0/db_1 after database service restarted
No step execution required.........
OPatchAuto successful.
--------------------------------Summary--------------------------------
Patching is completed successfully. Please find the summary as follows:
Host:srv2
RAC Home:/u01/app/oracle/product/12.1.0/db_1
Version:12.1.0.2.0
Summary:
==Following patches were SKIPPED:
Patch: /u01/24412235/21436941
Reason: This patch is not applicable to this specified target type - "rac_database"
Patch: /u01/24412235/24007012
Reason: This patch is not applicable to this specified target type - "rac_database"
Patch: /u01/24412235/23854735
Reason: This Patch does not exist in the home, it cannot be rolled back.
Patch: /u01/24412235/24006101
Reason: This Patch does not exist in the home, it cannot be rolled back.
Host:srv2
CRS Home:/u01/app/12.1.0/grid
Version:12.1.0.2.0
Summary:
==Following patches were SKIPPED:
Patch: /u01/24412235/24007012
Reason: Patch /u01/24412235/24007012 is not applied as part of bundle patch 24412235
==Following patches were SUCCESSFULLY rolled back:
Patch: /u01/24412235/21436941
Log: /u01/app/12.1.0/grid/cfgtoollogs/opatchauto/core/opatch/opatch2020-05-29_16-14-16PM_1.log
Patch: /u01/24412235/23854735
Log: /u01/app/12.1.0/grid/cfgtoollogs/opatchauto/core/opatch/opatch2020-05-29_16-14-16PM_1.log
Patch: /u01/24412235/24006101
Log: /u01/app/12.1.0/grid/cfgtoollogs/opatchauto/core/opatch/opatch2020-05-29_16-14-16PM_1.log
OPatchauto session completed at Fri May 29 16:25:18 2020
Time taken to complete the session 16 minutes, 21 seconds
srv2:/u01/app/12.1.0/grid/OPatch #
srv2:/u01/app/12.1.0/grid/OPatch #
srv2:/u01/app/12.1.0/grid/OPatch #
srv2:/u01/app/12.1.0/grid/OPatch #
srv2:/u01/app/12.1.0/grid/OPatch #
- Check the status after rollback , both nodes are working fine.
srv1:~ # crsctl status resource -t
--------------------------------------------------------------------------------
Name Target State Server State details
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.CRS.dg
ONLINE ONLINE srv1 STABLE
ONLINE ONLINE srv2 STABLE
ora.DATA.dg
ONLINE ONLINE srv1 STABLE
ONLINE ONLINE srv2 STABLE
ora.FRA.dg
ONLINE ONLINE srv1 STABLE
ONLINE ONLINE srv2 STABLE
ora.LISTENER.lsnr
ONLINE ONLINE srv1 STABLE
ONLINE ONLINE srv2 STABLE
ora.asm
ONLINE ONLINE srv1 Started,STABLE
ONLINE ONLINE srv2 Started,STABLE
ora.net1.network
ONLINE ONLINE srv1 STABLE
ONLINE ONLINE srv2 STABLE
ora.ons
ONLINE ONLINE srv1 STABLE
ONLINE ONLINE srv2 STABLE
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.LISTENER_SCAN1.lsnr
1 ONLINE ONLINE srv2 STABLE
ora.LISTENER_SCAN2.lsnr
1 ONLINE ONLINE srv1 STABLE
ora.LISTENER_SCAN3.lsnr
1 ONLINE ONLINE srv1 STABLE
ora.MGMTLSNR
1 ONLINE ONLINE srv2 169.254.82.21 192.16
8.10.2,STABLE
ora.cvu
1 ONLINE ONLINE srv1 STABLE
ora.mgmtdb
1 ONLINE ONLINE srv2 Open,STABLE
ora.oc4j
1 ONLINE ONLINE srv1 STABLE
ora.rac.db
1 ONLINE ONLINE srv1 Open,STABLE
2 ONLINE ONLINE srv2 Open,STABLE
ora.rac.pretaf.svc
1 ONLINE ONLINE srv1 STABLE
ora.rac.pretaf_preconnect.svc
1 ONLINE ONLINE srv2 STABLE
ora.scan1.vip
1 ONLINE ONLINE srv2 STABLE
ora.scan2.vip
1 ONLINE ONLINE srv1 STABLE
ora.scan3.vip
1 ONLINE ONLINE srv1 STABLE
ora.srv1.vip
1 ONLINE ONLINE srv1 STABLE
ora.srv2.vip
1 ONLINE ONLINE srv2 STABLE
--------------------------------------------------------------------------------
srv1:~ #
- Patch details on node2 where we rollback
grid@srv2:/u01/app/12.1.0/grid/OPatch> ./opatch lsinventory
Oracle Interim Patch Installer version 12.2.0.1.17
Copyright (c) 2020, Oracle Corporation. All rights reserved.
Oracle Home : /u01/app/12.1.0/grid
Central Inventory : /u01/app/oraInventory
from : /u01/app/12.1.0/grid/oraInst.loc
OPatch version : 12.2.0.1.17
OUI version : 12.1.0.2.0
Log file location : /u01/app/12.1.0/grid/cfgtoollogs/opatch/opatch2020-05-29_16-30-46PM_1.log
Lsinventory Output file location : /u01/app/12.1.0/grid/cfgtoollogs/opatch/lsinv/lsinventory2020-05-29_16-30-46PM.txt
--------------------------------------------------------------------------------
Local Machine Information::
Hostname: srv2.example.com
ARU platform id: 226
ARU platform description:: Linux x86-64
Installed Top-level Products (1):
Oracle Grid Infrastructure 12c 12.1.0.2.0
There are 1 products installed in this Oracle Home.
There are no Interim patches installed in this Oracle Home.
--------------------------------------------------------------------------------
OPatch succeeded.
grid@srv2:/u01/app/12.1.0/grid/OPatch>
- Patch details on Node1 which was successsfully applied
grid@srv1:/u01/app/12.1.0/grid/OPatch> ./opatch lsinventory
Oracle Interim Patch Installer version 12.2.0.1.17
Copyright (c) 2020, Oracle Corporation. All rights reserved.
Oracle Home : /u01/app/12.1.0/grid
Central Inventory : /u01/app/oraInventory
from : /u01/app/12.1.0/grid/oraInst.loc
OPatch version : 12.2.0.1.17
OUI version : 12.1.0.2.0
Log file location : /u01/app/12.1.0/grid/cfgtoollogs/opatch/opatch2020-05-30_12-08-02PM_1.log
Lsinventory Output file location : /u01/app/12.1.0/grid/cfgtoollogs/opatch/lsinv/lsinventory2020-05-30_12-08-02PM.txt
--------------------------------------------------------------------------------
Local Machine Information::
Hostname: srv1.example.com
ARU platform id: 226
ARU platform description:: Linux x86-64
Installed Top-level Products (1):
Oracle Grid Infrastructure 12c 12.1.0.2.0
There are 1 products installed in this Oracle Home.
Interim patches (4) :
Patch 24007012 : applied on Wed May 27 22:42:55 IST 2020
Unique Patch ID: 20511653
Patch description: "ACFS Patch Set Update : 12.1.0.2.161018 (24007012)"
Created on 30 Aug 2016, 00:17:17 hrs PST8PDT
Bugs fixed:
19060056, 21369858, 19355146, 19690653, 19526234, 20952520, 19475588
21231953, 18510745, 19149476, 19013966, 22222222, 19859183, 21519796
19469788, 21555038, 18877486, 20438706, 19610022, 19335268, 21058846
22472364, 22319558, 19183802, 19452723, 21124596, 19051391, 20010980
19526283, 22198405, 22689989, 19279106, 19078259, 19644505, 21077218
21233961, 19184398, 18321597, 19811784, 18185024, 22174238, 20098064
19353057, 19502657, 22661787, 19434261, 18951113, 20140148, 18900953
19053182, 22975177, 18955907, 18934139, 19134464, 19450090, 19517835
22241945, 20923224, 19446719, 20402287, 19201087, 21208140, 19649858
21076821, 19428756, 19001684, 19610001, 18899600, 20314907, 19509898
19528981, 18957085, 19127216, 23557970, 19901825, 22810422, 18915417
19270227, 22087780, 22198176, 19919907, 19593769, 23112252, 19557156
19195735, 23252830, 22846612, 20681968, 18851012, 19844362
Patch 24006101 : applied on Wed May 27 22:35:47 IST 2020
Unique Patch ID: 20683584
Patch description: "Database Patch Set Update : 12.1.0.2.161018 (24006101)"
Created on 1 Oct 2016, 12:33:50 hrs PST8PDT
Sub-patch 23054246; "Database Patch Set Update : 12.1.0.2.160719 (23054246)"
Sub-patch 22291127; "Database Patch Set Update : 12.1.0.2.160419 (22291127)"
Sub-patch 21948354; "Database Patch Set Update : 12.1.0.2.160119 (21948354)"
Sub-patch 21359755; "Database Patch Set Update : 12.1.0.2.5 (21359755)"
Sub-patch 20831110; "Database Patch Set Update : 12.1.0.2.4 (20831110)"
Sub-patch 20299023; "Database Patch Set Update : 12.1.0.2.3 (20299023)"
Sub-patch 19769480; "Database Patch Set Update : 12.1.0.2.2 (19769480)"
Bugs fixed:
19309466, 19902195, 18250893, 17655240, 19028800, 21266085, 19035573
19366375, 18456643, 19289642, 18845653, 19915271, 21291274, 18417036
20475845, 22528741, 22148226, 19243521, 19658708, 21153266, 19326908
19597583, 17414008, 20897759, 19174430, 22046677, 22243719, 21960504
19054077, 20688221, 22657942, 21899588, 20428621, 13542050, 21387964
19723336, 19835133, 17532734, 19333670, 21373473, 23260854, 19687159
14643995, 20977794, 19012119, 20734332, 19869255, 17551063, 18681056
19676012, 20588502, 19520602, 19841800, 19439759, 20245930, 19303936
19001359, 19393542, 22916353, 21099555, 22353346, 19141838, 19644859
21915719, 21421886, 19908836, 19358317, 19134173, 19524158, 20447445
21188584, 19335438, 19390567, 19058490, 18799993, 19769480, 21097043
21225209, 19284031, 19450314, 19016730, 18967382, 20919320, 22075064
20347562, 20348653, 22551446, 19896336, 20048359, 19524384, 16439813
18354830, 20596234, 20440930, 20936905, 19171086, 17867700, 19791273
18990023, 21241829, 19591608, 22296366, 20173897, 18914624, 19571367
17210525, 21260431, 19501299, 20425790, 19124589, 19402853, 19888853
16870214, 17722075, 18202441, 18743542, 19001390, 19081128, 22173980
21875360, 19178851, 19149990, 20951038, 22168163, 19606174, 20848335
19791377, 19050649, 19382851, 20920911, 20528052, 22762046, 19189525
20598042, 18988834, 19176326, 19048007, 19238590, 20387265, 21263635
20356733, 22160989, 22380919, 18499088, 18436647, 20825533, 18952989
20794034, 19468347, 20284155, 19883092, 20657441, 17365043, 20952966
19176223, 21300341, 18288842, 19699191, 22353199, 22083366, 20669434
18964978, 19577410, 21373076, 14283239, 19931709, 21239530, 20880215
20798891, 20043616, 18122373, 19013183, 18856999, 23124895, 21450666
18893947, 19587324, 20464614, 22062026, 19189317, 21917884, 19708632
20711718, 20134339, 22815955, 18973548, 22507210, 20101006, 19197175
18797519, 19597439, 21387128, 19180770, 19879746, 19354335, 19730508
21785691, 22366558, 6599380, 18964939, 22507234, 20124446, 20627866
16923858, 19518079, 19371175, 20466322, 18940497, 19074147, 22923409
17274537, 20842388, 19154375, 20474192, 19044962, 19532017, 19662635
22374754, 20560611, 18899974, 20471920, 18705806, 19052488, 22024071
20074391, 21184223, 19157754, 21220620, 18921743, 24316947, 19865345
19065677, 19065556, 19018447, 19018206, 19777862, 19304354, 22223463
21322887, 20879889, 20890311, 19578350, 20869721, 21756699, 20217801
18819908, 19363645, 20898391, 19291380, 20373598, 19248799, 19155797
19279273, 18886413, 18618122, 19990037, 20922010, 20509482, 18966843
19077215, 21526048, 20704450, 19068970, 21620471, 19023822, 19670108
19068610, 20267166, 21756677, 20476175, 18549238, 18674047, 20328248
19385656, 18849537, 19684504, 20899461, 19308965, 19143550, 19024808
18948177, 19468991, 20009833, 20868862, 20466628, 21756661, 20397490
19706965, 22178855, 19604659, 16359751, 19032777, 19329654, 19928926
20212067, 20603378, 20859910, 19307662, 21847223, 21668627, 20281121
19075256, 20877664, 19487147, 19076343, 19430401, 24577566, 19676905
20844426, 20904530, 20925795, 20441797, 21296029, 21629064, 21442094
23229229, 20708701, 22865673, 19280225, 21315084, 18740837, 20294666
19989009, 18191823, 21517440, 19174942, 17319928, 19703301, 20122715
18411216, 20117253, 19258504, 21188532, 24386767, 17890099, 21649497
16887946, 18791688, 19721304, 22092979, 19490948, 19619732, 20165574
19272708, 19547370, 20139391, 20228093, 21281532, 19978542, 19409212
19805359, 19461270, 19434529, 18799063, 18990693, 20378086, 21246723
20831538, 21632821, 20424899, 20361671, 18674024, 19689979, 20235511
19873610, 16619249, 21091431, 19440586, 22757364, 18610915, 22175564
19561643, 19399918, 19195895, 20832516, 20017509, 20907061, 21665897
20746251, 19183343, 21787056, 21273804, 19067244, 18043064, 21329301
18885870, 19536415, 17835294, 20446883, 21744290, 20413820, 19185876
22465352, 20558005, 20402832, 19627012, 20093776, 18909599, 20618595
16863642, 19639483, 19315691, 20331945, 19512341, 19637186, 19174521
21479753, 19022470, 18607546, 18306996, 18851894, 19649152, 20581111
19201867, 20318889, 20898997, 19534363, 19188927
Patch 23854735 : applied on Wed May 27 22:32:57 IST 2020
Unique Patch ID: 20511532
Patch description: "OCW Patch Set Update : 12.1.0.2.161018 (23854735)"
Created on 29 Sep 2016, 23:50:00 hrs PST8PDT
Bugs fixed:
21339083, 18589889, 20768643, 19061429, 19133945, 19341538, 19521169
20011424, 19361757, 19187207, 19302350, 19130141, 19530755, 19699720
19620918, 19168690, 18899171, 19244316, 19653795, 18634372, 19471722
19536337, 19184188, 19131709, 20160490, 20995001, 21131037, 19380733
20985167, 18943696, 20552947, 19591984, 18135723, 18461246, 20014326
19524857, 18890943, 19154753, 19499021, 19046190, 20923930, 20028666
19051385, 19050688, 19682695, 19831611, 21607972, 18922918, 21087799
18956780, 19683886, 23757020, 19026993, 20110156, 21269977, 18261648
18362971, 19558324, 22651583, 20185476, 18882642, 19478119, 19414274
17447588, 19262534, 20752167, 19147513, 22475834, 21242118, 19514085
20758997, 19659885, 19319904, 18703978, 23079844, 19700256, 19703246
20467806, 19192901, 21527118, 19479503, 19147751, 18901356, 21232394
18964974, 22162062, 18835366, 19013789, 19207286, 18950232, 22583325
19148791, 19556820, 16505171, 22261732, 22135419, 19449737, 21878613
21646169, 19187515, 19230771, 20795241, 19453778, 19853036, 18843572
18520351, 21430567, 19185148, 19232454, 21220597, 18541110, 18834955
19204743, 20175174, 19140891, 18747335, 20676340, 19270660, 19325701
20877003, 19222693, 19662663, 19684131, 19010177, 19272663, 18910576
18907170, 19426384, 9372680, 20737462, 19700294, 20289828, 19331454
22568500, 20278216, 20827053, 20119857, 19703199, 22456393, 20588164
18955644, 20991879, 18508710, 19908346, 19589221, 18952857, 19537762
21152052, 16286734, 20669114, 18762843, 18945249, 19184799, 19205086
19351363, 20091753, 19031737, 19079087, 19148367, 18968981, 19150517
20231741, 19217019, 18730096, 18975620, 19067804, 21259359, 19054979
19209951, 19318983, 18747382, 19154673, 18752378, 22905714, 19150088
19013444, 19234177, 18999857, 19075747, 19367276, 19612597, 19874047
19677813, 23049292, 19427050, 18910443, 20033787, 19148982, 19777496
20730170, 18523468, 19277814, 20562133, 19071526, 21420753, 18850051
20433932, 20061168, 19370739, 20822591, 19609388, 18776786, 20136892
18989446, 19148793, 19585454, 18317489, 19955755, 19059053, 19807548
19124972, 22229116, 18910748, 19147509, 18849896, 19617592, 19398098
22840085, 19076165, 19498411, 19704993, 21294273, 19459023, 20634511
21229744, 21474380, 21484367, 20276459, 17208793, 19234907, 19538714
22867050, 19383028, 19513969, 22195657, 23111368, 19986391, 19314048
18834934, 19473851, 19458082, 18894342, 19522067, 18116578, 19241857
19076778, 19066699, 19068003, 18937186, 20267877, 19916737, 19770543
22863466, 19635215, 19613533, 21057239, 20783416, 19315522, 19141785
19163887, 19885321, 18715868, 18852058, 19701617, 19280860, 19139608
21453435, 18946768, 19135521, 18604143, 19627476, 20568884, 20317221
20177779, 19266658, 24522717, 18330979, 19027351, 21227730, 18707416
21118157, 21113068, 19925992, 20235486, 20006646, 15922206, 18439295
18991776, 21245437, 23170839, 19163425, 19550195, 18849021, 18861196
17940721, 18524834, 19287706, 19522313, 18835283, 18748932, 19184765
21639478, 14851828, 20598625, 19226141, 19053891, 18871287, 18998228
18980002, 19682778, 19325604, 18777835, 17338864, 18945906, 19513650
19702758, 18952577, 19473088, 19178517, 18729269, 19529729, 19455563
20877072, 23275930, 20340620, 18536826, 19292605, 22264951, 20920711
20660273, 20011635, 17592037, 18935857, 22989069, 19029647, 19179158
22302421, 23076471, 19140712, 20012766, 23049301, 19184276, 20510208
20001507, 20079414, 19680763, 19259765, 18962892, 19513888, 14661880
21519340, 21222147, 20218012, 19551830, 21616278, 19068333, 18945435
20775015, 19319192, 20839581, 19178629, 21694237, 19304104, 19284357
22594310, 20725084, 19457575, 21297657, 19069755, 19021575, 18715884
19584688, 18798573, 19812592, 19018001, 19292272, 19270956, 21967791
21794779, 23055224, 18700893, 21276514, 20467377, 18406774, 20607821
21976167, 21082737, 21694632, 20115586, 20883009, 19164099, 18283792
19155350, 19884033, 19146822, 18798432, 21123424, 19471836, 20936562
18750781, 19045143, 22483804, 19146980, 19601003, 20099624, 21378016
19537547, 19281106, 18862203, 19954372, 18235274, 19205617, 19513351
20219458, 19150313, 18843054, 18708349, 19332386, 18953639, 21423055
19371270, 19203996, 20038431, 19370846, 21053036, 18998379, 20157569
21357522, 19273577, 24709351, 22113170, 19632437, 18990354, 19288396
20620581, 19557558, 19127078, 21792881, 20900588, 20053557, 22088198
22664609, 19315567, 19444471, 19154933, 20953798, 18290252, 18813323
19915945, 19500293, 18643483, 19134098, 23034352, 18965694, 19226858
19591356, 19602208, 22884308, 20069197, 18417590, 18920408, 18636884
22289350, 19043795, 20746507, 18260170, 18919682, 18678829, 19319357
19273758, 18953878, 18999195, 18759724, 19066844, 13843841, 20290467
22934855, 19649640, 19062675, 21924910, 18859710, 20862812, 19504641
23101611, 19341481, 20293730, 19343245, 18304090, 19241655, 19470791
18242738, 20649573, 18372060, 18953889, 18827679, 19140711, 19023430
19259290, 19045388, 20186278, 19522571, 19709663, 18875012, 18861564
19273760, 19225265, 15885689, 20853464, 21696068, 18819158, 21394146
19049721, 19368917, 21255373, 22393909, 20408163, 20579351, 18868829
20350915, 21327402, 22024217, 23101338, 19820247, 20363708, 19538241
19804032
Patch 21436941 : applied on Wed May 27 22:28:49 IST 2020
Unique Patch ID: 19245012
Patch description: "WLM Patch Set Update: 12.1.0.2.5 (21436941)"
Created on 13 Aug 2015, 04:00:40 hrs PST8PDT
Bugs fixed:
20075154, 20641027, 20548410, 19016964, 19582630
--------------------------------------------------------------------------------
OPatch succeeded.
- Again apply grid patch on node 2
srv2:/u01 # cd /u01/app/12.1.0/grid/OPatch
srv2:/u01/app/12.1.0/grid/OPatch # export ORACLE_HOME=/u01/app/12.1.0/grid/
srv2:/u01/app/12.1.0/grid/OPatch # export PATH=$ORACLE_HOME/OPatch:$PATH:$ORACLE_HOME/bin
srv2:/u01/app/12.1.0/grid/OPatch # export PATH=$ORACLE_HOME/perl/bin:$PATH
srv2:/u01/app/12.1.0/grid/OPatch # opatchauto apply /u02/24412235 -oh /u01/app/12.1.0/grid
OPatchauto session is initiated at Fri May 29 18:57:10 2020
System initialization log file is /u01/app/12.1.0/grid/cfgtoollogs/opatchautodb/systemconfig2020-05-29_06-57-24PM.log.
Session log file is /u01/app/12.1.0/grid/cfgtoollogs/opatchauto/opatchauto2020-05-29_06-58-20PM.log
The id for this session is NA51
Executing OPatch prereq operations to verify patch applicability on home /u01/app/12.1.0/grid
Patch applicability verified successfully on home /u01/app/12.1.0/grid
Bringing down CRS service on home /u01/app/12.1.0/grid
Prepatch operation log file location: /u01/app/12.1.0/grid/cfgtoollogs/crsconfig/crspatch_srv2_2020-05-29_06-59-02PM.log
CRS service brought down successfully on home /u01/app/12.1.0/grid
Start applying binary patch on home /u01/app/12.1.0/grid
Binary patch applied successfully on home /u01/app/12.1.0/grid
Starting CRS service on home /u01/app/12.1.0/grid
Postpatch operation log file location: /u01/app/12.1.0/grid/cfgtoollogs/crsconfig/crspatch_srv2_2020-05-29_07-12-57PM.log
CRS service started successfully on home /u01/app/12.1.0/grid
OPatchAuto successful.
--------------------------------Summary--------------------------------
Patching is completed successfully. Please find the summary as follows:
Host:srv2
CRS Home:/u01/app/12.1.0/grid
Version:12.1.0.2.0
Summary:
==Following patches were SUCCESSFULLY applied:
Patch: /u02/24412235/21436941
Log: /u01/app/12.1.0/grid/cfgtoollogs/opatchauto/core/opatch/opatch2020-05-29_19-01-32PM_1.log
Patch: /u02/24412235/23854735
Log: /u01/app/12.1.0/grid/cfgtoollogs/opatchauto/core/opatch/opatch2020-05-29_19-01-32PM_1.log
Patch: /u02/24412235/24006101
Log: /u01/app/12.1.0/grid/cfgtoollogs/opatchauto/core/opatch/opatch2020-05-29_19-01-32PM_1.log
Patch: /u02/24412235/24007012
Log: /u01/app/12.1.0/grid/cfgtoollogs/opatchauto/core/opatch/opatch2020-05-29_19-01-32PM_1.log
OPatchauto session completed at Fri May 29 19:17:57 2020
Time taken to complete the session 20 minutes, 49 seconds
srv2:/u01/app/12.1.0/grid/OPatch #
- Check the opatch details on node 2
srv2:/u01/app/12.1.0/grid/OPatch # su grid
grid@srv2:/u01/app/12.1.0/grid/OPatch> ./opatch lsinventory
Oracle Interim Patch Installer version 12.2.0.1.17
Copyright (c) 2020, Oracle Corporation. All rights reserved.
Oracle Home : /u01/app/12.1.0/grid
Central Inventory : /u01/app/oraInventory
from : /u01/app/12.1.0/grid//oraInst.loc
OPatch version : 12.2.0.1.17
OUI version : 12.1.0.2.0
Log file location : /u01/app/12.1.0/grid/cfgtoollogs/opatch/opatch2020-05-29_19-41-10PM_1.log
Lsinventory Output file location : /u01/app/12.1.0/grid/cfgtoollogs/opatch/lsinv/lsinventory2020-05-29_19-41-10PM.txt
--------------------------------------------------------------------------------
Local Machine Information::
Hostname: srv2.example.com
ARU platform id: 226
ARU platform description:: Linux x86-64
Installed Top-level Products (1):
Oracle Grid Infrastructure 12c 12.1.0.2.0
There are 1 products installed in this Oracle Home.
Interim patches (4) :
Patch 24007012 : applied on Fri May 29 19:12:49 IST 2020
Unique Patch ID: 20511653
Patch description: "ACFS Patch Set Update : 12.1.0.2.161018 (24007012)"
Created on 30 Aug 2016, 00:17:17 hrs PST8PDT
Bugs fixed:
19060056, 21369858, 19355146, 19690653, 19526234, 20952520, 19475588
21231953, 18510745, 19149476, 19013966, 22222222, 19859183, 21519796
19469788, 21555038, 18877486, 20438706, 19610022, 19335268, 21058846
22472364, 22319558, 19183802, 19452723, 21124596, 19051391, 20010980
19526283, 22198405, 22689989, 19279106, 19078259, 19644505, 21077218
21233961, 19184398, 18321597, 19811784, 18185024, 22174238, 20098064
19353057, 19502657, 22661787, 19434261, 18951113, 20140148, 18900953
19053182, 22975177, 18955907, 18934139, 19134464, 19450090, 19517835
22241945, 20923224, 19446719, 20402287, 19201087, 21208140, 19649858
21076821, 19428756, 19001684, 19610001, 18899600, 20314907, 19509898
19528981, 18957085, 19127216, 23557970, 19901825, 22810422, 18915417
19270227, 22087780, 22198176, 19919907, 19593769, 23112252, 19557156
19195735, 23252830, 22846612, 20681968, 18851012, 19844362
Patch 24006101 : applied on Fri May 29 19:06:55 IST 2020
Unique Patch ID: 20683584
Patch description: "Database Patch Set Update : 12.1.0.2.161018 (24006101)"
Created on 1 Oct 2016, 12:33:50 hrs PST8PDT
Sub-patch 23054246; "Database Patch Set Update : 12.1.0.2.160719 (23054246)"
Sub-patch 22291127; "Database Patch Set Update : 12.1.0.2.160419 (22291127)"
Sub-patch 21948354; "Database Patch Set Update : 12.1.0.2.160119 (21948354)"
Sub-patch 21359755; "Database Patch Set Update : 12.1.0.2.5 (21359755)"
Sub-patch 20831110; "Database Patch Set Update : 12.1.0.2.4 (20831110)"
Sub-patch 20299023; "Database Patch Set Update : 12.1.0.2.3 (20299023)"
Sub-patch 19769480; "Database Patch Set Update : 12.1.0.2.2 (19769480)"
Bugs fixed:
19309466, 19902195, 18250893, 17655240, 19028800, 21266085, 19035573
19366375, 18456643, 19289642, 18845653, 19915271, 21291274, 18417036
20475845, 22528741, 22148226, 19243521, 19658708, 21153266, 19326908
19597583, 17414008, 20897759, 19174430, 22046677, 22243719, 21960504
19054077, 20688221, 22657942, 21899588, 20428621, 13542050, 21387964
19723336, 19835133, 17532734, 19333670, 21373473, 23260854, 19687159
14643995, 20977794, 19012119, 20734332, 19869255, 17551063, 18681056
19676012, 20588502, 19520602, 19841800, 19439759, 20245930, 19303936
19001359, 19393542, 22916353, 21099555, 22353346, 19141838, 19644859
21915719, 21421886, 19908836, 19358317, 19134173, 19524158, 20447445
21188584, 19335438, 19390567, 19058490, 18799993, 19769480, 21097043
21225209, 19284031, 19450314, 19016730, 18967382, 20919320, 22075064
20347562, 20348653, 22551446, 19896336, 20048359, 19524384, 16439813
18354830, 20596234, 20440930, 20936905, 19171086, 17867700, 19791273
18990023, 21241829, 19591608, 22296366, 20173897, 18914624, 19571367
17210525, 21260431, 19501299, 20425790, 19124589, 19402853, 19888853
16870214, 17722075, 18202441, 18743542, 19001390, 19081128, 22173980
21875360, 19178851, 19149990, 20951038, 22168163, 19606174, 20848335
19791377, 19050649, 19382851, 20920911, 20528052, 22762046, 19189525
20598042, 18988834, 19176326, 19048007, 19238590, 20387265, 21263635
20356733, 22160989, 22380919, 18499088, 18436647, 20825533, 18952989
20794034, 19468347, 20284155, 19883092, 20657441, 17365043, 20952966
19176223, 21300341, 18288842, 19699191, 22353199, 22083366, 20669434
18964978, 19577410, 21373076, 14283239, 19931709, 21239530, 20880215
20798891, 20043616, 18122373, 19013183, 18856999, 23124895, 21450666
18893947, 19587324, 20464614, 22062026, 19189317, 21917884, 19708632
20711718, 20134339, 22815955, 18973548, 22507210, 20101006, 19197175
18797519, 19597439, 21387128, 19180770, 19879746, 19354335, 19730508
21785691, 22366558, 6599380, 18964939, 22507234, 20124446, 20627866
16923858, 19518079, 19371175, 20466322, 18940497, 19074147, 22923409
17274537, 20842388, 19154375, 20474192, 19044962, 19532017, 19662635
22374754, 20560611, 18899974, 20471920, 18705806, 19052488, 22024071
20074391, 21184223, 19157754, 21220620, 18921743, 24316947, 19865345
19065677, 19065556, 19018447, 19018206, 19777862, 19304354, 22223463
21322887, 20879889, 20890311, 19578350, 20869721, 21756699, 20217801
18819908, 19363645, 20898391, 19291380, 20373598, 19248799, 19155797
19279273, 18886413, 18618122, 19990037, 20922010, 20509482, 18966843
19077215, 21526048, 20704450, 19068970, 21620471, 19023822, 19670108
19068610, 20267166, 21756677, 20476175, 18549238, 18674047, 20328248
19385656, 18849537, 19684504, 20899461, 19308965, 19143550, 19024808
18948177, 19468991, 20009833, 20868862, 20466628, 21756661, 20397490
19706965, 22178855, 19604659, 16359751, 19032777, 19329654, 19928926
20212067, 20603378, 20859910, 19307662, 21847223, 21668627, 20281121
19075256, 20877664, 19487147, 19076343, 19430401, 24577566, 19676905
20844426, 20904530, 20925795, 20441797, 21296029, 21629064, 21442094
23229229, 20708701, 22865673, 19280225, 21315084, 18740837, 20294666
19989009, 18191823, 21517440, 19174942, 17319928, 19703301, 20122715
18411216, 20117253, 19258504, 21188532, 24386767, 17890099, 21649497
16887946, 18791688, 19721304, 22092979, 19490948, 19619732, 20165574
19272708, 19547370, 20139391, 20228093, 21281532, 19978542, 19409212
19805359, 19461270, 19434529, 18799063, 18990693, 20378086, 21246723
20831538, 21632821, 20424899, 20361671, 18674024, 19689979, 20235511
19873610, 16619249, 21091431, 19440586, 22757364, 18610915, 22175564
19561643, 19399918, 19195895, 20832516, 20017509, 20907061, 21665897
20746251, 19183343, 21787056, 21273804, 19067244, 18043064, 21329301
18885870, 19536415, 17835294, 20446883, 21744290, 20413820, 19185876
22465352, 20558005, 20402832, 19627012, 20093776, 18909599, 20618595
16863642, 19639483, 19315691, 20331945, 19512341, 19637186, 19174521
21479753, 19022470, 18607546, 18306996, 18851894, 19649152, 20581111
19201867, 20318889, 20898997, 19534363, 19188927
Patch 23854735 : applied on Fri May 29 19:04:00 IST 2020
Unique Patch ID: 20511532
Patch description: "OCW Patch Set Update : 12.1.0.2.161018 (23854735)"
Created on 29 Sep 2016, 23:50:00 hrs PST8PDT
Bugs fixed:
21339083, 18589889, 20768643, 19061429, 19133945, 19341538, 19521169
20011424, 19361757, 19187207, 19302350, 19130141, 19530755, 19699720
19620918, 19168690, 18899171, 19244316, 19653795, 18634372, 19471722
19536337, 19184188, 19131709, 20160490, 20995001, 21131037, 19380733
20985167, 18943696, 20552947, 19591984, 18135723, 18461246, 20014326
19524857, 18890943, 19154753, 19499021, 19046190, 20923930, 20028666
19051385, 19050688, 19682695, 19831611, 21607972, 18922918, 21087799
18956780, 19683886, 23757020, 19026993, 20110156, 21269977, 18261648
18362971, 19558324, 22651583, 20185476, 18882642, 19478119, 19414274
17447588, 19262534, 20752167, 19147513, 22475834, 21242118, 19514085
20758997, 19659885, 19319904, 18703978, 23079844, 19700256, 19703246
20467806, 19192901, 21527118, 19479503, 19147751, 18901356, 21232394
18964974, 22162062, 18835366, 19013789, 19207286, 18950232, 22583325
19148791, 19556820, 16505171, 22261732, 22135419, 19449737, 21878613
21646169, 19187515, 19230771, 20795241, 19453778, 19853036, 18843572
18520351, 21430567, 19185148, 19232454, 21220597, 18541110, 18834955
19204743, 20175174, 19140891, 18747335, 20676340, 19270660, 19325701
20877003, 19222693, 19662663, 19684131, 19010177, 19272663, 18910576
18907170, 19426384, 9372680, 20737462, 19700294, 20289828, 19331454
22568500, 20278216, 20827053, 20119857, 19703199, 22456393, 20588164
18955644, 20991879, 18508710, 19908346, 19589221, 18952857, 19537762
21152052, 16286734, 20669114, 18762843, 18945249, 19184799, 19205086
19351363, 20091753, 19031737, 19079087, 19148367, 18968981, 19150517
20231741, 19217019, 18730096, 18975620, 19067804, 21259359, 19054979
19209951, 19318983, 18747382, 19154673, 18752378, 22905714, 19150088
19013444, 19234177, 18999857, 19075747, 19367276, 19612597, 19874047
19677813, 23049292, 19427050, 18910443, 20033787, 19148982, 19777496
20730170, 18523468, 19277814, 20562133, 19071526, 21420753, 18850051
20433932, 20061168, 19370739, 20822591, 19609388, 18776786, 20136892
18989446, 19148793, 19585454, 18317489, 19955755, 19059053, 19807548
19124972, 22229116, 18910748, 19147509, 18849896, 19617592, 19398098
22840085, 19076165, 19498411, 19704993, 21294273, 19459023, 20634511
21229744, 21474380, 21484367, 20276459, 17208793, 19234907, 19538714
22867050, 19383028, 19513969, 22195657, 23111368, 19986391, 19314048
18834934, 19473851, 19458082, 18894342, 19522067, 18116578, 19241857
19076778, 19066699, 19068003, 18937186, 20267877, 19916737, 19770543
22863466, 19635215, 19613533, 21057239, 20783416, 19315522, 19141785
19163887, 19885321, 18715868, 18852058, 19701617, 19280860, 19139608
21453435, 18946768, 19135521, 18604143, 19627476, 20568884, 20317221
20177779, 19266658, 24522717, 18330979, 19027351, 21227730, 18707416
21118157, 21113068, 19925992, 20235486, 20006646, 15922206, 18439295
18991776, 21245437, 23170839, 19163425, 19550195, 18849021, 18861196
17940721, 18524834, 19287706, 19522313, 18835283, 18748932, 19184765
21639478, 14851828, 20598625, 19226141, 19053891, 18871287, 18998228
18980002, 19682778, 19325604, 18777835, 17338864, 18945906, 19513650
19702758, 18952577, 19473088, 19178517, 18729269, 19529729, 19455563
20877072, 23275930, 20340620, 18536826, 19292605, 22264951, 20920711
20660273, 20011635, 17592037, 18935857, 22989069, 19029647, 19179158
22302421, 23076471, 19140712, 20012766, 23049301, 19184276, 20510208
20001507, 20079414, 19680763, 19259765, 18962892, 19513888, 14661880
21519340, 21222147, 20218012, 19551830, 21616278, 19068333, 18945435
20775015, 19319192, 20839581, 19178629, 21694237, 19304104, 19284357
22594310, 20725084, 19457575, 21297657, 19069755, 19021575, 18715884
19584688, 18798573, 19812592, 19018001, 19292272, 19270956, 21967791
21794779, 23055224, 18700893, 21276514, 20467377, 18406774, 20607821
21976167, 21082737, 21694632, 20115586, 20883009, 19164099, 18283792
19155350, 19884033, 19146822, 18798432, 21123424, 19471836, 20936562
18750781, 19045143, 22483804, 19146980, 19601003, 20099624, 21378016
19537547, 19281106, 18862203, 19954372, 18235274, 19205617, 19513351
20219458, 19150313, 18843054, 18708349, 19332386, 18953639, 21423055
19371270, 19203996, 20038431, 19370846, 21053036, 18998379, 20157569
21357522, 19273577, 24709351, 22113170, 19632437, 18990354, 19288396
20620581, 19557558, 19127078, 21792881, 20900588, 20053557, 22088198
22664609, 19315567, 19444471, 19154933, 20953798, 18290252, 18813323
19915945, 19500293, 18643483, 19134098, 23034352, 18965694, 19226858
19591356, 19602208, 22884308, 20069197, 18417590, 18920408, 18636884
22289350, 19043795, 20746507, 18260170, 18919682, 18678829, 19319357
19273758, 18953878, 18999195, 18759724, 19066844, 13843841, 20290467
22934855, 19649640, 19062675, 21924910, 18859710, 20862812, 19504641
23101611, 19341481, 20293730, 19343245, 18304090, 19241655, 19470791
18242738, 20649573, 18372060, 18953889, 18827679, 19140711, 19023430
19259290, 19045388, 20186278, 19522571, 19709663, 18875012, 18861564
19273760, 19225265, 15885689, 20853464, 21696068, 18819158, 21394146
19049721, 19368917, 21255373, 22393909, 20408163, 20579351, 18868829
20350915, 21327402, 22024217, 23101338, 19820247, 20363708, 19538241
19804032
Patch 21436941 : applied on Fri May 29 19:01:42 IST 2020
Unique Patch ID: 19245012
Patch description: "WLM Patch Set Update: 12.1.0.2.5 (21436941)"
Created on 13 Aug 2015, 04:00:40 hrs PST8PDT
Bugs fixed:
20075154, 20641027, 20548410, 19016964, 19582630
--------------------------------------------------------------------------------
OPatch succeeded.
grid@srv2:/u01/app/12.1.0/grid/OPatch>
- Successfully stop and start cluster on both nodes
srv1:~ # crsctl stop cluster -all
CRS-2673: Attempting to stop 'ora.crsd' on 'srv1'
CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on 'srv1'
CRS-2673: Attempting to stop 'ora.LISTENER_SCAN3.lsnr' on 'srv1'
CRS-2673: Attempting to stop 'ora.LISTENER_SCAN2.lsnr' on 'srv1'
CRS-2673: Attempting to stop 'ora.rac.pretaf_preconnect.svc' on 'srv2'
CRS-2673: Attempting to stop 'ora.mgmtdb' on 'srv1'
CRS-2673: Attempting to stop 'ora.LISTENER.lsnr' on 'srv1'
CRS-2673: Attempting to stop 'ora.oc4j' on 'srv1'
CRS-2673: Attempting to stop 'ora.cvu' on 'srv1'
CRS-2677: Stop of 'ora.cvu' on 'srv1' succeeded
CRS-2677: Stop of 'ora.rac.pretaf_preconnect.svc' on 'srv2' succeeded
CRS-2673: Attempting to stop 'ora.rac.pretaf.svc' on 'srv1'
CRS-2677: Stop of 'ora.LISTENER_SCAN3.lsnr' on 'srv1' succeeded
CRS-2673: Attempting to stop 'ora.scan3.vip' on 'srv1'
CRS-2677: Stop of 'ora.LISTENER.lsnr' on 'srv1' succeeded
CRS-2677: Stop of 'ora.LISTENER_SCAN2.lsnr' on 'srv1' succeeded
CRS-2673: Attempting to stop 'ora.scan2.vip' on 'srv1'
CRS-2673: Attempting to stop 'ora.crsd' on 'srv2'
CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on 'srv2'
CRS-2677: Stop of 'ora.rac.pretaf.svc' on 'srv1' succeeded
CRS-2673: Attempting to stop 'ora.rac.db' on 'srv1'
CRS-2677: Stop of 'ora.scan3.vip' on 'srv1' succeeded
CRS-2677: Stop of 'ora.scan2.vip' on 'srv1' succeeded
CRS-2677: Stop of 'ora.rac.db' on 'srv1' succeeded
CRS-2673: Attempting to stop 'ora.FRA.dg' on 'srv1'
CRS-2677: Stop of 'ora.mgmtdb' on 'srv1' succeeded
CRS-2673: Attempting to stop 'ora.MGMTLSNR' on 'srv1'
CRS-2677: Stop of 'ora.MGMTLSNR' on 'srv1' succeeded
CRS-2673: Attempting to stop 'ora.CRS.dg' on 'srv1'
CRS-2677: Stop of 'ora.CRS.dg' on 'srv1' succeeded
CRS-2677: Stop of 'ora.FRA.dg' on 'srv1' succeeded
CRS-2673: Attempting to stop 'ora.DATA.dg' on 'srv1'
CRS-2673: Attempting to stop 'ora.srv1.vip' on 'srv1'
CRS-2677: Stop of 'ora.DATA.dg' on 'srv1' succeeded
CRS-2677: Stop of 'ora.srv1.vip' on 'srv1' succeeded
CRS-2673: Attempting to stop 'ora.asm' on 'srv1'
CRS-2677: Stop of 'ora.asm' on 'srv1' succeeded
CRS-2673: Attempting to stop 'ora.LISTENER_SCAN1.lsnr' on 'srv2'
CRS-2673: Attempting to stop 'ora.LISTENER.lsnr' on 'srv2'
CRS-2673: Attempting to stop 'ora.rac.db' on 'srv2'
CRS-2677: Stop of 'ora.LISTENER.lsnr' on 'srv2' succeeded
CRS-2673: Attempting to stop 'ora.srv2.vip' on 'srv2'
CRS-2677: Stop of 'ora.LISTENER_SCAN1.lsnr' on 'srv2' succeeded
CRS-2673: Attempting to stop 'ora.scan1.vip' on 'srv2'
CRS-2677: Stop of 'ora.rac.db' on 'srv2' succeeded
CRS-2673: Attempting to stop 'ora.DATA.dg' on 'srv2'
CRS-2673: Attempting to stop 'ora.FRA.dg' on 'srv2'
CRS-2677: Stop of 'ora.srv2.vip' on 'srv2' succeeded
CRS-2677: Stop of 'ora.scan1.vip' on 'srv2' succeeded
CRS-2677: Stop of 'ora.FRA.dg' on 'srv2' succeeded
CRS-2677: Stop of 'ora.DATA.dg' on 'srv2' succeeded
CRS-2673: Attempting to stop 'ora.CRS.dg' on 'srv2'
CRS-2677: Stop of 'ora.CRS.dg' on 'srv2' succeeded
CRS-2673: Attempting to stop 'ora.asm' on 'srv2'
CRS-2677: Stop of 'ora.asm' on 'srv2' succeeded
CRS-2673: Attempting to stop 'ora.ons' on 'srv2'
CRS-2677: Stop of 'ora.ons' on 'srv2' succeeded
CRS-2673: Attempting to stop 'ora.net1.network' on 'srv2'
CRS-2677: Stop of 'ora.net1.network' on 'srv2' succeeded
CRS-2792: Shutdown of Cluster Ready Services-managed resources on 'srv2' has completed
CRS-2677: Stop of 'ora.crsd' on 'srv2' succeeded
CRS-2673: Attempting to stop 'ora.ctssd' on 'srv2'
CRS-2673: Attempting to stop 'ora.evmd' on 'srv2'
CRS-2673: Attempting to stop 'ora.storage' on 'srv2'
CRS-2677: Stop of 'ora.storage' on 'srv2' succeeded
CRS-2673: Attempting to stop 'ora.asm' on 'srv2'
CRS-2677: Stop of 'ora.ctssd' on 'srv2' succeeded
CRS-2677: Stop of 'ora.evmd' on 'srv2' succeeded
CRS-2677: Stop of 'ora.oc4j' on 'srv1' succeeded
CRS-2673: Attempting to stop 'ora.ons' on 'srv1'
CRS-2677: Stop of 'ora.ons' on 'srv1' succeeded
CRS-2673: Attempting to stop 'ora.net1.network' on 'srv1'
CRS-2677: Stop of 'ora.net1.network' on 'srv1' succeeded
CRS-2792: Shutdown of Cluster Ready Services-managed resources on 'srv1' has completed
CRS-2677: Stop of 'ora.crsd' on 'srv1' succeeded
CRS-2673: Attempting to stop 'ora.ctssd' on 'srv1'
CRS-2673: Attempting to stop 'ora.evmd' on 'srv1'
CRS-2673: Attempting to stop 'ora.storage' on 'srv1'
CRS-2677: Stop of 'ora.storage' on 'srv1' succeeded
CRS-2673: Attempting to stop 'ora.asm' on 'srv1'
CRS-2677: Stop of 'ora.asm' on 'srv2' succeeded
CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'srv2'
CRS-2677: Stop of 'ora.evmd' on 'srv1' succeeded
CRS-2677: Stop of 'ora.ctssd' on 'srv1' succeeded
CRS-2677: Stop of 'ora.cluster_interconnect.haip' on 'srv2' succeeded
CRS-2673: Attempting to stop 'ora.cssd' on 'srv2'
CRS-2677: Stop of 'ora.cssd' on 'srv2' succeeded
CRS-2677: Stop of 'ora.asm' on 'srv1' succeeded
CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'srv1'
CRS-2677: Stop of 'ora.cluster_interconnect.haip' on 'srv1' succeeded
CRS-2673: Attempting to stop 'ora.cssd' on 'srv1'
CRS-2677: Stop of 'ora.cssd' on 'srv1' succeeded
srv1:~ # crsctl start cluster -all
CRS-2672: Attempting to start 'ora.cssdmonitor' on 'srv1'
CRS-2672: Attempting to start 'ora.cssdmonitor' on 'srv2'
CRS-2672: Attempting to start 'ora.evmd' on 'srv1'
CRS-2672: Attempting to start 'ora.evmd' on 'srv2'
CRS-2676: Start of 'ora.cssdmonitor' on 'srv2' succeeded
CRS-2672: Attempting to start 'ora.cssd' on 'srv2'
CRS-2672: Attempting to start 'ora.diskmon' on 'srv2'
CRS-2676: Start of 'ora.evmd' on 'srv1' succeeded
CRS-2676: Start of 'ora.cssdmonitor' on 'srv1' succeeded
CRS-2672: Attempting to start 'ora.cssd' on 'srv1'
CRS-2672: Attempting to start 'ora.diskmon' on 'srv1'
CRS-2676: Start of 'ora.diskmon' on 'srv1' succeeded
CRS-2676: Start of 'ora.diskmon' on 'srv2' succeeded
CRS-2676: Start of 'ora.evmd' on 'srv2' succeeded
CRS-2676: Start of 'ora.cssd' on 'srv1' succeeded
CRS-2672: Attempting to start 'ora.ctssd' on 'srv1'
CRS-2672: Attempting to start 'ora.cluster_interconnect.haip' on 'srv1'
CRS-2676: Start of 'ora.cssd' on 'srv2' succeeded
CRS-2672: Attempting to start 'ora.ctssd' on 'srv2'
CRS-2672: Attempting to start 'ora.cluster_interconnect.haip' on 'srv2'
CRS-2676: Start of 'ora.ctssd' on 'srv1' succeeded
CRS-2676: Start of 'ora.ctssd' on 'srv2' succeeded
CRS-2676: Start of 'ora.cluster_interconnect.haip' on 'srv2' succeeded
CRS-2676: Start of 'ora.cluster_interconnect.haip' on 'srv1' succeeded
CRS-2672: Attempting to start 'ora.asm' on 'srv1'
CRS-2672: Attempting to start 'ora.asm' on 'srv2'
CRS-2676: Start of 'ora.asm' on 'srv1' succeeded
CRS-2672: Attempting to start 'ora.storage' on 'srv1'
CRS-2676: Start of 'ora.storage' on 'srv1' succeeded
CRS-2672: Attempting to start 'ora.crsd' on 'srv1'
CRS-2676: Start of 'ora.crsd' on 'srv1' succeeded
CRS-2676: Start of 'ora.asm' on 'srv2' succeeded
CRS-2672: Attempting to start 'ora.storage' on 'srv2'
CRS-2676: Start of 'ora.storage' on 'srv2' succeeded
CRS-2672: Attempting to start 'ora.crsd' on 'srv2'
CRS-2676: Start of 'ora.crsd' on 'srv2' succeeded
srv1:~ #
- Check the status of both nodes
srv1:~ # crsctl status resource -t
--------------------------------------------------------------------------------
Name Target State Server State details
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.CRS.dg
ONLINE ONLINE srv1 STABLE
ONLINE ONLINE srv2 STABLE
ora.DATA.dg
ONLINE ONLINE srv1 STABLE
ONLINE ONLINE srv2 STABLE
ora.FRA.dg
ONLINE ONLINE srv1 STABLE
ONLINE ONLINE srv2 STABLE
ora.LISTENER.lsnr
ONLINE ONLINE srv1 STABLE
ONLINE ONLINE srv2 STABLE
ora.asm
ONLINE ONLINE srv1 Started,STABLE
ONLINE ONLINE srv2 Started,STABLE
ora.net1.network
ONLINE ONLINE srv1 STABLE
ONLINE ONLINE srv2 STABLE
ora.ons
ONLINE ONLINE srv1 STABLE
ONLINE ONLINE srv2 STABLE
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.LISTENER_SCAN1.lsnr
1 ONLINE ONLINE srv2 STABLE
ora.LISTENER_SCAN2.lsnr
1 ONLINE ONLINE srv1 STABLE
ora.LISTENER_SCAN3.lsnr
1 ONLINE ONLINE srv1 STABLE
ora.MGMTLSNR
1 ONLINE ONLINE srv2 169.254.82.21 192.16
8.10.2,STABLE
ora.cvu
1 ONLINE ONLINE srv1 STABLE
ora.mgmtdb
1 ONLINE ONLINE srv2 Open,STABLE
ora.oc4j
1 ONLINE ONLINE srv1 STABLE
ora.rac.db
1 ONLINE ONLINE srv1 Open,STABLE
2 ONLINE ONLINE srv2 Open,STABLE
ora.rac.pretaf.svc
1 ONLINE ONLINE srv1 STABLE
ora.rac.pretaf_preconnect.svc
1 ONLINE ONLINE srv2 STABLE
ora.scan1.vip
1 ONLINE ONLINE srv2 STABLE
ora.scan2.vip
1 ONLINE ONLINE srv1 STABLE
ora.scan3.vip
1 ONLINE ONLINE srv1 STABLE
ora.srv1.vip
1 ONLINE ONLINE srv1 STABLE
ora.srv2.vip
1 ONLINE ONLINE srv2 STABLE
--------------------------------------------------------------------------------
srv1:~ #
No comments:
Post a Comment