Wednesday 7 April 2021

RAC - Rebuild node for surviving node 12.2.0.1.0

 

 Rebuild node for surviving node 12.2.0.1.0

This is lab scenario , OS recreated after making passwordless oracle and grid connection. we proceed further for adding failed node. Here addenode.sh command are almost same but in 12.2.0.1.0 adding HUB or LEAF  "CLUSTER_NEW_NODE_ROLES={HUB}" . In our case it is 2 node RAC grid so we use HUB depends upon option provided earlier.

  • Operating System : OEL 6.7 X 64 bit
  • Oracle Grid version : 12.1.0.2.0
  • Please follow these steps before executing commands Web blog link : Add failed node 12.1.0.2.0 grid
  • Below we add node from srv2 to srv1 server.

[grid@srv2 addnode]$ ./addnode.sh -ignoreSysPrereqs -ignorePrereq -silent "CLUSTER_NEW_NODES={srv1}" "CLUSTER_NEW_VIRTUAL_HOSTNAMES={srv1-vip}" "CLUSTER_NEW_NODE_ROLES={HUB}"


Prepare Configuration in progress.


Prepare Configuration successful.

..................................................   7% Done.


Copy Files to Remote Nodes in progress.

..................................................   12% Done.

..................................................   17% Done.

..............................

Copy Files to Remote Nodes successful.

You can find the log of this install session at:

 /u01/app/oraInventory/logs/addNodeActions2021-04-06_05-34-07-PM.log


Instantiate files in progress.


Instantiate files successful.

..................................................   49% Done.


Saving cluster inventory in progress.

..................................................   83% Done.


Saving cluster inventory successful.

The Cluster Node Addition of /u01/app/12.2.0/grid was successful.

Please check '/u01/app/12.2.0/grid/inventory/silentInstall2021-04-06_5-33-57-PM.log' for more details.


Setup Oracle Base in progress.


Setup Oracle Base successful.

..................................................   90% Done.


Update Inventory in progress.


Update Inventory successful.

..................................................   97% Done.


As a root user, execute the following script(s):

        1. /u01/app/12.2.0/grid/root.sh


Execute /u01/app/12.2.0/grid/root.sh on the following nodes:

[srv1]


The scripts can be executed in parallel on all the nodes.


..................................................   100% Done.

Successfully Setup Software.

[root@srv1 ~]# tail -1000f /u01/app/12.2.0/grid/install/root_srv1.example.com_2021-04-06_18-05-43-573011212.log
Performing root user operation.

The following environment variables are set as:
    ORACLE_OWNER= grid
    ORACLE_HOME=  /u01/app/12.2.0/grid
   Copying dbhome to /usr/local/bin ...
   Copying oraenv to /usr/local/bin ...
   Copying coraenv to /usr/local/bin ...

Entries will be added to the /etc/oratab file as needed by
Database Configuration Assistant when a database is created
Finished running generic part of root script.
Now product-specific root actions will be performed.
Relinking oracle with rac_on option
Using configuration parameter file: /u01/app/12.2.0/grid/crs/install/crsconfig_params
The log of current session can be found at:
  /u01/app/grid/crsdata/srv1/crsconfig/rootcrs_srv1_2021-04-06_06-08-10PM.log
2021/04/06 18:08:20 CLSRSC-594: Executing installation step 1 of 19: 'SetupTFA'.
2021/04/06 18:08:20 CLSRSC-4001: Installing Oracle Trace File Analyzer (TFA) Collector.
2021/04/06 18:10:14 CLSRSC-4002: Successfully installed Oracle Trace File Analyzer (TFA) Collector.
2021/04/06 18:10:14 CLSRSC-594: Executing installation step 2 of 19: 'ValidateEnv'.
2021/04/06 18:10:34 CLSRSC-363: User ignored prerequisites during installation
2021/04/06 18:10:34 CLSRSC-594: Executing installation step 3 of 19: 'CheckFirstNode'.
2021/04/06 18:10:41 CLSRSC-594: Executing installation step 4 of 19: 'GenSiteGUIDs'.
2021/04/06 18:10:44 CLSRSC-594: Executing installation step 5 of 19: 'SaveParamFile'.
2021/04/06 18:11:07 CLSRSC-594: Executing installation step 6 of 19: 'SetupOSD'.
2021/04/06 18:11:09 CLSRSC-594: Executing installation step 7 of 19: 'CheckCRSConfig'.
2021/04/06 18:11:13 CLSRSC-594: Executing installation step 8 of 19: 'SetupLocalGPNP'.
2021/04/06 18:11:27 CLSRSC-594: Executing installation step 9 of 19: 'ConfigOLR'.
2021/04/06 18:11:52 CLSRSC-594: Executing installation step 10 of 19: 'ConfigCHMOS'.
2021/04/06 18:11:52 CLSRSC-594: Executing installation step 11 of 19: 'CreateOHASD'.
2021/04/06 18:12:06 CLSRSC-594: Executing installation step 12 of 19: 'ConfigOHASD'.
2021/04/06 18:12:24 CLSRSC-330: Adding Clusterware entries to file 'oracle-ohasd.conf'
2021/04/06 18:13:24 CLSRSC-594: Executing installation step 13 of 19: 'InstallAFD'.
2021/04/06 18:13:38 CLSRSC-594: Executing installation step 14 of 19: 'InstallACFS'.
CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'srv1'
CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'srv1' has completed
CRS-4133: Oracle High Availability Services has been stopped.
CRS-4123: Oracle High Availability Services has been started.
2021/04/06 18:15:31 CLSRSC-594: Executing installation step 15 of 19: 'InstallKA'.
2021/04/06 18:15:45 CLSRSC-594: Executing installation step 16 of 19: 'InitConfig'.
CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'srv1'
CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'srv1' has completed
CRS-4133: Oracle High Availability Services has been stopped.
CRS-4123: Oracle High Availability Services has been started.
CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'srv1'
CRS-2673: Attempting to stop 'ora.drivers.acfs' on 'srv1'
CRS-2677: Stop of 'ora.drivers.acfs' on 'srv1' succeeded
CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'srv1' has completed
CRS-4133: Oracle High Availability Services has been stopped.
2021/04/06 18:16:24 CLSRSC-594: Executing installation step 17 of 19: 'StartCluster'.
CRS-4123: Starting Oracle High Availability Services-managed resources
CRS-2672: Attempting to start 'ora.mdnsd' on 'srv1'
CRS-2672: Attempting to start 'ora.evmd' on 'srv1'
CRS-2676: Start of 'ora.mdnsd' on 'srv1' succeeded
CRS-2676: Start of 'ora.evmd' on 'srv1' succeeded
CRS-2672: Attempting to start 'ora.gpnpd' on 'srv1'
CRS-2676: Start of 'ora.gpnpd' on 'srv1' succeeded
CRS-2672: Attempting to start 'ora.gipcd' on 'srv1'
CRS-2676: Start of 'ora.gipcd' on 'srv1' succeeded
CRS-2672: Attempting to start 'ora.cssdmonitor' on 'srv1'
CRS-2676: Start of 'ora.cssdmonitor' on 'srv1' succeeded
CRS-2672: Attempting to start 'ora.cssd' on 'srv1'
CRS-2672: Attempting to start 'ora.diskmon' on 'srv1'
CRS-2676: Start of 'ora.diskmon' on 'srv1' succeeded
CRS-2676: Start of 'ora.cssd' on 'srv1' succeeded
CRS-2672: Attempting to start 'ora.cluster_interconnect.haip' on 'srv1'
CRS-2672: Attempting to start 'ora.ctssd' on 'srv1'
CRS-2676: Start of 'ora.ctssd' on 'srv1' succeeded
CRS-2676: Start of 'ora.cluster_interconnect.haip' on 'srv1' succeeded
CRS-2672: Attempting to start 'ora.asm' on 'srv1'
CRS-2676: Start of 'ora.asm' on 'srv1' succeeded
CRS-2672: Attempting to start 'ora.storage' on 'srv1'
CRS-2676: Start of 'ora.storage' on 'srv1' succeeded
CRS-2672: Attempting to start 'ora.crf' on 'srv1'
CRS-2676: Start of 'ora.crf' on 'srv1' succeeded
CRS-2672: Attempting to start 'ora.crsd' on 'srv1'
CRS-2676: Start of 'ora.crsd' on 'srv1' succeeded
CRS-6017: Processing resource auto-start for servers: srv1
CRS-2672: Attempting to start 'ora.ASMIBNETLSNR_ASM.lsnr' on 'srv1'
CRS-2673: Attempting to stop 'ora.LISTENER_SCAN1.lsnr' on 'srv2'
CRS-2672: Attempting to start 'ora.net1.network' on 'srv1'
CRS-2676: Start of 'ora.net1.network' on 'srv1' succeeded
CRS-2672: Attempting to start 'ora.qosmserver' on 'srv1'
CRS-2677: Stop of 'ora.LISTENER_SCAN1.lsnr' on 'srv2' succeeded
CRS-2673: Attempting to stop 'ora.scan1.vip' on 'srv2'
CRS-2672: Attempting to start 'ora.ons' on 'srv1'
CRS-2677: Stop of 'ora.scan1.vip' on 'srv2' succeeded
CRS-2672: Attempting to start 'ora.scan1.vip' on 'srv1'
CRS-2676: Start of 'ora.scan1.vip' on 'srv1' succeeded
CRS-2672: Attempting to start 'ora.LISTENER_SCAN1.lsnr' on 'srv1'
CRS-2676: Start of 'ora.ASMIBNETLSNR_ASM.lsnr' on 'srv1' succeeded
CRS-2672: Attempting to start 'ora.asm' on 'srv1'
CRS-2676: Start of 'ora.ons' on 'srv1' succeeded
CRS-2676: Start of 'ora.LISTENER_SCAN1.lsnr' on 'srv1' succeeded
CRS-2676: Start of 'ora.asm' on 'srv1' succeeded
CRS-2672: Attempting to start 'ora.DATA.dg' on 'srv1'
CRS-2672: Attempting to start 'ora.FRA.dg' on 'srv1'
CRS-2676: Start of 'ora.DATA.dg' on 'srv1' succeeded
CRS-2676: Start of 'ora.FRA.dg' on 'srv1' succeeded
CRS-2676: Start of 'ora.qosmserver' on 'srv1' succeeded
CRS-6016: Resource auto-start has completed for server srv1
CRS-6024: Completed start of Oracle Cluster Ready Services-managed resources
CRS-4123: Oracle High Availability Services has been started.
2021/04/06 18:18:25 CLSRSC-343: Successfully started Oracle Clusterware stack
2021/04/06 18:18:25 CLSRSC-594: Executing installation step 18 of 19: 'ConfigNode'.
clscfg: EXISTING configuration version 5 detected.
clscfg: version 5 is 12c Release 2.
Successfully accumulated necessary OCR keys.
Creating OCR keys for user 'root', privgrp 'root'..
Operation successful.

2021/04/06 18:20:26 CLSRSC-594: Executing installation step 19 of 19: 'PostConfig'.
PRCR-1013 : Failed to start resource ora.LISTENER.lsnr

PRCR-1064 : Failed to start resource ora.LISTENER.lsnr on node srv1

CRS-5016: Process "/u01/app/12.2.0/grid/bin/lsnrctl" spawned by agent "ORAAGENT" for action "start" failed: details at "(:CLSN00010:)" in "/u01/app/grid/diag/crs/srv1/crs/trace/crsd_oraagent_grid.trc"

CRS-5016: Process "/u01/app/12.2.0/grid/bin/lsnrctl" spawned by agent "ORAAGENT" for action "start" failed: details at "(:CLSN00010:)" in "/u01/app/grid/diag/crs/srv1/crs/trace/crsd_oraagent_grid.trc"

CRS-2674: Start of 'ora.LISTENER.lsnr' on 'srv1' failed

2021/04/06 18:20:44 CLSRSC-180: An error occurred while executing the command '/u01/app/12.2.0/grid/bin/srvctl start listener -n srv1'
2021/04/06 18:21:02 CLSRSC-325: Configure Oracle Grid Infrastructure for a Cluster ... succeeded


^C
[root@srv1 ~]#

No comments:

Post a Comment