Showing posts with label RAC. Show all posts
Showing posts with label RAC. Show all posts

Wednesday 15 December 2021

OUI-10022:The target area /u01/oracle/gridbase/oraInventory cannot be used because it is in an invalid state.

 OUI-10022:The target area /u01/oracle/gridbase/oraInventory cannot be used because it is in an invalid state.

  • Scenario : 
We clean up the RAC machine on both VMbox and try to reinstall from scratch  ora inventory was different from old installation.



  • Check location on both node and correct the same . In our case inventory location was different so correct it or remove inventory location it will automatically add inventory_loc during installation.

[root@srv2 etc]# vi oraInst.loc 

inventory_loc=/u01/oracle/gridbase/oraInventory

inst_group=oinstall


[root@srv2 etc]# cat  /etc/oraInst.loc 

inventory_loc=/u01/oracle/gridbase/oraInventory

inst_group=oinstall

[root@srv2 etc]# 


  • We re run ./gridsetup.sh and found no issue set run smoothly.  
Posted by at No comments:
Labels: ,

Monday 8 November 2021

RAC - Replace or Recover CSS votedisk in case of failure without backup

 

RAC - Replace or Recover CSS votedisk in case of failure with out backup




 
Scenario: 

We have 3 node 12.2.0.1.0 RAC  setup .  We are running only 2 node  later after voteing disk replace we will start 3rd node as well. Voting disk and OCR is stored in same ASM diskgroup location which is +CRS. Our scenario is in case  repair or replace  votedisk to another disk group without backup.  

step 1 : Stop cluster and crs on all nodes 

crsctl stop crs -f  (on all nodes )

crsctl disable crs  (disable auto start )



step 2 :  Start crs in exclusive mode on one of node 
crsctl start crs -excl 
crsctl start crs -excl -nocrs 



step 3 :  Replace current votedisk  

crsctl replace votedisk +backup

crsctl query css votedisk 


step 4 : stop crs  on current node 

crsctl stop crs

step 5 : start crs and cluster on all the nodes 

crsctl start crs 

crsctl start cluster -all

step 6: check  votedisk location 
ocrcheck

crsctl query css votedisk 

step 7 : verify  cluster on all nodes 

  • Check current location of css votedisk and OCR , In our case currently it is stored in +CRS disk group

[root@srv2 ~]# crsctl  query crs activeversion
Oracle Clusterware active version on the cluster is [12.2.0.1.0]

[root@srv2 ~]# crsctl query css votedisk
##  STATE    File Universal Id                File Name Disk group
--  -----    -----------------                --------- ---------
 1. ONLINE   89ccb666fba84f48bffd99f68cc37d9a (/dev/oracleasm/disks/CRS) [CRS]
Located 1 voting disk(s).
[root@srv2 ~]# 


[root@srv2 ~]# ocrcheck
Status of Oracle Cluster Registry is as follows :
Version                  :          4
Total space (kbytes)     :     409568
Used space (kbytes)      :       2268
Available space (kbytes) :     407300
ID                       :  817426981
Device/File Name         :       +CRS
                                    Device/File integrity check succeeded

                                    Device/File not configured

                                    Device/File not configured

                                    Device/File not configured

                                    Device/File not configured

Cluster registry integrity check succeeded

Logical corruption check succeeded

  • Current ASM disk name  first we create backup diskgroup with external redundancy . This is for preparation of replacing votedisk or failure, As we can't replace with same diskgroup .

[root@srv1 ~]# oracleasm listdisks
BACKUP
CRS
DATA
FRA
[root@srv1 ~]# asmcd
bash: asmcd: command not found...
[root@srv1 ~]# asmcmd
ASMCMD> lsdg
State    Type    Rebal  Sector  Logical_Sector  Block       AU  Total_MB  Free_MB  Req_mir_free_MB  Usable_file_MB  Offline_disks  Voting_files  Name
MOUNTED  EXTERN  N         512             512   4096  4194304     43004     8920                0            8920              0             Y  CRS/
MOUNTED  EXTERN  N         512             512   4096  4194304     20476    20300                0           20300              0             N  DATA/
MOUNTED  EXTERN  N         512             512   4096  4194304     20476    15592                0           15592              0             N  FRA/

  • Current disk group information status and backup disk is in provisioned state 
ASMCMD> exit


SQL> set lines 999;

col diskgroup for a10

col diskname for a12

col path for a30

select a.name DiskGroup,b.name DiskName, b.total_mb, (b.total_mb-b.free_mb) Used_MB, b.free_mb,b.path,b.header_status from v$asm_disk b, v$asm_diskgroup a where a.group_number (+) =b.group_number order by b.group_number,b.name;SQL> SQL> SQL> SQL> SQL> SQL> SQL> SQL> 

DISKGROUP  DISKNAME   TOTAL_MB    USED_MB FREE_MB PATH HEADER_STATU
---------- ------------ ---------- ---------- ---------- ------------------------------ ------------
0     0        0 /dev/oracleasm/disks/BACKUP PROVISIONED
CRS    CRS_0000      43004 34084     8920 /dev/oracleasm/disks/CRS MEMBER
DATA    DATA_0000      20476   176    20300 /dev/oracleasm/disks/DATA MEMBER
FRA    FRA_0000      20476 4884    15592 /dev/oracleasm/disks/FRA MEMBER

SQL> 


SQL> set pages 40000 lines 120

col PATH for a30

select DISK_NUMBER,MOUNT_STATUS,HEADER_STATUS,MODE_STATUS,STATE,PATH FROM V$ASM_DISK;SQL> SQL> SQL> SQL> 

DISK_NUMBER MOUNT_S HEADER_STATU MODE_ST STATE   PATH
----------- ------- ------------ ------- -------- ------------------------------
  0 CLOSED  PROVISIONED  ONLINE  NORMAL   /dev/oracleasm/disks/BACKUP
  0 CACHED  MEMBER ONLINE  NORMAL   /dev/oracleasm/disks/CRS
  0 CACHED  MEMBER ONLINE  NORMAL   /dev/oracleasm/disks/FRA
  0 CACHED  MEMBER ONLINE  NORMAL   /dev/oracleasm/disks/DATA



SQL> sho parameter ASM_DISKSTRING

NAME      TYPE VALUE
------------------------------------ ----------- ------------------------------
asm_diskstring      string /dev/oracleasm/disks

  • Create diskgroup backup with external redundancy 
SQL> create diskgroup Backup external redundancy disk '/dev/oracleasm/disks/BACKUP' name backup;

Diskgroup created.

SQL> select DISK_NUMBER,MOUNT_STATUS,HEADER_STATUS,MODE_STATUS,STATE,PATH FROM V$ASM_DISK;

DISK_NUMBER MOUNT_S HEADER_STATU MODE_ST STATE   PATH
----------- ------- ------------ ------- -------- ------------------------------
  0 CACHED  MEMBER ONLINE  NORMAL   /dev/oracleasm/disks/CRS
  0 CACHED  MEMBER ONLINE  NORMAL   /dev/oracleasm/disks/FRA
  0 CACHED  MEMBER ONLINE  NORMAL   /dev/oracleasm/disks/DATA
  0 CACHED  MEMBER ONLINE  NORMAL   /dev/oracleasm/disks/BACKUP

  • Check ASM diskgroup status 
SQL> select a.name DiskGroup,b.name DiskName, b.total_mb, (b.total_mb-b.free_mb) Used_MB, b.free_mb,b.path,b.header_status from v$asm_disk b, v$asm_diskgroup a where a.group_number (+) =b.group_number order by b.group_number,b.name;

DISKGROUP  DISKNAME   TOTAL_MB    USED_MB FREE_MB PATH HEADER_STATU
---------- ------------ ---------- ---------- ---------- ------------------------------ ------------
CRS    CRS_0000      43004 34084     8920 /dev/oracleasm/disks/CRS MEMBER
DATA    DATA_0000      20476   176    20300 /dev/oracleasm/disks/DATA MEMBER
FRA    FRA_0000      20476 4884    15592 /dev/oracleasm/disks/FRA MEMBER
BACKUP    BACKUP      15359    52    15307 /dev/oracleasm/disks/BACKUP MEMBER

SQL> 


SQL>  select state,name,type from v$asm_diskgroup;

STATE     NAME    TYPE
----------- ------------------------------ ------
MOUNTED     CRS    EXTERN
MOUNTED     DATA    EXTERN
MOUNTED     FRA    EXTERN
MOUNTED     BACKUP    EXTERN

  • Now if any real time scenario if voting disk got crashed or some hardware failure in vote disk stop all cluster services forcefully below. 
[root@srv2 ~]# crsctl stop crs -f 
CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'srv2'
CRS-2673: Attempting to stop 'ora.crsd' on 'srv2'
CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on server 'srv2'
CRS-2673: Attempting to stop 'ora.chad' on 'srv2'
CRS-2673: Attempting to stop 'ora.rac.db' on 'srv2'
CRS-2677: Stop of 'ora.rac.db' on 'srv2' succeeded
CRS-2673: Attempting to stop 'ora.DATA.dg' on 'srv2'
CRS-2673: Attempting to stop 'ora.CRS.dg' on 'srv2'
CRS-2673: Attempting to stop 'ora.FRA.dg' on 'srv2'
CRS-2673: Attempting to stop 'ora.LISTENER.lsnr' on 'srv2'
CRS-2673: Attempting to stop 'ora.LISTENER_SCAN1.lsnr' on 'srv2'
CRS-2677: Stop of 'ora.FRA.dg' on 'srv2' succeeded
CRS-2677: Stop of 'ora.DATA.dg' on 'srv2' succeeded
CRS-2677: Stop of 'ora.CRS.dg' on 'srv2' succeeded
CRS-2673: Attempting to stop 'ora.asm' on 'srv2'
CRS-2677: Stop of 'ora.LISTENER.lsnr' on 'srv2' succeeded
CRS-2673: Attempting to stop 'ora.srv2.vip' on 'srv2'
CRS-2677: Stop of 'ora.LISTENER_SCAN1.lsnr' on 'srv2' succeeded
CRS-2673: Attempting to stop 'ora.scan1.vip' on 'srv2'
CRS-2677: Stop of 'ora.asm' on 'srv2' succeeded
CRS-2673: Attempting to stop 'ora.ASMNET1LSNR_ASM.lsnr' on 'srv2'
CRS-2677: Stop of 'ora.scan1.vip' on 'srv2' succeeded
CRS-2677: Stop of 'ora.srv2.vip' on 'srv2' succeeded
CRS-2677: Stop of 'ora.chad' on 'srv2' succeeded
CRS-2677: Stop of 'ora.ASMNET1LSNR_ASM.lsnr' on 'srv2' succeeded
CRS-2672: Attempting to start 'ora.scan1.vip' on 'srv1'
CRS-2672: Attempting to start 'ora.srv2.vip' on 'srv1'
CRS-2676: Start of 'ora.srv2.vip' on 'srv1' succeeded
CRS-2676: Start of 'ora.scan1.vip' on 'srv1' succeeded
CRS-2672: Attempting to start 'ora.LISTENER_SCAN1.lsnr' on 'srv1'
CRS-2676: Start of 'ora.LISTENER_SCAN1.lsnr' on 'srv1' succeeded
CRS-2673: Attempting to stop 'ora.ons' on 'srv2'
CRS-2677: Stop of 'ora.ons' on 'srv2' succeeded
CRS-2673: Attempting to stop 'ora.net1.network' on 'srv2'
CRS-2677: Stop of 'ora.net1.network' on 'srv2' succeeded
CRS-2792: Shutdown of Cluster Ready Services-managed resources on 'srv2' has completed
CRS-2677: Stop of 'ora.crsd' on 'srv2' succeeded
CRS-2673: Attempting to stop 'ora.storage' on 'srv2'
CRS-2673: Attempting to stop 'ora.crf' on 'srv2'
CRS-2673: Attempting to stop 'ora.gpnpd' on 'srv2'
CRS-2673: Attempting to stop 'ora.mdnsd' on 'srv2'
CRS-2677: Stop of 'ora.crf' on 'srv2' succeeded
CRS-2677: Stop of 'ora.gpnpd' on 'srv2' succeeded
CRS-2677: Stop of 'ora.storage' on 'srv2' succeeded
CRS-2673: Attempting to stop 'ora.asm' on 'srv2'
CRS-2677: Stop of 'ora.mdnsd' on 'srv2' succeeded
CRS-2677: Stop of 'ora.asm' on 'srv2' succeeded
CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'srv2'
CRS-2677: Stop of 'ora.cluster_interconnect.haip' on 'srv2' succeeded
CRS-2673: Attempting to stop 'ora.ctssd' on 'srv2'
CRS-2673: Attempting to stop 'ora.evmd' on 'srv2'
CRS-2677: Stop of 'ora.ctssd' on 'srv2' succeeded
CRS-2677: Stop of 'ora.evmd' on 'srv2' succeeded
CRS-2673: Attempting to stop 'ora.cssd' on 'srv2'
CRS-2677: Stop of 'ora.cssd' on 'srv2' succeeded
CRS-2673: Attempting to stop 'ora.gipcd' on 'srv2'
CRS-2677: Stop of 'ora.gipcd' on 'srv2' succeeded
CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'srv2' has completed
CRS-4133: Oracle High Availability Services has been stopped.

  • Disable auto-start  CRS service in case  for OS reboot 

[root@srv2 ~]# crsctl disable crs
CRS-4621: Oracle High Availability Services autostart is disabled.

  • Start crs service with exclusive mode with no crs services 


Usage:
  crsctl start crs [-excl [-nocrs | -cssonly]] | [-wait | -waithas | -nowait] | [-noautostart]
     Start OHAS on this server
where
     -excl        Start Oracle Clusterware in exclusive mode
     -nocrs       Start Oracle Clusterware in exclusive mode without starting CRS
     -nowait      Do not wait for OHAS to start
     -wait        Wait until startup is complete and display all progress and status messages
     -waithas     Wait until startup is complete and display OHASD progress and status messages
     -cssonly     Start only CSS
     -noautostart Start only OHAS


[root@srv2 ~]# crsctl start crs -excl -nocrs
CRS-4123: Oracle High Availability Services has been started.
CRS-2672: Attempting to start 'ora.evmd' on 'srv2'
CRS-2672: Attempting to start 'ora.mdnsd' on 'srv2'
CRS-2676: Start of 'ora.mdnsd' on 'srv2' succeeded
CRS-2676: Start of 'ora.evmd' on 'srv2' succeeded
CRS-2672: Attempting to start 'ora.gpnpd' on 'srv2'
CRS-2676: Start of 'ora.gpnpd' on 'srv2' succeeded
CRS-2672: Attempting to start 'ora.cssdmonitor' on 'srv2'
CRS-2672: Attempting to start 'ora.gipcd' on 'srv2'
CRS-2676: Start of 'ora.cssdmonitor' on 'srv2' succeeded
CRS-2676: Start of 'ora.gipcd' on 'srv2' succeeded
CRS-2672: Attempting to start 'ora.cssd' on 'srv2'
CRS-2672: Attempting to start 'ora.diskmon' on 'srv2'
CRS-2676: Start of 'ora.diskmon' on 'srv2' succeeded
CRS-2676: Start of 'ora.cssd' on 'srv2' succeeded
CRS-2672: Attempting to start 'ora.cluster_interconnect.haip' on 'srv2'
CRS-2672: Attempting to start 'ora.ctssd' on 'srv2'
CRS-2676: Start of 'ora.ctssd' on 'srv2' succeeded
CRS-2676: Start of 'ora.cluster_interconnect.haip' on 'srv2' succeeded
CRS-2672: Attempting to start 'ora.asm' on 'srv2'
CRS-2676: Start of 'ora.asm' on 'srv2' succeeded


[root@srv2 ~]# crsctl query css votedisk
##  STATE    File Universal Id                File Name Disk group
--  -----    -----------------                --------- ---------
 1. ONLINE   89ccb666fba84f48bffd99f68cc37d9a (/dev/oracleasm/disks/CRS) [CRS]
Located 1 voting disk(s).
  • Replace votedisk with new diskgroup. We can place votedisk with same OCR location.

[root@srv2 ~]# crsctl replace votedisk +backup
Successful addition of voting disk 6fc2ec78a9024fc2bf02824b67e7da7c.
Successful deletion of voting disk 89ccb666fba84f48bffd99f68cc37d9a.
Successfully replaced voting disk group with +backup.
CRS-4266: Voting file(s) successfully replaced

  • Stop current Cluster Synchronization Services

[root@srv2 ~]# crsctl stop crs
Unable to communicate with the Cluster Synchronization Services daemon.
  • Start CRS service on all nodes 
[root@srv2 ~]# crsctl start cluster -all
CRS-4639: Could not contact Oracle High Availability Services
CRS-4000: Command Start failed, or completed with errors.

[root@srv2 ~]# crsctl start crs
CRS-4123: Oracle High Availability Services has been started.

[root@srv2 ~]# crsctl query css votedisk
##  STATE    File Universal Id                File Name Disk group
--  -----    -----------------                --------- ---------
 1. ONLINE   6fc2ec78a9024fc2bf02824b67e7da7c (/dev/oracleasm/disks/BACKUP) [BACKUP]
Located 1 voting disk(s).
[root@srv2 ~]# 
  • Check all clusterware services 

[root@srv2 ~]# crsctl status resource -t
--------------------------------------------------------------------------------
Name           Target  State        Server                   State details       
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.ASMNET1LSNR_ASM.lsnr
               ONLINE  ONLINE       srv1                     STABLE
               ONLINE  ONLINE       srv2                     STABLE
ora.BACKUP.dg
               ONLINE  ONLINE       srv1                     STABLE
               ONLINE  ONLINE       srv2                     STABLE
ora.CRS.dg
               ONLINE  ONLINE       srv1                     STABLE
               ONLINE  ONLINE       srv2                     STABLE
ora.DATA.dg
               ONLINE  ONLINE       srv1                     STABLE
               ONLINE  ONLINE       srv2                     STABLE
ora.FRA.dg
               ONLINE  ONLINE       srv1                     STABLE
               ONLINE  ONLINE       srv2                     STABLE
ora.LISTENER.lsnr
               ONLINE  ONLINE       srv1                     STABLE
               ONLINE  ONLINE       srv2                     STABLE
ora.chad
               ONLINE  ONLINE       srv1                     STABLE
               ONLINE  ONLINE       srv2                     STABLE
ora.net1.network
               ONLINE  ONLINE       srv1                     STABLE
               ONLINE  ONLINE       srv2                     STABLE
ora.ons
               ONLINE  ONLINE       srv1                     STABLE
               ONLINE  ONLINE       srv2                     STABLE
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.LISTENER_SCAN1.lsnr
      1        ONLINE  ONLINE       srv1                     STABLE
ora.LISTENER_SCAN2.lsnr
      1        ONLINE  ONLINE       srv2                     STABLE
ora.LISTENER_SCAN3.lsnr
      1        ONLINE  ONLINE       srv2                     STABLE
ora.MGMTLSNR
      1        ONLINE  ONLINE       srv2                     169.254.238.221 192.
                                                             168.10.2,STABLE
ora.asm
      1        ONLINE  ONLINE       srv1                     Started,STABLE
      2        ONLINE  ONLINE       srv2                     Started,STABLE
      3        ONLINE  OFFLINE                               STABLE
ora.cvu
      1        ONLINE  ONLINE       srv2                     STABLE
ora.mgmtdb
      1        ONLINE  ONLINE       srv2                     Open,STABLE
ora.qosmserver
      1        ONLINE  ONLINE       srv2                     STABLE
ora.rac.db
      1        ONLINE  ONLINE       srv1                     Open,HOME=/u01/app/o
                                                             racle/product/12.2.0
                                                             /db_1,STABLE
      2        ONLINE  ONLINE       srv2                     Open,HOME=/u01/app/o
                                                             racle/product/12.2.0
                                                             /db_1,STABLE
      3        ONLINE  OFFLINE                               STABLE
ora.scan1.vip
      1        ONLINE  ONLINE       srv1                     STABLE
ora.scan2.vip
      1        ONLINE  ONLINE       srv2                     STABLE
ora.scan3.vip
      1        ONLINE  ONLINE       srv2                     STABLE
ora.srv1.vip
      1        ONLINE  ONLINE       srv1                     STABLE
ora.srv2.vip
      1        ONLINE  ONLINE       srv2                     STABLE
ora.srv3.vip
      1        ONLINE  INTERMEDIATE srv2                     FAILED OVER,STABLE
--------------------------------------------------------------------------------

  • Now Start node 3 and check vote disk status 
[root@srv2 ~]# ssh srv3
root@srv3's password: 
Last login: Tue Nov  2 16:13:08 2021 from srv1.example.com
[root@srv3 ~]# . oraenv
ORACLE_SID = [root] ? +ASM3
The Oracle base has been set to /u01/app/grid
[root@srv3 ~]# crsctl query css votedisk
##  STATE    File Universal Id                File Name Disk group
--  -----    -----------------                --------- ---------
 1. ONLINE   6fc2ec78a9024fc2bf02824b67e7da7c (/dev/oracleasm/disks/BACKUP) [BACKUP]
Located 1 voting disk(s).
[root@srv3 ~]# olsnodes
srv1
srv2
srv3

  • Check clusrtware status from node 3
[root@srv3 ~]# crsctl check cluster -all
**************************************************************
srv1:
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online
**************************************************************
srv2:
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online
**************************************************************
srv3:
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online
**************************************************************

[root@srv3 ~]# crsctl status resource -t
--------------------------------------------------------------------------------
Name           Target  State        Server                   State details       
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.ASMNET1LSNR_ASM.lsnr
               ONLINE  ONLINE       srv1                     STABLE
               ONLINE  ONLINE       srv2                     STABLE
               ONLINE  ONLINE       srv3                     STABLE
ora.BACKUP.dg
               ONLINE  ONLINE       srv1                     STABLE
               ONLINE  ONLINE       srv2                     STABLE
               ONLINE  ONLINE       srv3                     STABLE
ora.CRS.dg
               ONLINE  ONLINE       srv1                     STABLE
               ONLINE  ONLINE       srv2                     STABLE
               ONLINE  ONLINE       srv3                     STABLE
ora.DATA.dg
               ONLINE  ONLINE       srv1                     STABLE
               ONLINE  ONLINE       srv2                     STABLE
               ONLINE  ONLINE       srv3                     STABLE
ora.FRA.dg
               ONLINE  ONLINE       srv1                     STABLE
               ONLINE  ONLINE       srv2                     STABLE
               ONLINE  ONLINE       srv3                     STABLE
ora.LISTENER.lsnr
               ONLINE  ONLINE       srv1                     STABLE
               ONLINE  ONLINE       srv2                     STABLE
               ONLINE  ONLINE       srv3                     STABLE
ora.chad
               ONLINE  ONLINE       srv1                     STABLE
               ONLINE  ONLINE       srv2                     STABLE
               OFFLINE OFFLINE      srv3                     STABLE
ora.net1.network
               ONLINE  ONLINE       srv1                     STABLE
               ONLINE  ONLINE       srv2                     STABLE
               ONLINE  ONLINE       srv3                     STABLE
ora.ons
               ONLINE  ONLINE       srv1                     STABLE
               ONLINE  ONLINE       srv2                     STABLE
               ONLINE  ONLINE       srv3                     STABLE
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.LISTENER_SCAN1.lsnr
      1        ONLINE  ONLINE       srv1                     STABLE
ora.LISTENER_SCAN2.lsnr
      1        ONLINE  ONLINE       srv2                     STABLE
ora.LISTENER_SCAN3.lsnr
      1        ONLINE  ONLINE       srv3                     STABLE
ora.MGMTLSNR
      1        ONLINE  ONLINE       srv3                     169.254.187.26 192.1
                                                             68.10.3,STABLE
ora.asm
      1        ONLINE  ONLINE       srv1                     Started,STABLE
      2        ONLINE  ONLINE       srv2                     Started,STABLE
      3        ONLINE  ONLINE       srv3                     Started,STABLE
ora.cvu
      1        ONLINE  ONLINE       srv3                     STABLE
ora.mgmtdb
      1        ONLINE  ONLINE       srv3                     Open,STABLE
ora.qosmserver
      1        ONLINE  ONLINE       srv3                     STABLE
ora.rac.db
      1        ONLINE  ONLINE       srv1                     Open,HOME=/u01/app/o
                                                             racle/product/12.2.0
                                                             /db_1,STABLE
      2        ONLINE  ONLINE       srv2                     Open,HOME=/u01/app/o
                                                             racle/product/12.2.0
                                                             /db_1,STABLE
      3        ONLINE  ONLINE       srv3                     Open,HOME=/u01/app/o
                                                             racle/product/12.2.0
                                                             /db_1,STABLE
ora.scan1.vip
      1        ONLINE  ONLINE       srv1                     STABLE
ora.scan2.vip
      1        ONLINE  ONLINE       srv2                     STABLE
ora.scan3.vip
      1        ONLINE  ONLINE       srv3                     STABLE
ora.srv1.vip
      1        ONLINE  ONLINE       srv1                     STABLE
ora.srv2.vip
      1        ONLINE  ONLINE       srv2                     STABLE
ora.srv3.vip
      1        ONLINE  ONLINE       srv3                     STABLE
--------------------------------------------------------------------------------





Posted by at No comments:
Labels:

Wednesday 27 October 2021

RAC - Add grid 3rd node and oracle instance in 12.2 grid cluster

RAC - Add grid 3rd node and oracle instance in 12.2 grid cluster 

Operating System OEL 7.8

2 node Grid RAC - rac1,rac2 instance 

Version : 12.2.0

Adding rac3 instance 

hostname : srv1.example.com, srv2.example.com, srv3.example.com.

Grid Level user

  •  Add new public, private and vip  IP address in all hosts.
  • Add  required package and pre  requestors on new grid and oracle instance .
  • Check scan IP nslookup at new node
  • Check oracleasm storage configuration (oracleasm listdisks)
  • Make passwordless ssh connection to oracle and grid user to new host.
  • Run cluster verify utility of new node . (if all passed proceed further to add node)
  • Run add node silently or using GUI
  • Run root.sh
Oracle Level user
  • Add node sh file on oracle and run root.sh
  • Add instance using dbca from master node or existing instance not from new instance 


 

  •  Add passwordless shh connection for oracle user

[root@srv1 sshsetup]# ./sshUserSetup.sh -user oracle -hosts "srv1 srv2 srv3" -advanced -exverify –noPromptPassphrase
  • Add passwordless shh connection for grid user 

[root@srv1 sshsetup]# ./sshUserSetup.sh -user grid -hosts "srv1 srv2 srv3" -advanced -exverify –noPromptPassphrase
  • Check cluvfy utility and if any issue found fix prequestories 

[grid@srv1 bin]$ cluvfy stage -pre nodeadd -n srv3 -fixup -fixupnoexec

  • Existing information of clusterware resource 
[grid@srv1 bin]$ crsctl status resource -t
--------------------------------------------------------------------------------
Name           Target  State        Server                   State details       
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.ASMNET1LSNR_ASM.lsnr
               ONLINE  ONLINE       srv1                     STABLE
               ONLINE  ONLINE       srv2                     STABLE
ora.CRS.dg
               ONLINE  ONLINE       srv1                     STABLE
               ONLINE  ONLINE       srv2                     STABLE
ora.DATA.dg
               ONLINE  ONLINE       srv1                     STABLE
               ONLINE  ONLINE       srv2                     STABLE
ora.FRA.dg
               ONLINE  ONLINE       srv1                     STABLE
               ONLINE  ONLINE       srv2                     STABLE
ora.LISTENER.lsnr
               ONLINE  ONLINE       srv1                     STABLE
               ONLINE  ONLINE       srv2                     STABLE
ora.chad
               ONLINE  ONLINE       srv1                     STABLE
               ONLINE  ONLINE       srv2                     STABLE
ora.net1.network
               ONLINE  ONLINE       srv1                     STABLE
               ONLINE  ONLINE       srv2                     STABLE
ora.ons
               ONLINE  ONLINE       srv1                     STABLE
               ONLINE  ONLINE       srv2                     STABLE
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.LISTENER_SCAN1.lsnr
      1        ONLINE  ONLINE       srv1                     STABLE
ora.LISTENER_SCAN2.lsnr
      1        ONLINE  ONLINE       srv2                     STABLE
ora.LISTENER_SCAN3.lsnr
      1        ONLINE  ONLINE       srv2                     STABLE
ora.MGMTLSNR
      1        ONLINE  ONLINE       srv2                     169.254.238.221 192.
                                                             168.10.2,STABLE
ora.asm
      1        ONLINE  ONLINE       srv1                     Started,STABLE
      2        ONLINE  ONLINE       srv2                     Started,STABLE
      3        OFFLINE OFFLINE                               STABLE
ora.cvu
      1        ONLINE  ONLINE       srv2                     STABLE
ora.mgmtdb
      1        ONLINE  ONLINE       srv2                     Open,STABLE
ora.qosmserver
      1        ONLINE  ONLINE       srv2                     STABLE
ora.rac.db
      1        ONLINE  ONLINE       srv1                     Open,HOME=/u01/app/o
                                                             racle/product/12.2.0
                                                             /db_1,STABLE
      2        ONLINE  ONLINE       srv2                     Open,HOME=/u01/app/o
                                                             racle/product/12.2.0
                                                             /db_1,STABLE
ora.scan1.vip
      1        ONLINE  ONLINE       srv1                     STABLE
ora.scan2.vip
      1        ONLINE  ONLINE       srv2                     STABLE
ora.scan3.vip
      1        ONLINE  ONLINE       srv2                     STABLE
ora.srv1.vip
      1        ONLINE  ONLINE       srv1                     STABLE
ora.srv2.vip
      1        ONLINE  ONLINE       srv2                     STABLE
--------------------------------------------------------------------------------
[grid@srv1 bin]$ 
[grid@srv1 bin]$ cat /etc/hosts
127.0.0.1   localhost.localdomain localhost
# Public
192.168.56.71   srv1.example.com        srv1
192.168.56.72   srv2.example.com        srv2
192.168.56.73   srv3.example.com        srv3
192.168.56.74   srv4.example.com        srv4
# Private
192.168.10.1    srv1-priv.example.com   srv1-priv
192.168.10.2    srv2-priv.example.com   srv2-priv
192.168.10.3    srv3-priv.example.com   srv3-priv
192.168.10.4    srv4-priv.example.com   srv4-priv

# Virtual
192.168.56.81   srv1-vip.example.com    srv1-vip
192.168.56.82   srv2-vip.example.com    srv2-vip
192.168.56.83   srv3-vip.example.com    srv3-vip
192.168.56.84   srv4-vip.example.com    srv4-vip

# SCAN (in production this should be configured in DNS)
192.168.56.91   srv-scan.example.com    srv-scan
192.168.56.92   srv-scan.example.com    srv-scan
192.168.56.93   srv-scan.example.com    srv-scan

  • Add node using commands prompt using slient installation

[grid@srv1 addnode]$ ./addnode.sh -silent "CLUSTER_NEW_NODES={srv3}" "CLUSTER_NEW_VIRTUAL_HOSTNAMES={srv3-vip}" "CLUSTER_NEW_NODE_ROLES={HUB}"

  • Using GUI adding node
[grid@srv1 addnode]$ ./addnode.sh

















  • Run root.sh scripts  ( root user)
  
 [root@srv3 ~]# /u01/app/12.2.0/grid/root.sh
Performing root user operation.

The following environment variables are set as:
    ORACLE_OWNER= grid
    ORACLE_HOME=  /u01/app/12.2.0/grid

Enter the full pathname of the local bin directory: [/usr/local/bin]: 
   Copying dbhome to /usr/local/bin ...
   Copying oraenv to /usr/local/bin ...
   Copying coraenv to /usr/local/bin ...

Entries will be added to the /etc/oratab file as needed by
Database Configuration Assistant when a database is created
Finished running generic part of root script.
Now product-specific root actions will be performed.
Relinking oracle with rac_on option

Using configuration parameter file: /u01/app/12.2.0/grid/crs/install/crsconfig_params
The log of current session can be found at:
  /u01/app/grid/crsdata/srv3/crsconfig/rootcrs_srv3_2021-10-24_10-25-34PM.log

2021/10/24 22:26:41 CLSRSC-594: Executing installation step 1 of 19: 'SetupTFA'.
2021/10/24 22:26:41 CLSRSC-4001: Installing Oracle Trace File Analyzer (TFA) Collector.
2021/10/24 22:27:11 CLSRSC-4002: Successfully installed Oracle Trace File Analyzer (TFA) Collector.
2021/10/24 22:27:11 CLSRSC-594: Executing installation step 2 of 19: 'ValidateEnv'.
2021/10/24 22:27:13 CLSRSC-363: User ignored prerequisites during installation
2021/10/24 22:27:13 CLSRSC-594: Executing installation step 3 of 19: 'CheckFirstNode'.
2021/10/24 22:27:14 CLSRSC-594: Executing installation step 4 of 19: 'GenSiteGUIDs'.
2021/10/24 22:27:17 CLSRSC-594: Executing installation step 5 of 19: 'SaveParamFile'.
2021/10/24 22:27:20 CLSRSC-594: Executing installation step 6 of 19: 'SetupOSD'.
2021/10/24 22:27:21 CLSRSC-594: Executing installation step 7 of 19: 'CheckCRSConfig'.
2021/10/24 22:27:22 CLSRSC-594: Executing installation step 8 of 19: 'SetupLocalGPNP'.
2021/10/24 22:27:23 CLSRSC-594: Executing installation step 9 of 19: 'ConfigOLR'.
2021/10/24 22:27:37 CLSRSC-594: Executing installation step 10 of 19: 'ConfigCHMOS'.
2021/10/24 22:27:37 CLSRSC-594: Executing installation step 11 of 19: 'CreateOHASD'.
2021/10/24 22:27:38 CLSRSC-594: Executing installation step 12 of 19: 'ConfigOHASD'.
2021/10/24 22:27:54 CLSRSC-330: Adding Clusterware entries to file 'oracle-ohasd.service'
2021/10/24 22:28:43 CLSRSC-594: Executing installation step 13 of 19: 'InstallAFD'.
2021/10/24 22:28:44 CLSRSC-594: Executing installation step 14 of 19: 'InstallACFS'.
CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'srv3'
CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'srv3' has completed
CRS-4133: Oracle High Availability Services has been stopped.
CRS-4123: Oracle High Availability Services has been started.
2021/10/24 22:29:11 CLSRSC-594: Executing installation step 15 of 19: 'InstallKA'.
2021/10/24 22:29:12 CLSRSC-594: Executing installation step 16 of 19: 'InitConfig'.
CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'srv3'
CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'srv3' has completed
CRS-4133: Oracle High Availability Services has been stopped.
CRS-4123: Oracle High Availability Services has been started.
CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'srv3'
CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'srv3' has completed
CRS-4133: Oracle High Availability Services has been stopped.
2021/10/24 22:29:46 CLSRSC-594: Executing installation step 17 of 19: 'StartCluster'.
CRS-4123: Starting Oracle High Availability Services-managed resources
CRS-2672: Attempting to start 'ora.evmd' on 'srv3'
CRS-2672: Attempting to start 'ora.mdnsd' on 'srv3'
CRS-2676: Start of 'ora.mdnsd' on 'srv3' succeeded
CRS-2676: Start of 'ora.evmd' on 'srv3' succeeded
CRS-2672: Attempting to start 'ora.gpnpd' on 'srv3'
CRS-2676: Start of 'ora.gpnpd' on 'srv3' succeeded
CRS-2672: Attempting to start 'ora.gipcd' on 'srv3'
CRS-2676: Start of 'ora.gipcd' on 'srv3' succeeded
CRS-2672: Attempting to start 'ora.cssdmonitor' on 'srv3'
CRS-2676: Start of 'ora.cssdmonitor' on 'srv3' succeeded
CRS-2672: Attempting to start 'ora.cssd' on 'srv3'
CRS-2672: Attempting to start 'ora.diskmon' on 'srv3'
CRS-2676: Start of 'ora.diskmon' on 'srv3' succeeded
CRS-2676: Start of 'ora.cssd' on 'srv3' succeeded
CRS-2672: Attempting to start 'ora.cluster_interconnect.haip' on 'srv3'
CRS-2672: Attempting to start 'ora.ctssd' on 'srv3'
CRS-2676: Start of 'ora.ctssd' on 'srv3' succeeded
CRS-2676: Start of 'ora.cluster_interconnect.haip' on 'srv3' succeeded
CRS-2672: Attempting to start 'ora.asm' on 'srv3'
CRS-2676: Start of 'ora.asm' on 'srv3' succeeded
CRS-2672: Attempting to start 'ora.storage' on 'srv3'
CRS-2676: Start of 'ora.storage' on 'srv3' succeeded
CRS-2672: Attempting to start 'ora.crf' on 'srv3'
CRS-2676: Start of 'ora.crf' on 'srv3' succeeded
CRS-2672: Attempting to start 'ora.crsd' on 'srv3'
CRS-2676: Start of 'ora.crsd' on 'srv3' succeeded
CRS-6017: Processing resource auto-start for servers: srv3
CRS-2673: Attempting to stop 'ora.LISTENER_SCAN2.lsnr' on 'srv2'
CRS-2672: Attempting to start 'ora.net1.network' on 'srv3'
CRS-2672: Attempting to start 'ora.chad' on 'srv3'
CRS-2672: Attempting to start 'ora.ASMNET1LSNR_ASM.lsnr' on 'srv3'
CRS-2677: Stop of 'ora.LISTENER_SCAN2.lsnr' on 'srv2' succeeded
CRS-2676: Start of 'ora.net1.network' on 'srv3' succeeded
CRS-2673: Attempting to stop 'ora.scan2.vip' on 'srv2'
CRS-2672: Attempting to start 'ora.ons' on 'srv3'
CRS-2676: Start of 'ora.chad' on 'srv3' succeeded
CRS-2677: Stop of 'ora.scan2.vip' on 'srv2' succeeded
CRS-2672: Attempting to start 'ora.scan2.vip' on 'srv3'
CRS-2676: Start of 'ora.scan2.vip' on 'srv3' succeeded
CRS-2672: Attempting to start 'ora.LISTENER_SCAN2.lsnr' on 'srv3'
CRS-2676: Start of 'ora.ons' on 'srv3' succeeded
CRS-2676: Start of 'ora.ASMNET1LSNR_ASM.lsnr' on 'srv3' succeeded
CRS-2672: Attempting to start 'ora.asm' on 'srv3'
CRS-2676: Start of 'ora.LISTENER_SCAN2.lsnr' on 'srv3' succeeded
CRS-2676: Start of 'ora.asm' on 'srv3' succeeded
CRS-2672: Attempting to start 'ora.FRA.dg' on 'srv3'
CRS-2676: Start of 'ora.FRA.dg' on 'srv3' succeeded
CRS-6016: Resource auto-start has completed for server srv3
CRS-6024: Completed start of Oracle Cluster Ready Services-managed resources
CRS-4123: Oracle High Availability Services has been started.
2021/10/24 22:32:51 CLSRSC-343: Successfully started Oracle Clusterware stack
2021/10/24 22:32:51 CLSRSC-594: Executing installation step 18 of 19: 'ConfigNode'.
clscfg: EXISTING configuration version 5 detected.
clscfg: version 5 is 12c Release 2.
Successfully accumulated necessary OCR keys.
Creating OCR keys for user 'root', privgrp 'root'..
Operation successful.
2021/10/24 22:33:10 CLSRSC-594: Executing installation step 19 of 19: 'PostConfig'.
2021/10/24 22:33:23 CLSRSC-325: Configure Oracle Grid Infrastructure for a Cluster ... succeeded

    
  [root@srv3 ~]# 


  • Clusterware status 

[root@srv1 addnode]# crsctl status resource -t
--------------------------------------------------------------------------------
Name           Target  State        Server                   State details       
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.ASMNET1LSNR_ASM.lsnr
               ONLINE  ONLINE       srv1                     STABLE
               ONLINE  ONLINE       srv2                     STABLE
               ONLINE  ONLINE       srv3                     STABLE
ora.CRS.dg
               ONLINE  ONLINE       srv1                     STABLE
               ONLINE  ONLINE       srv2                     STABLE
               ONLINE  ONLINE       srv3                     STABLE
ora.DATA.dg
               ONLINE  ONLINE       srv1                     STABLE
               ONLINE  ONLINE       srv2                     STABLE
               ONLINE  ONLINE       srv3                     STABLE
ora.FRA.dg
               ONLINE  ONLINE       srv1                     STABLE
               ONLINE  ONLINE       srv2                     STABLE
               ONLINE  ONLINE       srv3                     STABLE
ora.LISTENER.lsnr
               ONLINE  ONLINE       srv1                     STABLE
               ONLINE  ONLINE       srv2                     STABLE
               ONLINE  ONLINE       srv3                     STABLE
ora.chad
               ONLINE  ONLINE       srv1                     STABLE
               ONLINE  ONLINE       srv2                     STABLE
               ONLINE  ONLINE       srv3                     STABLE
ora.net1.network
               ONLINE  ONLINE       srv1                     STABLE
               ONLINE  ONLINE       srv2                     STABLE
               ONLINE  ONLINE       srv3                     STABLE
ora.ons
               ONLINE  ONLINE       srv1                     STABLE
               ONLINE  ONLINE       srv2                     STABLE
               ONLINE  ONLINE       srv3                     STABLE
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.LISTENER_SCAN1.lsnr
      1        ONLINE  ONLINE       srv1                     STABLE
ora.LISTENER_SCAN2.lsnr
      1        ONLINE  ONLINE       srv3                     STABLE
ora.LISTENER_SCAN3.lsnr
      1        ONLINE  ONLINE       srv2                     STABLE
ora.MGMTLSNR
      1        ONLINE  ONLINE       srv2                     169.254.238.221 192.
                                                             168.10.2,STABLE
ora.asm
      1        ONLINE  ONLINE       srv1                     Started,STABLE
      2        ONLINE  ONLINE       srv2                     Started,STABLE
      3        ONLINE  ONLINE       srv3                     Started,STABLE
ora.cvu
      1        ONLINE  ONLINE       srv2                     STABLE
ora.mgmtdb
      1        ONLINE  ONLINE       srv2                     Open,STABLE
ora.qosmserver
      1        ONLINE  ONLINE       srv2                     STABLE
ora.rac.db
      1        ONLINE  ONLINE       srv1                     Open,HOME=/u01/app/o
                                                             racle/product/12.2.0
                                                             /db_1,STABLE
      2        ONLINE  ONLINE       srv2                     Open,HOME=/u01/app/o
                                                             racle/product/12.2.0
                                                             /db_1,STABLE
ora.scan1.vip
      1        ONLINE  ONLINE       srv1                     STABLE
ora.scan2.vip
      1        ONLINE  ONLINE       srv3                     STABLE
ora.scan3.vip
      1        ONLINE  ONLINE       srv2                     STABLE
ora.srv1.vip
      1        ONLINE  ONLINE       srv1                     STABLE
ora.srv2.vip
      1        ONLINE  ONLINE       srv2                     STABLE
ora.srv3.vip
      1        ONLINE  ONLINE       srv3                     STABLE
--------------------------------------------------------------------------------


[root@srv1 addnode]# olsnodes -n -i -t
srv1 1 srv1-vip.example.com Unpinned
srv2 2 srv2-vip.example.com Unpinned
srv3 3 srv3-vip.example.com Unpinned
[root@srv1 addnode]# 

[root@srv1 addnode]#  crsctl check cluster -all
**************************************************************
srv1:
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online
**************************************************************
srv2:
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online
**************************************************************
srv3:
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online
**************************************************************

  • Add instance using oracle user 
[oracle@srv1 db_1]$ cd addnode/
[oracle@srv1 addnode]$ pwd
/u01/app/oracle/product/12.2.0/db_1/addnode
[oracle@srv1 addnode]$ 


[oracle@srv1 addnode]$ ./addnode.sh 
Starting Oracle Universal Installer...

Checking Temp space: must be greater than 120 MB.   Actual 14147 MB    Passed
Checking swap space: must be greater than 150 MB.   Actual 8186 MB    Passed
Checking monitor: must be configured to display at least 256 colors.    Actual 16777216    Passed











  • Run root.sh using root user
[root@srv3 ~]# /u01/app/oracle/product/12.2.0/db_1/root.sh
Performing root user operation.

The following environment variables are set as:
    ORACLE_OWNER= oracle
    ORACLE_HOME=  /u01/app/oracle/product/12.2.0/db_1

Enter the full pathname of the local bin directory: [/usr/local/bin]: 
The contents of "dbhome" have not changed. No need to overwrite.
The contents of "oraenv" have not changed. No need to overwrite.
The contents of "coraenv" have not changed. No need to overwrite.

Entries will be added to the /etc/oratab file as needed by
Database Configuration Assistant when a database is created
Finished running generic part of root script.
Now product-specific root actions will be performed.
[root@srv3 ~]# 




  • Set oracle environment and run ./dbca for adding instance  

[oracle@srv1 bin]$ pwd
/u01/app/oracle/product/12.2.0/db_1/bin
[oracle@srv1 bin]$ 

[oracle@srv1 bin]$ . oraenv
ORACLE_SID = [rac1] ? rac
The Oracle base has been changed from /u01/app/grid to /u01/app/oracle
[oracle@srv1 bin]$ pwd
/u01/app/oracle/product/12.2.0/db_1/bin
[oracle@srv1 bin]$ ./dbca



















  • Check database instance status 

[root@srv1 rac]# crsctl check cluster -all
**************************************************************
srv1:
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online
**************************************************************
srv2:
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online
**************************************************************
srv3:
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online
**************************************************************
[root@srv1 rac]# crsctl status resource -t
--------------------------------------------------------------------------------
Name           Target  State        Server                   State details       
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.ASMNET1LSNR_ASM.lsnr
               ONLINE  ONLINE       srv1                     STABLE
               ONLINE  ONLINE       srv2                     STABLE
               ONLINE  ONLINE       srv3                     STABLE
ora.CRS.dg
               ONLINE  ONLINE       srv1                     STABLE
               ONLINE  ONLINE       srv2                     STABLE
               ONLINE  ONLINE       srv3                     STABLE
ora.DATA.dg
               ONLINE  ONLINE       srv1                     STABLE
               ONLINE  ONLINE       srv2                     STABLE
               ONLINE  ONLINE       srv3                     STABLE
ora.FRA.dg
               ONLINE  ONLINE       srv1                     STABLE
               ONLINE  ONLINE       srv2                     STABLE
               ONLINE  ONLINE       srv3                     STABLE
ora.LISTENER.lsnr
               ONLINE  ONLINE       srv1                     STABLE
               ONLINE  ONLINE       srv2                     STABLE
               ONLINE  ONLINE       srv3                     STABLE
ora.chad
               ONLINE  ONLINE       srv1                     STABLE
               ONLINE  ONLINE       srv2                     STABLE
               ONLINE  ONLINE       srv3                     STABLE
ora.net1.network
               ONLINE  ONLINE       srv1                     STABLE
               ONLINE  ONLINE       srv2                     STABLE
               ONLINE  ONLINE       srv3                     STABLE
ora.ons
               ONLINE  ONLINE       srv1                     STABLE
               ONLINE  ONLINE       srv2                     STABLE
               ONLINE  ONLINE       srv3                     STABLE
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.LISTENER_SCAN1.lsnr
      1        ONLINE  ONLINE       srv1                     STABLE
ora.LISTENER_SCAN2.lsnr
      1        ONLINE  ONLINE       srv3                     STABLE
ora.LISTENER_SCAN3.lsnr
      1        ONLINE  ONLINE       srv2                     STABLE
ora.MGMTLSNR
      1        ONLINE  ONLINE       srv2                     169.254.238.221 192.
                                                             168.10.2,STABLE
ora.asm
      1        ONLINE  ONLINE       srv1                     Started,STABLE
      2        ONLINE  ONLINE       srv2                     Started,STABLE
      3        ONLINE  ONLINE       srv3                     Started,STABLE
ora.cvu
      1        ONLINE  ONLINE       srv2                     STABLE
ora.mgmtdb
      1        ONLINE  ONLINE       srv2                     Open,STABLE
ora.qosmserver
      1        ONLINE  ONLINE       srv2                     STABLE
ora.rac.db
      1        ONLINE  ONLINE       srv1                     Open,HOME=/u01/app/o
                                                             racle/product/12.2.0
                                                             /db_1,STABLE
      2        ONLINE  ONLINE       srv2                     Open,HOME=/u01/app/o
                                                             racle/product/12.2.0
                                                             /db_1,STABLE
      3        ONLINE  ONLINE       srv3                     Open,HOME=/u01/app/o
                                                             racle/product/12.2.0
                                                             /db_1,STABLE
ora.scan1.vip
      1        ONLINE  ONLINE       srv1                     STABLE
ora.scan2.vip
      1        ONLINE  ONLINE       srv3                     STABLE
ora.scan3.vip
      1        ONLINE  ONLINE       srv2                     STABLE
ora.srv1.vip
      1        ONLINE  ONLINE       srv1                     STABLE
ora.srv2.vip
      1        ONLINE  ONLINE       srv2                     STABLE
ora.srv3.vip
      1        ONLINE  ONLINE       srv3                     STABLE
--------------------------------------------------------------------------------


[root@srv1 rac]# srvctl status database -d rac
Instance rac1 is running on node srv1
Instance rac2 is running on node srv2
Instance rac3 is running on node srv3
[root@srv1 rac]# 

[root@srv1 rac]# srvctl config database -d rac
Database unique name: rac
Database name: rac
Oracle home: /u01/app/oracle/product/12.2.0/db_1
Oracle user: oracle
Spfile: +FRA/RAC/PARAMETERFILE/spfile.273.1084982103
Password file: +FRA/RAC/PASSWORD/pwdrac.256.1084981397
Domain: 
Start options: open
Stop options: immediate
Database role: PRIMARY
Management policy: AUTOMATIC
Server pools: 
Disk Groups: FRA
Mount point paths: 
Services: 
Type: RAC
Start concurrency: 
Stop concurrency: 
OSDBA group: dba
OSOPER group: 
Database instances: rac1,rac2,rac3
Configured nodes: srv1,srv2,srv3
CSS critical: no
CPU count: 0
Memory target: 0
Maximum memory: 0
Default network number for database services: 
Database is administrator managed
[root@srv1 rac]# 






















Posted by at No comments:
Labels:
Subscribe to: Posts (Atom)