RMAN 12c error :RMAN-00554,RMAN-03000,RMAN-06001,RMAN-01009,RMAN-01008,RMAN-01007

Scenario Preview:

RMAN-00554: initialization of internal recovery manager package failed
RMAN-03000: recovery manager compiler component initialization failed
RMAN-06001: error parsing job step library
RMAN-01009: syntax error: found "identifier": expecting one of: ""
RMAN-01008: the bad identifier was: baschemaversion
RMAN-01007: at line 17 column 1 file: ?/rdbms/admin/recover.bsq


Solution: Provide correct path in .bash_profile 

/u01/app/oracle/product/12.1.0/dbhome_2/bin/rman

oracle@sgdcplm01:~> rman target /

Recovery Manager: Release 12.1.0.2.0 - Production on Wed Dec 4 11:21:15 2019

Copyright (c) 1982, 2014, Oracle and/or its affiliates.  All rights reserved.

RMAN-00571: ===========================================================
RMAN-00569: =============== ERROR MESSAGE STACK FOLLOWS ===============
RMAN-00571: ===========================================================
RMAN-00554: initialization of internal recovery manager package failed
RMAN-03000: recovery manager compiler component initialization failed
RMAN-06001: error parsing job step library
RMAN-01009: syntax error: found "identifier": expecting one of: ""
RMAN-01008: the bad identifier was: baschemaversion
RMAN-01007: at line 17 column 1 file: ?/rdbms/admin/recover.bsq

oracle@sgdcplm01:~> /u01/app/oracle/product/12.1.0/dbhome_2/bin/rman target sys/xxxxx@pretaf

Recovery Manager: Release 12.1.0.2.0 - Production on Wed Dec 4 11:22:37 2019

Copyright (c) 1982, 2014, Oracle and/or its affiliates.  All rights reserved.

connected to target database: SMRRAC (DBID=4255065810)

RMAN>

FAL[client, MRP0]: Error 12154 connecting to rac for fetching gap sequence

Preview Scenario:

• 2 Node RAC with standalone physical standby

• Error: FAL[client, MRP0]: Error 12154 connecting to rac for fetching gap sequence

Solution :

• Copy password file from ASM diskgroup to local disk than scp to standby DBS location.

Standby alert log below:

Tue Dec 10 13:53:19 2019

All non-current ORLs have been archived.

Media Recovery Waiting for thread 1 sequence 555

Fetching gap sequence in thread 1, gap sequence 555-555

Error 12154 received logging on to the standby

FAL[client, MRP0]: Error 12154 connecting to rac for fetching gap sequence

Tue Dec 10 13:53:19 2019

Errors in file /u01/app/oracle/diag/rdbms/stdrac/stdrac/trace/stdrac_mrp0_3806.trc:

ORA-12154: TNS:could not resolve the connect identifier specified

Completed:  alter database recover managed standby database disconnect from session

Tue Dec 10 13:53:29 2019

Error 12154 received logging on to the standby

FAL[client, MRP0]: Error 12154 connecting to rac for fetching gap sequence

Tue Dec 10 13:53:29 2019

Errors in file /u01/app/oracle/diag/rdbms/stdrac/stdrac/trace/stdrac_mrp0_3806.trc:

ORA-12154: TNS:could not resolve the connect identifier specified

Tue Dec 10 13:53:39 2019

Error 12154 received logging on to the standby

FAL[client, MRP0]: Error 12154 connecting to rac for fetching gap sequence

Tue Dec 10 13:53:39 2019

Errors in file /u01/app/oracle/diag/rdbms/stdrac/stdrac/trace/stdrac_mrp0_3806.trc:

ORA-12154: TNS:could not resolve the connect identifier specified

Tue Dec 10 13:53:49 2019

Error 12154 received logging on to the standby

FAL[client, MRP0]: Error 12154 connecting to rac for fetching gap sequence

Tue Dec 10 13:53:49 2019

Errors in file /u01/app/oracle/diag/rdbms/stdrac/stdrac/trace/stdrac_mrp0_3806.trc:

ORA-12154: TNS:could not resolve the connect identifier specified

Tue Dec 10 13:53:59 2019

Error 12154 received logging on to the standby

FAL[client, MRP0]: Error 12154 connecting to rac for fetching gap sequence

Tue Dec 10 13:53:59 2019

Errors in file /u01/app/oracle/diag/rdbms/stdrac/stdrac/trace/stdrac_mrp0_3806.trc:

ORA-12154: TNS:could not resolve the connect identifier specified

Tue Dec 10 13:54:09 2019

Error 12154 received logging on to the standby

FAL[client, MRP0]: Error 12154 connecting to rac for fetching gap sequence

Tue Dec 10 13:54:09 2019

• Login to asmcmd diskgroup

[grid@srv2 ~]$ . oraenv

ORACLE_SID = [+ASM2] ? +ASM2

The Oracle base remains unchanged with value /u01/app/grid

[grid@srv2 ~]$ asmcmd

ASMCMD> lsdg

State    Type    Rebal  Sector  Block       AU  Total_MB  Free_MB  Req_mir_free_MB  Usable_file_MB  Offline_disks  Voting_files  Name

MOUNTED  NORMAL  N         512   4096  1048576     36852    27526            12284            7621              0             Y  CRS/

MOUNTED  EXTERN  N         512   4096  1048576     20473    10150                0           10150              0             N  DATA/

MOUNTED  EXTERN  N         512   4096  1048576     20473    15734                0           15734              0             N  FRA/

ASMCMD>

ASMCMD> cd RAC

ASMCMD> ls
CONTROLFILE/
DATAFILE/
ONLINELOG/
PARAMETERFILE/
PASSWORD/
TEMPFILE/
ASMCMD> cd PASSWORD/
ASMCMD> ls
pwdrac.269.1020351483
ASMCMD> pwcopy pwdrac.269.1020351483 /u01/grid
copying +DATA/RAC/PASSWORD/pwdrac.269.1020351483 -> /u01/grid/pwdrac.269.1020351483
ASMCMD> exit
[grid@srv1 ~]$ cd /u01/grid/

                                                  

Check ssh date on both 2 node RAC Server

• [grid@srv2 ~]$ cat /etc/hosts

#127.0.0.1   localhost localhost.localdomain localhost4 localhost4.localdomain4
#::1         localhost localhost.localdomain localhost6 localhost6.localdomain6

127.0.0.1   localhost.localdomain localhost
# Public
192.168.56.71   srv1.example.com        srv1
192.168.56.72   srv2.example.com        srv2
192.168.56.73   srv3.example.com        srv3
# Private
192.168.10.1    srv1-priv.example.com   srv1-priv
192.168.10.2    srv2-priv.example.com   srv2-priv

# Virtual
192.168.56.81   srv1-vip.example.com    srv1-vip
192.168.56.82   srv2-vip.example.com    srv2-vip

# SCAN (in production this should be configured in DNS)
192.168.56.91   srv-scan.example.com    srv-scan
192.168.56.92   srv-scan.example.com    srv-scan
192.168.56.93   srv-scan.example.com    srv-scan

• [grid@srv2 ~]$ ssh srv1.example.com date;ssh srv2.example.com date

Wed Dec 11 12:59:04 IST 2019
Wed Dec 11 12:59:04 IST 2019
[grid@srv2 ~]$

NOTE : set date ===> date -s "2 OCT 2006 18:00:00"