Thursday 23 April 2020

RAC - ORA-15025: could not open disk |WARNING: FAILED to load library: /opt/oracle/extapi/64/asm/orcl/1/libasm.so


Scenario : 

Recently isntalling 2 node RAC 12c R1 , We face error during running ./dbca , Although we successfully installed grid setup ,asmca disk configuration  and oracle rdbms binary. but while installing instance we face error. I have done implementation several times but some silly mistake by me.. As was just test so i was taking it seriously fed up installing RAC setup , But today i learn something new for this error. following  (Doc ID 1378747.1)

Error:

ORA-15025: could not open disk "/dev/oracleasm/disks/FRA"

WARNING: FAILED to load library: /opt/oracle/extapi/64/asm/orcl/1/libasm.so


alert log error on rac1.log


ORA-15025: could not open disk "/dev/oracleasm/disks/FRA"

WARNING: FAILED to load library: /opt/oracle/extapi/64/asm/orcl/1/libasm.so
Wed Apr 22 14:38:18 2020
NOTE: ASMB connected to ASM instance +ASM1 osid: 15845 (Flex mode; client id 0xffffffffffffffff)
NOTE: initiating MARK startup
Starting background process MARK
Wed Apr 22 14:38:18 2020
MARK started with pid=35, OS id=15849
Wed Apr 22 14:38:19 2020
NOTE: MARK has subscribed
Wed Apr 22 14:38:26 2020
NOTE: ASMB mounting group 3 (FRA)
Wed Apr 22 14:38:28 2020
ORA-15025: could not open disk "/dev/oracleasm/disks/FRA"
ORA-27041: unable to open file
Linux-x86_64 Error: 13: Permission denied
Additional information: 9
ORA-15183: ASMLIB initialization error [driver/agent not installed]
NOTE: Disk 0 in group 3 could not be opened.
WARNING: Failed to complete group 3
WARNING: group 3 is being dismounted.
WARNING: ASMB force dismounting group 3 (FRA) due to failed mount
SUCCESS: diskgroup FRA was dismounted
NOTE: ASMB mounting group 2 (DATA)
Wed Apr 22 14:38:32 2020
ORA-15025: could not open disk "/dev/oracleasm/disks/DATA"
ORA-27041: unable to open file
Linux-x86_64 Error: 13: Permission denied
Additional information: 9
ORA-15040: diskgroup is incomplete
NOTE: Disk 0 in group 2 could not be opened.
WARNING: Failed to complete group 2
WARNING: group 2 is being dismounted.
WARNING: ASMB force dismounting group 2 (DATA) due to failed mount
SUCCESS: diskgroup DATA was dismounted
NOTE: ASMB mounting group 2 (DATA)
Wed Apr 22 14:38:33 2020
ORA-15025: could not open disk "/dev/oracleasm/disks/DATA"
ORA-27041: unable to open file
Linux-x86_64 Error: 13: Permission denied
Additional information: 9
ORA-15040: diskgroup is incomplete
NOTE: Disk 0 in group 2 could not be opened.
WARNING: Failed to complete group 2
WARNING: group 2 is being dismounted.

############################################################################

Solution:

After troubleshooting i checked  asmdba group was not provided to oracle and grid user. Although created but some how missed to proved group on user.


grid@sgdcplm01:~> id
uid=54323(grid) gid=54321(oinstall) groups=54321(oinstall),54329(asmadmin)
grid@sgdcplm01:~> su oracle
Password:
oracle@sgdcplm01:/home/grid> id
uid=502(oracle) gid=54321(oinstall) groups=54321(oinstall),503(dba),504(oper),1000(beoper) ,54329(asmadmin)
oracle@sgdcplm01:/home/grid>

( Adding group to oracle and grid user by executing from root user )

 # usermod -a -G asmdba oracle

# usermod -a -G asmdba grid


login as: grid
Keyboard-interactive authentication prompts from server:
| Password:
End of keyboard-interactive prompts from server
Last login: Wed Apr 22 09:54:57 2020 from 10.4.6.143
grid@sgdcplm01:~> id
uid=54323(grid) gid=54321(oinstall) groups=54321(oinstall),54327(asmdba),54329(asmadmin)
grid@sgdcplm01:~> su oracle
Password:
oracle@sgdcplm01:/home/grid> id
uid=502(oracle) gid=54321(oinstall) groups=54321(oinstall),503(dba),504(oper),1000(beoper),54327(asmdba),54329(asmadmin)
oracle@sgdcplm01:/home/grid>


grid@srv2:/u01/app/12.1.0/grid/bin> . oraenv
ORACLE_SID = [grid] ? +ASM2
The Oracle base has been set to /u01/app/grid

grid@srv2:/u01/app/12.1.0/grid/bin> ./setasmgidwrapo=/u01/app/oracle/product/12.1.0/db_1/bin/oracle


grid@srv2:/u01/app/12.1.0/grid/bin>

(NOTE: Following doc id below: Database Will Not Mount: ORA-15025, ORA-27041, 'Permission denied', ORA-15081 (Doc ID 1378747.1)


Alert log :

Wed Apr 22 15:54:45 2020
NOTE: ASMB registering with ASM instance as Standard client 0xffffffffffffffff (reg:2301527851) (new connection)
Starting background process RBAL
Wed Apr 22 15:54:45 2020
RBAL started with pid=34, OS id=11971
Wed Apr 22 15:54:45 2020
NOTE: Loaded library: /opt/oracle/extapi/64/asm/orcl/1/libasm.so
Wed Apr 22 15:54:45 2020
NOTE: ASMB connected to ASM instance +ASM1 osid: 11969 (Flex mode; client id 0xffffffffffffffff)
NOTE: initiating MARK startup
Starting background process MARK
Wed Apr 22 15:54:45 2020
MARK started with pid=35, OS id=11973
Wed Apr 22 15:54:45 2020
NOTE: MARK has subscribed
Wed Apr 22 15:54:50 2020
NOTE: ASMB mounting group 3 (FRA)
NOTE: Assigning number (3,0) to disk (/dev/oracleasm/disks/FRA)
SUCCESS: mounted group 3 (FRA)
NOTE: grp 3 disk 0: FRA_0000 path:/dev/oracleasm/disks/FRA
NOTE: ASMB mounting group 2 (DATA)
NOTE: Assigning number (2,0) to disk (/dev/oracleasm/disks/DATA)
SUCCESS: mounted group 2 (DATA)
NOTE: grp 2 disk 0: DATA_0000 path:/dev/oracleasm/disks/DATA



Tuesday 21 April 2020

RAC : [INS-13001] Environment does not meet minimum requirements.





















Unzip grid software and go to directory /u01/grid/stage/cvu/cv/admin andmake changes on cvu_config file
srv1:/u01/grid # ll
total 24
drwxrwxr-x 1 grid oinstall  298 Apr 21 20:53 install
drwxrwxr-x 1 grid oinstall   32 Jul  7  2014 response
drwxrwxr-x 1 grid oinstall   40 Jul  7  2014 rpm
-rwxrwxr-x 1 grid oinstall 8534 Jul  7  2014 runInstaller
-rwxrwxr-x 1 grid oinstall 5085 Dec 20  2013 runcluvfy.sh
drwxrwxr-x 1 grid oinstall   30 Jul  7  2014 sshsetup
drwxrwxr-x 1 grid oinstall  910 Jul  7  2014 stage
-rwxrwxr-x 1 grid oinstall  500 Feb  7  2013 welcome.html
srv1:/u01/grid #

srv1:/u01/grid/stage/cvu/cv/admin # ll
total 62472
-rwxrwxr-x 1 grid oinstall     1263 Jul  1  2014 cvu_config
-rwxrwxr-x 1 grid oinstall 63964254 Jul  1  2014 cvunetquery
srv1:/u01/grid/stage/cvu/cv/admin #

# Enable value 

CV_ASSUME_DISTID=SUSE11

zypper install libstdc++46-devel libstdc++33 libstdc++33-devel libelf-devel gcc-c++ libaio-devel sysstat unixODBC unixODBC-devel xdpyinfo

RAC [INS-06003] Failed to setup passwordless SSH connectivity with the following node(s)



  • Scenario Preview : We recently find ssh error on during installation. As per my experience only found this error only on open suse 12 server.

  • OpenSSH_6.7: ERROR [INS-06003] Failed to setup passwordless SSH connectivity During Grid Infrastructure Install (Doc ID 2111092.1)






















  • srv1:/u01/grid/sshsetup # vi  /etc/ssh/sshd_config (both nodes)


KexAlgorithms curve25519-sha256@libssh.org,ecdh-sha2-nistp256,ecdh-sha2-nistp384,ecdh-sha2-nistp521,diffie-hellman-group-exchange-sha256,diffie-hellman-group14-sha1,diffie-hellman-group-exchange-sha1,diffie-hellman-group1-sha1   

(Doc ID 2111092.1)


  • srv1:/u01/grid/sshsetup # service sshd restart (both nodes)
  • srv1:/u01/grid/sshsetup # service sshd status

sshd.service - OpenSSH Daemon
   Loaded: loaded (/usr/lib/systemd/system/sshd.service; enabled; vendor preset: disabled)
   Active: active (running) since Tue 2020-04-21 11:28:18 IST; 20s ago
  Process: 6035 ExecStartPre=/usr/sbin/sshd -t $SSHD_OPTS (code=exited, status=0/SUCCESS)
  Process: 6032 ExecStartPre=/usr/sbin/sshd-gen-keys-start (code=exited, status=0/SUCCESS)
 Main PID: 6039 (sshd)
    Tasks: 1
   CGroup: /system.slice/sshd.service
           └─6039 /usr/sbin/sshd -D

Apr 21 11:28:18 srv1 systemd[1]: Stopped OpenSSH Daemon.
Apr 21 11:28:18 srv1 systemd[1]: Starting OpenSSH Daemon...
Apr 21 11:28:18 srv1 sshd-gen-keys-start[6032]: Checking for missing server keys in /etc/ssh
Apr 21 11:28:18 srv1 sshd[6039]: Server listening on 0.0.0.0 port 22.
Apr 21 11:28:18 srv1 sshd[6039]: Server listening on :: port 22.
Apr 21 11:28:18 srv1 systemd[1]: Started OpenSSH Daemon.
srv1:/u01/grid/sshsetup #