Database Software

We have recently upgraded (only security updates - yum update security) our RHEL 5.6 (Tikanga) + Oracle 11G and ASM.
1) First thing we have seen after reboot was this error:

+[oracle@hostname ~]$ sqlplus+

SQL*Plus: Release 11.1.0.7.0 - Production on Wed Jul 27 12:57:36 2011

Copyright (c) 1982, 2008, Oracle. All rights reserved.

Enter user-name: user-name
Enter password:
ERROR:
ORA-01034: ORACLE not available
ORA-27101: shared memory realm does not exist
Linux-x86_64 Error: 2: No such file or directory
Process ID: 0
Session ID: 0 Serial number: 0


I tried to start it but unsuccessfully:
+[oracle@hostname ~]$ sqlplus / as sysdba+

SQL*Plus: Release 11.1.0.7.0 - Production on Wed Jul 27 15:47:06 2011

Copyright (c) 1982, 2008, Oracle. All rights reserved.

Connected to an idle instance.

SQL> Select * from v$instance;
Select * from v$instance
*+
ERROR at line 1:
ORA-01034: ORACLE not available
Process ID: 0
Session ID: 0 Serial number: 0

SQL> shutdown abort
ORACLE instance shut down.
SQL> startup nomount
ORA-01078: failure in processing system parameters
ORA-01565: error in identifying file 'DG1/ourdb/ourdb.ora'+
ORA-17503: ksfdopn:2 Failed to open file DG1/ourdb/ourdb.ora+
ORA-15077: could not locate ASM instance serving a required diskgroup
SQL> alter database mount
+2+
SQL> alter database mount;
alter database mount
*+
ERROR at line 1:
ORA-01034: ORACLE not available
Process ID: 0
Session ID: 0 Serial number: 0

Then we checked ASM:

+[root@hostname ~]# /etc/init.d/oracleasm listdisks+
+[root@hostname ~]#+


which was not working because kernel module "oracleasm" was not loaded

+[root@hostname ~]# lsmod |grep oracleasm+
+[root@hostname ~]#+

This is most probably due to recent kernel update
from
+2.6.18-238.5.1.el5+
to
+2.6.18-274.el5+

I think that Oracle supply modules just for some particular kernel versions and our version is not supported:

+[root@hostname ~]# oracleasm update-driver+
Kernel: 2.6.18-274.el5 x86_64
Driver name: oracleasm-2.6.18-274.el5
Driver for kernel 2.6.18-274.el5 does not exist
+[root@hostname ~]#+

Is there any script which can build module for our kernel version (something similar as vmware provides)? Or oracleasm update-driver is the only way?

We made some workaround of copying module from old kernel to new kernel directory:

+[root@hostname ~]#cp /lib/modules/2.6.18-238.5.1.el5/kernel/drivers/addon/oracleasm/oracleasm.ko /lib/modules/2.6.18-274.el5/kernel/drivers/addon/oracleasm/+
+[root@hostname ~]#+

and loaded that module into memory:

+[root@hostname ~]# insmod /lib/modules/2.6.18-274.el5/kernel/drivers/addon/oracleasm/oracleasm.ko+
+[root@hostname ~]# lsmod |grep oracleasm+
oracleasm 84136 0
+[root@hostname ~]#+

and then ASM started to displaying disks:

+[root@hostname ~]# /etc/init.d/oracleasm status+
Checking if ASM is loaded: yes
Checking if /dev/oracleasm is mounted: no
+[root@hostname ~]# /etc/init.d/oracleasm stop+
+Dropping Oracle ASMLib disks: [ OK ]+
+Shutting down the Oracle ASMLib driver: [FAILED]+
+[root@hostname ~]# /etc/init.d/oracleasm start+
+Initializing the Oracle ASMLib driver: [ OK ]+
+Scanning the system for Oracle ASMLib disks: [ OK ]+
+[root@hostname ~]# /etc/init.d/oracleasm listdisks+
ASM01
ASM02
+[root@hostname ~]#+

This is all fine until restart. How to load this oracleasm module automatically?


2) Then we tried to boot from previous kernel version "2.6.18-238.5.1.el5". ASM works fine here and "oracleasm" module is loaded automatically after reboot.
However we are still facing the original issue listed at the very beginning:

+[oracle@hostname ~]$ sqlplus+

SQL*Plus: Release 11.1.0.7.0 - Production on Wed Jul 27 12:57:36 2011

Copyright (c) 1982, 2008, Oracle. All rights reserved.

Enter user-name: username
Enter password:
ERROR:
ORA-01034: ORACLE not available
ORA-27101: shared memory realm does not exist
Linux-x86_64 Error: 2: No such file or directory
Process ID: 0
Session ID: 0 Serial number: 0

This was working fine before. How to fix it with old or new kernel please?
Thank you

Edited by: 872550 on Jul 28, 2011 1:39 AM