ORA-00313: open failed for members of log group 2 of thread 1
20361Oct 27 2005 — edited Oct 27 2005We have a 4 node 32bit linux RAC (Dell/EMC) system running 9.2.0.4. It is very stable but over the past couple of months we've encountered a few ORA-00313 errors, while the system is running.
No patterns. Different loads, times of day, nodes.
The redo can't be opened, the node crashes, we look for errors, can't find any and then restart. The file is there and the permissions are fine. No other processes are accessing the files. No other Db errors. No O/S, SAN, Fiber, errors.
All the research I've done shows that this is an error you'd only get on startup.
We're going to log a TAR, but I can't believe we're the only ones to ever see this occur.
[directory and server names have been modified to protect the system. Don't get hung up on typos or possible file system config problems too much - this system has been and is running now]
======================================================
Log entries:
Mon Oct 24 22:51:58 2005
Errors in file /u01/app/oracle/admin/sampdb/bdump/sampdb1_lgwr_2237.trc:
ORA-00313: open failed for members of log group 2 of thread 1
ORA-00312: online log 2 thread 1: '/sampledb/redo0/oradata/sampdb/redo/redo102.log'
ORA-27041: unable to open file
Linux Error: 13: Permission denied
Additional information: 2
Mon Oct 24 22:51:58 2005
Errors in file /u01/app/oracle/admin/sampdb/bdump/sampdb1_lgwr_2237.trc:
ORA-00313: open failed for members of log group 2 of thread 1
ORA-00312: online log 2 thread 1: '/sampledb/redo0/oradata/sampdb/redo/redo102.log'
ORA-27041: unable to open file
Linux Error: 13: Permission denied
Additional information: 2
Mon Oct 24 22:51:58 2005
LGWR: terminating instance due to error 313
Below are the contents of the trace file mentioned in the above log:
trace file /u01/app/oracle/admin/sampdb/bdump/sampdb1_lgwr_2237.trc:
[oracle@db1 bdump]$ more /u01/app/oracle/admin/sampdb/bdump/sampdb1_lgwr_2237.trc
/u01/app/oracle/admin/sampdb/bdump/sampdb1_lgwr_2237.trc
Oracle9i Enterprise Edition Release 9.2.0.4.0 - Production
With the Partitioning, Real Application Clusters, OLAP and Oracle Data Mining options
JServer Release 9.2.0.4.0 - Production
ORACLE_HOME = /u01/app/oracle/product/920
System name: Linux
Node name: db1.sample.com
Release: 2.4.9-e.59enterprise
Version: #1 SMP Mon Jan 17 07:02:16 EST 2005
Machine: i686
Instance name: sampdb1
Redo thread mounted by this instance: 0 <none>
Oracle process number: 24
Unix process pid: 2237, image: oracle@db1.sample.com (LGWR)
*** SESSION ID:(25.1) 2005-10-11 22:31:02.315
CMCLI WARNING: CMInitContext: init ctx(0xad96e80)
*** 2005-10-24 22:51:58.192
ORA-00313: open failed for members of log group 2 of thread 1
ORA-00312: online log 2 thread 1: '/sampledb/redo0/oradata/sampdb/redo/redo102.log'
ORA-27041: unable to open file
Linux Error: 13: Permission denied
Additional information: 2
error 313 detected in background process
ORA-00313: open failed for members of log group 2 of thread 1
ORA-00312: online log 2 thread 1: '/sampledb/redo0/oradata/sampdb/redo/redo102.log'
ORA-27041: unable to open file
Linux Error: 13: Permission denied
Additional information: 2
ksuitm: waiting for [5] seconds before killing DIAG