Oracle Database Discussions

I went to "bounce" (shutdown immediate -> startup)a database because something had pegged the cpu at 100% and no users were active and got tyhe following errors...

SQL*Plus: Release 11.2.0.1.0 Production on Wed Oct 26 13:35:53 2011

Copyright (c) 1982, 2010, Oracle. All rights reserved.

Enter user-name: sys as sysdba
Enter password:
Connected to an idle instance.

SQL> startup
ORACLE instance started.

Total System Global Area 778387456 bytes
Fixed Size 1374808 bytes
Variable Size 503317928 bytes
Database Buffers 260046848 bytes
Redo Buffers 13647872 bytes
Database mounted.
ORA-01092: ORACLE instance terminated. Disconnection forced
ORA-12578: TNS:wallet open failed
Process ID: 4756
Session ID: 1 Serial number: 5


SQL>

In Alert.log:

Starting ORACLE instance (normal)
Wed Oct 26 09:17:31 2011
LICENSE_MAX_SESSION = 0
LICENSE_SESSIONS_WARNING = 0
Picked latch-free SCN scheme 2
Using LOG_ARCHIVE_DEST_1 parameter default value as USE_DB_RECOVERY_FILE_DEST
Autotune of undo retention is turned on.
IMODE=BR
ILAT =84
LICENSE_MAX_USERS = 0
SYS auditing is disabled
Starting up:
Oracle Database 11g Enterprise Edition Release 11.2.0.1.0 - Production
With the Partitioning, OLAP, Data Mining and Real Application Testing options.
Using parameter settings in server-side spfile E:\ORACLE\PRODUCT\11.2.0\DBHOME_1\DATABASE\SPFILEORCL.ORA
System parameters with non-default values:
processes = 500
memory_target = 1232M
control_files = "E:\ORACLE\ORADATA\ORCL\CONTROL01.CTL"
control_files = "E:\ORACLE\FLASH_RECOVERY_AREA\ORCL\CONTROL02.CTL"
db_block_size = 8192
compatible = "11.2.0.0.0"
log_buffer = 10485760
db_recovery_file_dest = "E:\Oracle\flash_recovery_area"
db_recovery_file_dest_size= 3852M
undo_tablespace = "UNDOTBS1"
remote_login_passwordfile= "EXCLUSIVE"
db_domain = "accounts.cdcr.ca.gov"
dispatchers = "(PROTOCOL=TCP) (SERVICE=orclXDB)"
local_listener = "LISTENER_ORCL"
session_cached_cursors = 200
job_queue_processes = 1000
audit_file_dest = "E:\ORACLE\ADMIN\ORCL\ADUMP"
audit_trail = "DB"
db_name = "orcl"
open_cursors = 300
diagnostic_dest = "E:\ORACLE"
Wed Oct 26 09:17:40 2011
PMON started with pid=2, OS id=3108
Wed Oct 26 09:17:40 2011
VKTM started with pid=3, OS id=3112 at elevated priority
VKTM running at (10)millisec precision with DBRM quantum (100)ms
Wed Oct 26 09:17:40 2011
GEN0 started with pid=4, OS id=3116
Wed Oct 26 09:17:40 2011
DIAG started with pid=5, OS id=3128
Wed Oct 26 09:17:40 2011
DBRM started with pid=6, OS id=3136
Wed Oct 26 09:17:41 2011
PSP0 started with pid=7, OS id=3140
Wed Oct 26 09:17:41 2011
DIA0 started with pid=8, OS id=3144
Wed Oct 26 09:17:41 2011
MMAN started with pid=9, OS id=3148
Wed Oct 26 09:17:41 2011
DBW0 started with pid=10, OS id=3160
Wed Oct 26 09:17:41 2011
LGWR started with pid=11, OS id=3168
Wed Oct 26 09:17:41 2011
CKPT started with pid=12, OS id=3176
Wed Oct 26 09:17:41 2011
SMON started with pid=13, OS id=3184
Wed Oct 26 09:17:41 2011
RECO started with pid=14, OS id=3192
Wed Oct 26 09:17:42 2011
MMON started with pid=15, OS id=3196
Wed Oct 26 09:17:42 2011
starting up 1 dispatcher(s) for network address '(ADDRESS=(PARTIAL=YES)(PROTOCOL=TCP))'...
Wed Oct 26 09:17:42 2011
MMNL started with pid=16, OS id=3200
starting up 1 shared server(s) ...
ORACLE_BASE from environment = E:\Oracle
Wed Oct 26 09:17:45 2011
alter database mount exclusive
Wed Oct 26 09:17:53 2011
Successful mount of redo thread 1, with mount id 1293322043
Database mounted in Exclusive Mode
Lost write protection disabled
Wed Oct 26 09:17:55 2011
Completed: alter database mount exclusive
alter database open
Beginning crash recovery of 1 threads
Started redo scan
Completed redo scan
read 0 KB redo, 0 data blocks need recovery
Started redo application at
Thread 1: logseq 1019, block 2, scn 15641501
Recovery of Online Redo Log: Thread 1 Group 2 Seq 1019 Reading mem 0
Mem# 0: E:\ORACLE\ORADATA\ORCL\REDO02.LOG
Completed redo application of 0.00MB
Completed crash recovery at
Thread 1: logseq 1019, block 3, scn 15661503
0 data blocks read, 0 data blocks written, 0 redo k-bytes read
Wed Oct 26 09:18:06 2011
Thread 1 advanced to log sequence 1020 (thread open)
Thread 1 opened at log sequence 1020
Current log# 3 seq# 1020 mem# 0: E:\ORACLE\ORADATA\ORCL\REDO03.LOG
Successful open of redo thread 1
Wed Oct 26 09:18:08 2011
MTTR advisory is disabled because FAST_START_MTTR_TARGET is not set
Wed Oct 26 09:18:08 2011
SMON: enabling cache recovery
Errors in file e:\oracle\diag\rdbms\orcl\orcl\trace\orcl_ora_3276.trc:
ORA-12578: TNS:wallet open failed
Errors in file e:\oracle\diag\rdbms\orcl\orcl\trace\orcl_ora_3276.trc:
ORA-12578: TNS:wallet open failed
Error 12578 happened during db open, shutting down database
USER (ospid: 3276): terminating the instance due to error 12578
Instance terminated by USER, pid = 3276
ORA-1092 signalled during: alter database open...
opiodr aborting process unknown ospid (3276) as a result of ORA-1092
Wed Oct 26 09:18:13 2011
ORA-1092 : opitsk aborting process

In the trace file:

Trace file e:\oracle\diag\rdbms\orcl\orcl\trace\orcl_ora_3276.trc
Oracle Database 11g Enterprise Edition Release 11.2.0.1.0 - Production
With the Partitioning, OLAP, Data Mining and Real Application Testing options
Windows NT Version V6.0 Service Pack 1
CPU : 1 - type 586, 1 Physical Cores
Process Affinity : 0x0x00000000
Memory (Avail/Total): Ph:5079M/6142M, Ph+PgF:10214M/12444M, VA:1034M/2047M
VM name : VMWare Version (6)
Instance name: orcl
Redo thread mounted by this instance: 1
Oracle process number: 19
Windows thread id: 3276, image: ORACLE.EXE (SHAD)


*** 2011-10-26 09:18:01.283
*** SESSION ID:(1.3) 2011-10-26 09:18:01.283
*** CLIENT ID:() 2011-10-26 09:18:01.283
*** SERVICE NAME:() 2011-10-26 09:18:01.283
*** MODULE NAME:(oradim.exe) 2011-10-26 09:18:01.283
*** ACTION NAME:() 2011-10-26 09:18:01.283

Thread 1 checkpoint: logseq 1019, block 2, scn 15641501
on-disk rba: logseq 1016, block 24845, scn 15581487
start recovery at logseq 1019, block 2, scn 15641501

*** 2011-10-26 09:18:01.751
Started writing zeroblks thread 1 seq 1019 blocks 3-10

*** 2011-10-26 09:18:02.329
Completed writing zeroblks thread 1 seq 1019

*** 2011-10-26 09:18:02.876
==== Redo read statistics for thread 1 ====
Total physical reads (from disk and memory): 4096Kb
-- Redo read_disk statistics --
Read rate (ASYNC): 0Kb in 1.55s => 0.00 Mb/sec
Longest record: 0Kb, moves: 0/1 (0%)
Longest LWN: 0Kb, moves: 0/1 (0%), moved: 0Mb
Last redo scn: 0x0000.00eeab9e (15641502)
----------------------------------------------
----- Recovery Hash Table Statistics ---------
Hash table buckets = 32768
Longest hash chain = 0
Average hash chain = 0/0 = 0.0
Max compares per lookup = 0
Avg compares per lookup = 0/0 = 0.0
----------------------------------------------

*** 2011-10-26 09:18:03.626
KCRA: start recovery claims for 0 data blocks

*** 2011-10-26 09:18:04.094
KCRA: blocks processed = 0/0, claimed = 0, eliminated = 0

*** 2011-10-26 09:18:04.891
Recovery of Online Redo Log: Thread 1 Group 2 Seq 1019 Reading mem 0

*** 2011-10-26 09:18:04.984
Completed redo application of 0.00MB

*** 2011-10-26 09:18:04.984
Completed recovery checkpoint
IR RIA: redo_size 0 bytes, time_taken 314 ms
----- Recovery Hash Table Statistics ---------
Hash table buckets = 32768
Longest hash chain = 0
Average hash chain = 0/0 = 0.0
Max compares per lookup = 0
Avg compares per lookup = 0/0 = 0.0
----------------------------------------------
Recovery sets nab of thread 1 seq 1019 to 3 with 8 zeroblks

*** 2011-10-26 09:18:11.466
ORA-12578: TNS:wallet open failed
ORA-12578: TNS:wallet open failed

*** 2011-10-26 09:18:11.497
USER (ospid: 3276): terminating the instance due to error 12578
Symbol file E:\Oracle\product\11.2.0\dbhome_1\BIN\orageneric11.SYM does not match binary.
Symbol TimeStamp=4bb5eb10, Module TimeStamp=0 are different
EnumerateLoadedModules64 failed with error -1073741819
Symbol file orageneric11.SYM does not match binary.
Symbol TimeStamp=4bb5eb10, Module TimeStamp=0 are different

Edited by: 878073 on Oct 26, 2011 1:36 PM