Database Software

Hi again ,Oracle RAC 9i problem has not been solved. This is the trace file.

ump file c:\oracle\admin\recp9\bdump\recp91_lck0_4080.trc
Wed Aug 31 05:30:45 2011
ORACLE V9.2.0.5.0 - Production vsnsta=0
vsnsql=12 vsnxtr=3
Windows 2000 Version 5.2 Service Pack 2, CPU type 586
Oracle9i Enterprise Edition Release 9.2.0.5.0 - Production
With the Partitioning, Real Application Clusters, OLAP and Oracle Data Mining options
JServer Release 9.2.0.5.0 - Production
Windows 2000 Version 5.2 Service Pack 2, CPU type 586
Instance name: recp91

Redo thread mounted by this instance: 1

Oracle process number: 20

Windows thread id: 4080, image: ORACLE.EXE


*** 2011-08-31 05:30:45.235
*** SESSION ID:(20.1) 2011-08-31 05:30:45.235
error 29740 detected in background process
ORA-29740: evicted by member , group incarnation


From the Alert Log File
ed Aug 31 05:30:44 2011
Errors in file c:\oracle\admin\recp9\bdump\recp91_lms1_3648.trc:
ORA-29740: evicted by member , group incarnation

Wed Aug 31 05:30:45 2011
Errors in file c:\oracle\admin\recp9\bdump\recp91_lck0_4080.trc:
ORA-29740: evicted by member , group incarnation

Instance terminated by LMON, pid = 3624
Dump file c:\oracle\admin\recp9\bdump\alert_recp91.log
Wed Aug 31 09:32:02 2011
ORACLE V9.2.0.5.0 - Production vsnsta=0
vsnsql=12 vsnxtr=3
Windows 2000 Version 5.2 Service Pack 2, CPU type 586
Wed Aug 31 09:32:02 2011
Starting ORACLE instance (normal)
Wed Aug 31 09:32:02 2011
Global Enqueue Service Resources = 4086, pool = 1
Wed Aug 31 09:32:02 2011
Global Enqueue Service Enqueues = 5947
LICENSE_MAX_SESSION = 0
LICENSE_SESSIONS_WARNING = 0
GES IPC: Receivers 3 Senders 3
GES IPC: Buffers Receive 1000 Send 530 Reserve 300
GES IPC: Msg Size Regular 420 Batch 2048
SCN scheme 2
Using log_archive_dest parameter default value
LICENSE_MAX_USERS = 0
SYS auditing is enabled
Starting up ORACLE RDBMS Version: 9.2.0.5.0.
System parameters with non-default values:
processes = 150
timed_statistics = TRUE
shared_pool_size = 478150656
sga_max_size = 1553017760
large_pool_size = 109051904
java_pool_size = 25165824
spfile = o:\oradata\recp9\spfilerecp9.ora
resource_manager_plan =
control_files = o:\oradata\recp9\CONTROL01.CTL, o:\oradata\recp9\CONTROL02.CTL, o:\oradata\recp9\CONTROL03.CTL
db_block_size = 8192
db_cache_size = 813694976
compatible = 9.2.0.0.0
log_archive_start = TRUE
log_archive_dest_1 = location=o:\oradata\recp9\archive
log_archive_format = arch_%t_%s.arc
db_file_multiblock_read_count= 16
cluster_database = TRUE
cluster_database_instances= 2
thread = 1
fast_start_mttr_target = 300
instance_number = 1
undo_management = AUTO
undo_tablespace = UNDOTBS1
undo_retention = 10800
remote_login_passwordfile= EXCLUSIVE
audit_sys_operations = TRUE
db_domain = cashdesk.casino
instance_name = recp91
dispatchers = (PROTOCOL=TCP) (SERVICE=recp9XDB)
local_listener = LISTENER_RECP91
remote_listener = LISTENERS_RECP9
job_queue_processes = 10
hash_join_enabled = TRUE
background_dump_dest = c:\Oracle\admin\recp9\bdump
user_dump_dest = c:\Oracle\admin\recp9\udump
core_dump_dest = c:\Oracle\admin\recp9\cdump
audit_trail = DB
sort_area_size = 524288
db_name = recp9
open_cursors = 300
star_transformation_enabled= FALSE
query_rewrite_enabled = FALSE
pga_aggregate_target = 200000000
aq_tm_processes = 1
Wed Aug 31 09:32:02 2011
cluster interconnect IPC version:Oracle 9i Winsock2 TCP/IP IPC
IPC Vendor 0 proto 0 Version 0.0
PMON started with pid=2
DIAG started with pid=3
LMON started with pid=4
LMD0 started with pid=5
LMS0 started with pid=6
LMS1 started with pid=7
DBW0 started with pid=8
LGWR started with pid=9
CKPT started with pid=10
SMON started with pid=11
RECO started with pid=12
CJQ0 started with pid=13
QMN0 started with pid=14
Wed Aug 31 09:32:08 2011
starting up 1 shared server(s) ...
starting up 1 dispatcher(s) for network address '(ADDRESS=(PARTIAL=YES)(PROTOCOL=TCP))'...
ARCH: STARTING ARCH PROCESSES
ARC0 started with pid=17
ARC0: Archival started
ARC1 started with pid=18
ARC1: Archival started
Wed Aug 31 09:32:09 2011
ARCH: STARTING ARCH PROCESSES COMPLETE
Wed Aug 31 09:32:09 2011
ARC0: Thread not mounted
Wed Aug 31 09:32:09 2011
ARC1: Thread not mounted
Wed Aug 31 09:32:09 2011
alter database mount exclusive
Wed Aug 31 09:32:09 2011
ORA-32700 signalled during: alter database mount exclusive...
Wed Aug 31 09:35:14 2011
Restarting dead background process QMN0
QMN0 started with pid=14
Wed Aug 31 09:40:27 2011
Restarting dead background process QMN0
QMN0 started with pid=14
Wed Aug 31 09:45:40 2011
Restarting dead background process QMN0
QMN0 started with pid=14
Wed Aug 31 09:50:53 2011
Restarting dead background process QMN0
QMN0 started with pid=14
Wed Aug 31 09:56:05 2011
Restarting dead background process QMN0
QMN0 started with pid=14
Wed Aug 31 10:01:18 2011
Restarting dead background process QMN0
QMN0 started with pid=14
Wed Aug 31 10:06:28 2011
Restarting dead background process QMN0
QMN0 started with pid=14
Wed Aug 31 10:11:41 2011
Restarting dead background process QMN0
QMN0 started with pid=14
Wed Aug 31 10:16:53 2011
Restarting dead background process QMN0
QMN0 started with pid=14
Wed Aug 31 10:22:06 2011
Restarting dead background process QMN0
QMN0 started with pid=14

I haven't found anything in the internet. 2 possible causes the backup we take this time ,and something with ntp and time sychronization.
Any help sould be appreciated.
Even if i restart the services of the oracle instance the instance doesn't start.
The only solution is to restart the node.