Oracle Database Discussions

HI

I have cold backups running every night and before the backup session starts, we have a cronjob 'srvctl stop -p prod' where our db servers are running on RAC.

but starts from last saturday, our backup session for raw device failed. when look at the alert log, it gives as (example on 15th November 2006)

Tue Nov 21 01:33:31 2006
Thread 1 advanced to log sequence 2855
Current log# 1 seq# 2855 mem# 0: /u01/oracle/oradata/prod/redo_1_01_01.log
Current log# 1 seq# 2855 mem# 1: /u01/oracle/oradata/prod/redo_1_01_02.log
Tue Nov 21 02:37:24 2006
Reconfiguration started
List of nodes: 0,
Global Resource Directory frozen
one node partition
Communication channels reestablished
Server queues filtered
Master broadcasted resource hash value bitmaps
Non-local Process blocks cleaned out
Resources and enqueues cleaned out
Resources remastered 13089
147420 GCS shadows traversed, 0 cancelled, 18306 closed
63793 GCS resources traversed, 0 cancelled
98369 GCS resources on freelist, 162162 on array, 162162 allocated
set master node info
147420 GCS shadows traversed, 0 replayed, 18306 unopened
Submitted all remote-enqueue requests
Update rdomain variables
0 write requests issued in 129114 GCS resources
1 PIs marked suspect, 0 flush PI msgs
Dwn-cvts replayed, VALBLKs dubious
All grantable enqueues granted
Tue Nov 21 02:37:27 2006
Reconfiguration complete
Tue Nov 21 02:37:28 2006
Instance recovery: looking for dead threads
Instance recovery: lock domain invalid but no dead threads
Tue Nov 21 02:37:29 2006
Shutting down instance: further logons disabled
Shutting down instance (immediate)
License high water mark = 90
Tue Nov 21 02:37:29 2006
ALTER DATABASE CLOSE NORMAL
Tue Nov 21 02:37:29 2006
SMON: disabling tx recovery
SMON: disabling cache recovery
Tue Nov 21 02:37:34 2006
Thread 1 closed at log sequence 2855
Tue Nov 21 02:37:38 2006
Completed: ALTER DATABASE CLOSE NORMAL
Tue Nov 21 02:37:38 2006
ALTER DATABASE DISMOUNT
Completed: ALTER DATABASE DISMOUNT
ARCH: Archiving is disabled
Shutting down archive processes
archiving is disabled
Archive process shutdown avoided: 0 active
ARCH: Archiving is disabled
Shutting down archive processes
archiving is disabled
Archive process shutdown avoided: 0 active
Tue Nov 21 02:42:49 2006
SHUTDOWN: waiting for detached processes to terminate.Tue Nov 21 07:16:38 2006
Starting ORACLE instance (normal)

Seems like it was hang when 'shutdown immediate' command is issued. can somebody help me? what should i do?

Thanks

Best regards,
Nonie