Database Software

Has anyone seen the problem with all transactions and/or logins hanging when starting or stopping the 2nd node of a 2 node RAC database. When I shut down the 2nd instance using srvctl I occasionally get errors and long delays connecting. On our larger database with instances having a very large SGAs, trying to connect you sometimes get ORA-12537 or ORA-01033. Users experience a very long hang before getting the errors. These instances have very large SGAs of about 30GB on each node.

In the log of the first instance we see messages like the following for quite a while.

Global Resource Directory frozen
Communication channels reestablished
Master broadcasted resource hash value bitmaps
Non-local Process blocks cleaned out
Mon Jan 8 06:59:08 2007
LMS 1: 0 GCS shadows cancelled, 0 closed
Mon Jan 8 06:59:08 2007
LMS 0: 0 GCS shadows cancelled, 0 closed
Set master node info
Submitted all remote-enqueue requests
Dwn-cvts replayed, VALBLKs dubious
All grantable enqueues granted
Mon Jan 8 06:59:23 2007
LMS 0: 20740 GCS shadows traversed, 4001 replayed
Mon Jan 8 06:59:23 2007
LMS 1: 20744 GCS shadows traversed, 4001 replayed
Mon Jan 8 06:59:23 2007
LMS 0: 20882 GCS shadows traversed, 4001 replayed
Mon Jan 8 06:59:23 2007
LMS 1: 20627 GCS shadows traversed, 4001 replayed
Mon Jan 8 06:59:24 2007
LMS 0: 20781 GCS shadows traversed, 4001 replayed
Mon Jan 8 06:59:24 2007


Thanks in advance.