Background Media Recovery process shutdown, Need to Resolve it
Hi,
Good Day!
O/S: HPUX 11.31
DB: 10.2.0.5
primary database: 2xnode RAC/ASM
standby database: Single Instance / Unix File system
Problem
======
due to not having enough file system free space on standby database node the Undo tablespace datafile extention (initiated from Primary database) failed at standby database and MRP shutdown.
Primary 2xnode RAC/ASM running fine, as there was enough free space available in ASM-DG, but standby database's MRP failed to run as undo datafile could not be extended due to not enough free space available on file system.
Alert - Contents:
ORA-01237: cannot extend datafile 7
ORA-01110: data file 7: '/oracle/folder/undotbs2_01.dbf'
ORA-19502: write error on file "/oracle/folder/undotbs2_01.dbf", blockno 102713 (blocksize=8192)
ORA-27072: File I/O error
HPUX-ia64 Error: 11: Resource temporarily unavailable
Additional information: 4
Additional information: 102713
Additional information: 456704
Sun Aug 07 11:27:58 PST 2011
Some recovered datafiles maybe left media fuzzy
Media recovery may continue but open resetlogs may fail
Sun Aug 07 11:27:58 PST 2011
Errors in file /xxxx/bsspindb_mrp0_11342.trc:
ORA-01237: cannot extend datafile 7
ORA-01110: data file 7: '/oracle/folder/undotbs2_01.dbf'
ORA-19502: write error on file "/oracle/folder/undotbs2_01.dbf", blockno 102713 (blocksize=8192)
ORA-27072: File I/O error
HPUX-ia64 Error: 11: Resource temporarily unavailable
Additional information: 4
Additional information: 102713
Additional information: 456704
Sun Aug 07 11:27:58 PST 2011
MRP0: Background Media Recovery process shutdown (bsspindb)
trace file contents:
=============
*** 2011-08-07 11:27:32.542
*** 2011-08-07 11:27:32.542 64896 kcrr.c
MRP0: Background Media Recovery terminated with error 1237
ORA-01237: cannot extend datafile 7
ORA-01110: data file 7: '/oracle/folder/undotbs2_01.dbf'
ORA-19502: write error on file "/oracle/folder/undotbs2_01.dbf", blockno 102713 (blocksize=8192)
ORA-27072: File I/O error
HPUX-ia64 Error: 11: Resource temporarily unavailable
Additional information: 4
Additional information: 102713
Additional information: 456704
----- Redo read statistics for thread 2 -----
Read rate (SYNC): 2651607Kb in 18054.67s => 0.14 Mb/sec
Total physical reads: 2651607Kb
Longest record: 14Kb, moves: 0/9426662 (0%)
Change moves: 1382412/14790845 (9%), moved: 503Mb
Longest LWN: 1081Kb, moves: 204/935910 (0%), moved: 5Mb
Last redo scn: 0x0807.6e5e2a25 (8828009458213)
----------------------------------------------
*** 2011-08-07 11:27:32.557
Media Recovery drop redo thread 2
----- Redo read statistics for thread 1 -----
Read rate (SYNC): 2696445Kb in 18836.08s => 0.14 Mb/sec
Total physical reads: 2696445Kb
Longest record: 64Kb, moves: 0/7997789 (0%)
Change moves: 1622690/11754876 (13%), moved: 701Mb
Longest LWN: 1974Kb, moves: 237/591888 (0%), moved: 22Mb
Last redo scn: 0x0807.6e5e2a03 (8828009458179)
----------------------------------------------
*** 2011-08-07 11:27:32.557
Media Recovery drop redo thread 1
*** 2011-08-07 11:27:58.586
Recovery is currently unrecoverable!
*** 2011-08-07 11:27:58.586 1170 krsm.c
Managed Recovery: Not Active posted.
ORA-01237: cannot extend datafile 7
ORA-01110: data file 7: '/oracle/folder/undotbs2_01.dbf'
ORA-19502: write error on file "/oracle/folder/undotbs2_01.dbf", blockno 102713 (blocksize=8192)
ORA-27072: File I/O error
HPUX-ia64 Error: 11: Resource temporarily unavailable
Additional information: 4
Additional information: 102713
Additional information: 456704
*** 2011-08-07 11:27:58.590 64896 kcrr.c
MRP0: Background Media Recovery process shutdown
*** 2011-08-07 11:27:58.590 1170 krsm.c
++++++++++++++++++++++++++++++++++
Any idea, how to troubleshoot the issue and restart the MRP process.
Thanks..
Regards,
X