The Backup Process was killed by system when I Backup Oracle RAC
608395Jan 6 2012 — edited Jan 7 2012HI all:
I use RMAN and MML to backup my Oracle Rac. When it backup 60GB (it total 300GB),the oracle backup process was killed by the system.
the follow is the system log from syslog.log file:
Jan 5 10:54:57 hpux01 vmunix: Pid 24142 was killed due to failure in writing the signal context - possible stack overflow.
And the follow is the trc log from Oracle:
/ora_backup/szyy/orcl_ora_24142.trc
Oracle Database 10g Enterprise Edition Release 10.2.0.3.0 - 64bit Production
With the Partitioning, Real Application Clusters, OLAP and Data Mining options
ORACLE_HOME = /u01/app/oracle/product/10.2.0/racdb
System name: HP-UX
Node name: hpux01
Release: B.11.31
Version: U
Machine: ia64
Instance name: orcl
Redo thread mounted by this instance: 1
Oracle process number: 131
Unix process pid: 24142, image: oracleorcl@hpux01
*** 2012-01-05 09:55:32.576
*** ACTION NAME:(0000067 STARTED16) 2012-01-05 09:55:32.567
*** MODULE NAME:(backup incr datafile) 2012-01-05 09:55:32.567
*** SERVICE NAME:(kmyb) 2012-01-05 09:55:32.567
*** SESSION ID:(4044.1365) 2012-01-05 09:55:32.567
WARNING:Oracle process running out of OS kernel I/O resources
*** 2012-01-05 09:58:59.396
*** ACTION NAME:(0000071 STARTED16) 2012-01-05 09:58:59.396
WARNING:Oracle process running out of OS kernel I/O resources
WARNING:Oracle process running out of OS kernel I/O resources
*** 2012-01-05 09:59:28.666
WARNING:Oracle process running out of OS kernel I/O resources
*** 2012-01-05 10:00:27.749
*** ACTION NAME:(0000073 STARTED16) 2012-01-05 10:00:27.749
WARNING:Oracle process running out of OS kernel I/O resources
WARNING:Oracle process running out of OS kernel I/O resources
*** 2012-01-05 10:04:40.215
*** ACTION NAME:(0000077 STARTED16) 2012-01-05 10:04:40.215
WARNING:Oracle process running out of OS kernel I/O resources
WARNING:Oracle process running out of OS kernel I/O resources
*** 2012-01-05 10:05:20.131
WARNING:Oracle process running out of OS kernel I/O resources
WARNING:Oracle process running out of OS kernel I/O resources
WARNING:Oracle process running out of OS kernel I/O resources
WARNING:Oracle process running out of OS kernel I/O resources
*** 2012-01-05 10:06:49.812
*** ACTION NAME:(0000079 STARTED16) 2012-01-05 10:06:49.812
WARNING:Oracle process running out of OS kernel I/O resources
WARNING:Oracle process running out of OS kernel I/O resources
*** 2012-01-05 10:07:23.498
WARNING:Oracle process running out of OS kernel I/O resources
WARNING:Oracle process running out of OS kernel I/O resources
WARNING:Oracle process running out of OS kernel I/O resources
*** 2012-01-05 10:09:06.092
*** ACTION NAME:(0000081 STARTED16) 2012-01-05 10:09:06.091
WARNING:Oracle process running out of OS kernel I/O resources
*** 2012-01-05 10:11:26.153
*** ACTION NAME:(0000083 STARTED16) 2012-01-05 10:11:26.153
WARNING:Oracle process running out of OS kernel I/O resources
WARNING:Oracle process running out of OS kernel I/O resources
WARNING:Oracle process running out of OS kernel I/O resources
*** 2012-01-05 10:12:50.144
*** ACTION NAME:(0000085 STARTED16) 2012-01-05 10:12:50.144
WARNING:Oracle process running out of OS kernel I/O resources
WARNING:Oracle process running out of OS kernel I/O resources
WARNING:Oracle process running out of OS kernel I/O resources
WARNING:Oracle process running out of OS kernel I/O resources
*** 2012-01-05 10:15:09.731
*** ACTION NAME:(0000087 STARTED16) 2012-01-05 10:15:09.731
WARNING:Oracle process running out of OS kernel I/O resources
*** 2012-01-05 10:17:47.068
*** ACTION NAME:(0000089 STARTED16) 2012-01-05 10:17:47.068
WARNING:Oracle process running out of OS kernel I/O resources
*** 2012-01-05 10:18:29.698
*** ACTION NAME:(0000091 STARTED16) 2012-01-05 10:18:29.698
WARNING:Oracle process running out of OS kernel I/O resources
WARNING:Oracle process running out of OS kernel I/O resources
WARNING:Oracle process running out of OS kernel I/O resources
*** 2012-01-05 10:20:32.236
*** ACTION NAME:(0000093 STARTED16) 2012-01-05 10:20:32.236
WARNING:Oracle process running out of OS kernel I/O resources
*** 2012-01-05 10:20:57.822
WARNING:Oracle process running out of OS kernel I/O resources
*** 2012-01-05 10:23:11.251
*** ACTION NAME:(0000095 STARTED16) 2012-01-05 10:23:11.251
WARNING:Oracle process running out of OS kernel I/O resources
WARNING:Oracle process running out of OS kernel I/O resources
WARNING:Oracle process running out of OS kernel I/O resources
*** 2012-01-05 10:25:21.496
*** ACTION NAME:(0000097 STARTED16) 2012-01-05 10:25:21.496
WARNING:Oracle process running out of OS kernel I/O resources
*** 2012-01-05 10:26:40.743
*** ACTION NAME:(0000099 STARTED16) 2012-01-05 10:26:40.743
WARNING:Oracle process running out of OS kernel I/O resources
WARNING:Oracle process running out of OS kernel I/O resources
*** 2012-01-05 10:26:52.331
WARNING:Oracle process running out of OS kernel I/O resources
*** 2012-01-05 10:27:11.566
WARNING:Oracle process running out of OS kernel I/O resources
WARNING:Oracle process running out of OS kernel I/O resources
*** 2012-01-05 10:27:24.826
WARNING:Oracle process running out of OS kernel I/O resources
*** 2012-01-05 10:31:00.760
*** ACTION NAME:(0000103 STARTED16) 2012-01-05 10:31:00.759
WARNING:Oracle process running out of OS kernel I/O resources
*** 2012-01-05 10:31:25.595
WARNING:Oracle process running out of OS kernel I/O resources
*** 2012-01-05 10:31:45.456
WARNING:Oracle process running out of OS kernel I/O resources
WARNING:Oracle process running out of OS kernel I/O resources
*** 2012-01-05 10:33:58.612
*** ACTION NAME:(0000105 STARTED16) 2012-01-05 10:33:58.612
WARNING:Oracle process running out of OS kernel I/O resources
WARNING:Oracle process running out of OS kernel I/O resources
*** 2012-01-05 10:35:13.323
*** ACTION NAME:(0000107 STARTED16) 2012-01-05 10:35:13.323
WARNING:Oracle process running out of OS kernel I/O resources
*** 2012-01-05 10:37:59.764
*** ACTION NAME:(0000109 STARTED16) 2012-01-05 10:37:59.764
WARNING:Oracle process running out of OS kernel I/O resources
WARNING:Oracle process running out of OS kernel I/O resources
WARNING:Oracle process running out of OS kernel I/O resources
*** 2012-01-05 10:42:27.364
*** ACTION NAME:(0000113 STARTED16) 2012-01-05 10:42:27.364
WARNING:Oracle process running out of OS kernel I/O resources
WARNING:Oracle process running out of OS kernel I/O resources
WARNING:Oracle process running out of OS kernel I/O resources
*** 2012-01-05 10:46:54.632
*** ACTION NAME:(0000117 STARTED16) 2012-01-05 10:46:54.632
WARNING:Oracle process running out of OS kernel I/O resources
*** 2012-01-05 10:47:52.295
*** ACTION NAME:(0000119 STARTED16) 2012-01-05 10:47:52.295
WARNING:Oracle process running out of OS kernel I/O resources
*** 2012-01-05 10:52:31.041
*** ACTION NAME:(0000123 STARTED16) 2012-01-05 10:52:31.041
WARNING:Oracle process running out of OS kernel I/O resources
*** 2012-01-05 10:54:20.123
*** ACTION NAME:(0000125 STARTED16) 2012-01-05 10:54:20.123
WARNING:Oracle process running out of OS kernel I/O resources
*** 2012-01-05 10:54:41.410
WARNING:Oracle process running out of OS kernel I/O resources
WARNING:Oracle process running out of OS kernel I/O resources