Hi all,
RHEL 5.6 Linux x86-64bit 11.2.0.3.0
While trying to create a sqlfile for a fairly large dump file (~1TB) i recieve the following errors:
ORA-39014: One or more workers have prematurely exited.
ORA-39029: worker 1 with process name "DW00" prematurely terminated
ORA-31671: Worker process DW00 had an unhandled exception.
ORA-04030: out of process memory when trying to allocate 16048 bytes (session heap,kuxLpxAlloc)
ORA-06512: at "SYS.KUPW$WORKER", line 1838
ORA-06512: at line 2
The server has 72GB of memory and I've set aside 28GB for SGA and 13GB for PGA. The system utilizes huge pages (42GB).
I've checked the PGA memory usage for the impdp processes and it never goes beyond ~4GB. And there are approx. 24GB of free memory on the OS when the failure hits.
These are my kernel limits:
core file size (blocks, -c) 0
data seg size (kbytes, -d) unlimited
scheduling priority (-e) 0
file size (blocks, -f) unlimited
pending signals (-i) 593919
max locked memory (kbytes, -l) 44040192
max memory size (kbytes, -m) unlimited
open files (-n) 65536
pipe size (512 bytes, -p) 8
POSIX message queues (bytes, -q) 819200
real-time priority (-r) 0
stack size (kbytes, -s) unlimited
cpu time (seconds, -t) unlimited
max user processes (-u) 16384
virtual memory (kbytes, -v) unlimited
file locks (-x) unlimited
the stack size was set to 10240, but was changed to unlimited on request from oracle support (yes I've got an SR on this as well).
my sysctl.conf:
vm.nr_hugepages=21504
kernel.shmmni = 4096
kernel.sem = 250 32000 100 128
fs.file-max = 6815744
net.ipv4.ip_local_port_range = 9000 65500
net.core.rmem_default = 262144
net.core.wmem_default = 262144
net.core.rmem_max = 4194304
net.core.wmem_max = 1048576
fs.aio-max-nr = 1048576
kernel.shmmax = 37978374144
kernel.shmall = 11272192
The system is not memory starved but still it fails with out of memory. Does anyone have any tip on how to further investigate/resolve this?
edit: oh, i forgot to say, if i run the impdp sqlfile and exclude statistics it works..
Thank you!
Edited by: AJ on 20.jan.2012 02:36