Hi,
One of our customer's is seeing intermittent JVM crashes running weblogic 8.1SP6 app server on JDK 1.4.2_15, i.e. every three weeks or so.
It crashes during executing of the compilerthread on some code in a jsp page. I've included a sample "hs_pid.log" file.
We have not seen this in any of our testing or other production instances. I've researched and found similar bugs, but on jdk 1.5, not on jdk 1.4
We must use jdk 1.4.2 as weblogic 8.1 does not support jdk 1.5 or later.
Would an earlier jdk offer more stability? Also, we could switch to jrockit jvm, but would prefer to stay with sun jdk. Any other suggestions?
thanks in advance,
bill
#
# An unexpected error has been detected by HotSpot Virtual Machine:
#
# EXCEPTION_STACK_OVERFLOW (0xc00000fd) at pc=0x080ae88d, pid=3704, tid=3700
#
# Java VM: Java HotSpot(TM) Server VM (1.4.2_15-b02 mixed mode)
# Problematic frame:
# V [jvm.dll+0xae88d]
#
--------------- T H R E A D ---------------
Current thread (0x005c6628): JavaThread "CompilerThread0" daemon [_thread_in_native, id=3700]
siginfo: ExceptionCode=0xc00000fd, ExceptionInformation=0x00000001 0x03e20ffc
Registers:
EAX=0x089c0bf0, EBX=0x089c0bf0, ECX=0x00005622, EDX=0x0822403c
ESP=0x03e21000, EBP=0x03e5f53c, ESI=0x00000000, EDI=0x03e5f49c
EIP=0x080ae88d, EFLAGS=0x00010206
Top of Stack: (sp=0x03e21000)
0x03e21000: 00000000 00000033 08bff3f8 03e5f53c
0x03e21010: 080ae9aa 03e5f49c 089c0bf0 03e5f49c
0x03e21020: 00000000 00000001 08bff3b8 03e5f53c
0x03e21030: 080ae9aa 03e5f49c 08bff3f8 03e5f49c
0x03e21040: 00000000 00000002 08bff388 03e5f53c
0x03e21050: 080ae9aa 03e5f49c 08bff3b8 03e5f49c
0x03e21060: 00000000 00000001 08bff35c 03e5f53c
0x03e21070: 080ae9aa 03e5f49c 08bff388 03e5f49c
Instructions: (pc=0x080ae88d)
0x080ae87d: 90 90 90 51 53 8b 5c 24 10 55 8b e9 8b 4b 1c 56
0x080ae88d: 57 8b 7c 24 18 8b d1 89 6c 24 10 8b 47 08 c1 ea
Stack: [0x03e20000,0x03e60000), sp=0x03e21000, free space=4k
Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)
V [jvm.dll+0xae88d]
Current CompileTask:
opto:234% ! jsp_servlet._qa._include.__guidedsearchincl._jspService(Ljavax/servlet/http/HttpServletRequest;Ljavax/servlet/http/HttpServletResponse;)V @ 2612 (14208 bytes)
--------------- P R O C E S S ---------------
Java Threads: ( => current thread )
0x044c3dd0 JavaThread "Background Batch Spiller 2" daemon [_thread_blocked, id=2436]
0x05b8cc20 JavaThread "Java2D Disposer" daemon [_thread_blocked, id=6100]
0x04730628 JavaThread "Background Batch Spiller 1" daemon [_thread_blocked, id=5316]
0x05d01de8 JavaThread "Background Batch Spiller 0" daemon [_thread_blocked, id=4336]
0x05a2f008 JavaThread "AWT-Windows" daemon [_thread_in_native, id=4372]
0x05a2f170 JavaThread "JRC Timeout Thread" daemon [_thread_blocked, id=2300]
0x05a2f5a8 JavaThread "Thread-57" daemon [_thread_blocked, id=4456]
0x05b5a938 JavaThread "Thread-19" daemon [_thread_blocked, id=5960]
0x0524c118 JavaThread "ExecuteThread: '5' for queue: 'JMS.TimerClientPool'" daemon [_thread_blocked, id=1380]
0x05081140 JavaThread "ExecuteThread: '4' for queue: 'JMS.TimerClientPool'" daemon [_thread_blocked, id=2796]
0x05592170 JavaThread "ExecuteThread: '3' for queue: 'JMS.TimerClientPool'" daemon [_thread_blocked, id=3524]
0x05592008 JavaThread "ExecuteThread: '2' for queue: 'JMS.TimerClientPool'" daemon [_thread_blocked, id=4824]
0x05979d90 JavaThread "ExecuteThread: '1' for queue: 'JMS.TimerClientPool'" daemon [_thread_blocked, id=2812]
0x0471bb90 JavaThread "ExecuteThread: '0' for queue: 'JMS.TimerClientPool'" daemon [_thread_blocked, id=2532]
0x043ad458 JavaThread "SSLListenThread.Default" [_thread_in_native, id=2704]
0x05332f60 JavaThread "ListenThread.Default" [_thread_in_native, id=5560]
0x051e5840 JavaThread "Thread-18" daemon [_thread_blocked, id=5596]
0x046a2848 JavaThread "Thread-17" daemon [_thread_blocked, id=6072]
0x058ebe68 JavaThread "Thread-16" [_thread_blocked, id=3612]
0x04806460 JavaThread "Thread-14" daemon [_thread_blocked, id=5836]
0x04806008 JavaThread "Thread-13" daemon [_thread_blocked, id=5944]
0x043497d8 JavaThread "Thread-12" [_thread_blocked, id=3736]
0x047ccad0 JavaThread "Thread-11" daemon [_thread_blocked, id=4656]
0x044b9d70 JavaThread "Thread-10" [_thread_blocked, id=4836]
0x0540a260 JavaThread "Thread-9" daemon [_thread_blocked, id=5616]
0x04975500 JavaThread "Thread-8" daemon [_thread_blocked, id=3480]
0x04519008 JavaThread "ExecuteThread: '0' for queue: 'JMS.TimerTreePool'" daemon [_thread_blocked, id=3956]
0x04795138 JavaThread "Thread-7" [_thread_blocked, id=5824]
0x0460feb0 JavaThread "Thread-6" [_thread_blocked, id=3356]
0x05054518 JavaThread "weblogic.health.CoreHealthMonitor" daemon [_thread_blocked, id=5100]
0x0443ec20 JavaThread "Thread-5" [_thread_blocked, id=2448]
0x040dfa88 JavaThread "DoSManager" [_thread_blocked, id=5876]
0x04b02d50 JavaThread "VDE Transaction Processor Thread" [_thread_blocked, id=716]
0x0496e818 JavaThread "ExecuteThread: '2' for queue: 'weblogic.admin.RMI'" daemon [_thread_blocked, id=5160]
0x0496e600 JavaThread "ExecuteThread: '1' for queue: 'weblogic.admin.RMI'" daemon [_thread_blocked, id=4304]
0x0496e098 JavaThread "ExecuteThread: '0' for queue: 'weblogic.admin.RMI'" daemon [_thread_blocked, id=2420]
0x0496df30 JavaThread "ExecuteThread: '1' for queue: 'weblogic.admin.HTTP'" daemon [_thread_blocked, id=5460]
0x04975668 JavaThread "ExecuteThread: '0' for queue: 'weblogic.admin.HTTP'" daemon [_thread_blocked, id=2548]
0x04c99b80 JavaThread "weblogic.security.SpinnerRandomSource" daemon [_thread_blocked, id=2416]
0x04c998e0 JavaThread "weblogic.time.TimeEventGenerator" daemon [_thread_blocked, id=6080]
0x049b22a0 JavaThread "ExecuteThread: '4' for queue: 'weblogic.kernel.System'" daemon [_thread_blocked, id=1716]
0x04a80cf8 JavaThread "ExecuteThread: '3' for queue: 'weblogic.kernel.System'" daemon [_thread_blocked, id=2392]
0x048f98d0 JavaThread "ExecuteThread: '2' for queue: 'weblogic.kernel.System'" daemon [_thread_blocked, id=4240]
0x048f9228 JavaThread "ExecuteThread: '1' for queue: 'weblogic.kernel.System'" daemon [_thread_blocked, id=4640]
0x047a4920 JavaThread "ExecuteThread: '0' for queue: 'weblogic.kernel.System'" daemon [_thread_blocked, id=5108]
0x04371668 JavaThread "ExecuteThread: '24' for queue: 'weblogic.kernel.Default'" daemon [_thread_blocked, id=5000]
0x0523d9e0 JavaThread "ExecuteThread: '23' for queue: 'weblogic.kernel.Default'" daemon [_thread_blocked, id=5376]
0x04b9d618 JavaThread "ExecuteThread: '22' for queue: 'weblogic.kernel.Default'" daemon [_thread_blocked, id=1728]
0x04b9ca18 JavaThread "ExecuteThread: '21' for queue: 'weblogic.kernel.Default'" daemon [_thread_blocked, id=868]
0x047974a8 JavaThread "ExecuteThread: '20' for queue: 'weblogic.kernel.Default'" daemon [_thread_blocked, id=5744]
0x04da5800 JavaThread "ExecuteThread: '19' for queue: 'weblogic.kernel.Default'" daemon [_thread_blocked, id=4768]
0x04ddab48 JavaThread "ExecuteThread: '18' for queue: 'weblogic.kernel.Default'" daemon [_thread_blocked, id=5840]
0x04dda008 JavaThread "ExecuteThread: '17' for queue: 'weblogic.kernel.Default'" daemon [_thread_in_native, id=2688]
0x04ee9d48 JavaThread "ExecuteThread: '16' for queue: 'weblogic.kernel.Default'" daemon [_thread_blocked, id=3968]
0x04ee95e0 JavaThread "ExecuteThread: '15' for queue: 'weblogic.kernel.Default'" daemon [_thread_blocked, id=3936]
0x04b1a948 JavaThread "ExecuteThread: '14' for queue: 'weblogic.kernel.Default'" daemon [_thread_blocked, id=4620]
0x04ed1c88 JavaThread "ExecuteThread: '13' for queue: 'weblogic.kernel.Default'" daemon [_thread_blocked, id=2196]
0x04ed1148 JavaThread "ExecuteThread: '12' for queue: 'weblogic.kernel.Default'" daemon [_thread_blocked, id=5128]
0x0494d408 JavaThread "ExecuteThread: '11' for queue: 'weblogic.kernel.Default'" daemon [_thread_blocked, id=5532]
0x0434bb48 JavaThread "ExecuteThread: '10' for queue: 'weblogic.kernel.Default'" daemon [_thread_blocked, id=3808]
0x0434b808 JavaThread "ExecuteThread: '9' for queue: 'weblogic.kernel.Default'" daemon [_thread_blocked, id=1972]
0x04e119f0 JavaThread "ExecuteThread: '8' for queue: 'weblogic.kernel.Default'" daemon [_thread_blocked, id=5332]
0x04e11888 JavaThread "ExecuteThread: '7' for queue: 'weblogic.kernel.Default'" daemon [_thread_blocked, id=4840]
0x04f6ac28 JavaThread "ExecuteThread: '6' for queue: 'weblogic.kernel.Default'" daemon [_thread_blocked, id=4196]
0x04f6a9f8 JavaThread "ExecuteThread: '5' for queue: 'weblogic.kernel.Default'" daemon [_thread_blocked, id=4180]
0x04f6a7c8 JavaThread "ExecuteThread: '4' for queue: 'weblogic.kernel.Default'" daemon [_thread_blocked, id=4912]
0x04e111d0 JavaThread "ExecuteThread: '3' for queue: 'weblogic.kernel.Default'" daemon [_thread_blocked, id=3536]
0x04e11038 JavaThread "ExecuteThread: '2' for queue: 'weblogic.kernel.Default'" daemon [_thread_blocked, id=2104]
0x04e5fe10 JavaThread "ExecuteThread: '1' for queue: 'weblogic.kernel.Default'" daemon [_thread_blocked, id=4688]
0x04e5fca8 JavaThread "ExecuteThread: '0' for queue: 'weblogic.kernel.Default'" daemon [_thread_blocked, id=5984]
0x040085d8 JavaThread "Thread-1" daemon [_thread_blocked, id=2556]
0x005c75d0 JavaThread "CompilerThread1" daemon [_thread_blocked, id=3424]
=>0x005c6628 JavaThread "CompilerThread0" daemon [_thread_in_native, id=3700]
0x005c5838 JavaThread "AdapterThread" daemon [_thread_blocked, id=4316]
0x005c4cb8 JavaThread "Signal Dispatcher" daemon [_thread_blocked, id=4624]
0x005c2300 JavaThread "Finalizer" daemon [_thread_blocked, id=4696]
0x005c1770 JavaThread "Reference Handler" daemon [_thread_blocked, id=5456]
0x005a0e78 JavaThread "main" [_thread_blocked, id=4988]
Other Threads:
0x005b8388 VMThread [id=636]
0x00676398 WatcherThread [id=1032]
VM state:not at safepoint (normal execution)
VM Mutex/Monitor currently owned by a thread: None
Heap
def new generation total 104832K, used 52088K [0x10010000, 0x171d0000, 0x171d0000)
eden space 93184K, 53% used [0x10010000, 0x130b8b58, 0x15b10000)
from space 11648K, 19% used [0x16670000, 0x168a54c0, 0x171d0000)
to space 11648K, 0% used [0x15b10000, 0x15b10000, 0x16670000)
tenured generation total 932096K, used 663755K [0x171d0000, 0x50010000, 0x50010000)
the space 932096K, 71% used [0x171d0000, 0x3fa02d18, 0x3fa02e00, 0x50010000)
compacting perm gen total 88576K, used 88420K [0x50010000, 0x55690000, 0x58010000)
the space 88576K, 99% used [0x50010000, 0x556690f8, 0x55669200, 0x55690000)
Dynamic libraries:
0x00400000 - 0x0040e000 D:\SERVER~1\bea\WEBLOG~1\server\bin\beasvc.exe
0x7c800000 - 0x7c8c0000 C:\WINDOWS\system32\ntdll.dll
0x77e40000 - 0x77f42000 C:\WINDOWS\system32\kernel32.dll
0x77f50000 - 0x77feb000 C:\WINDOWS\system32\ADVAPI32.dll
0x77c50000 - 0x77cef000 C:\WINDOWS\system32\RPCRT4.dll
0x76f50000 - 0x76f63000 C:\WINDOWS\system32\Secur32.dll
0x71bd0000 - 0x71be1000 C:\WINDOWS\system32\MPR.dll
0x77380000 - 0x77411000 C:\WINDOWS\system32\USER32.dll
0x77c00000 - 0x77c48000 C:\WINDOWS\system32\GDI32.dll
0x77ba0000 - 0x77bfa000 C:\WINDOWS\system32\MSVCRT.dll
0x08000000 - 0x082bd000 C:\Program Files\Java\j2sdk1.4.2_15\jre\bin\server\jvm.dll
0x76aa0000 - 0x76acd000 C:\WINDOWS\system32\WINMM.dll
0x71bc0000 - 0x71bc8000 C:\WINDOWS\system32\rdpsnd.dll
0x771f0000 - 0x77201000 C:\WINDOWS\system32\WINSTA.dll
0x71c40000 - 0x71c97000 C:\WINDOWS\system32\NETAPI32.dll
0x76b70000 - 0x76b7b000 C:\WINDOWS\system32\PSAPI.DLL
0x10000000 - 0x10007000 C:\Program Files\Java\j2sdk1.4.2_15\jre\bin\hpi.dll
0x00730000 - 0x0073e000 C:\Program Files\Java\j2sdk1.4.2_15\jre\bin\verify.dll
0x00740000 - 0x00759000 C:\Program Files\Java\j2sdk1.4.2_15\jre\bin\java.dll
0x00760000 - 0x0076e000 C:\Program Files\Java\j2sdk1.4.2_15\jre\bin\zip.dll
0x04100000 - 0x0410f000 C:\Program Files\Java\j2sdk1.4.2_15\jre\bin\net.dll
0x71c00000 - 0x71c17000 C:\WINDOWS\system32\WS2_32.dll
0x71bf0000 - 0x71bf8000 C:\WINDOWS\system32\WS2HELP.dll
0x71b20000 - 0x71b61000 C:\WINDOWS\System32\mswsock.dll
0x76ed0000 - 0x76efa000 C:\WINDOWS\system32\DNSAPI.dll
0x76f70000 - 0x76f77000 C:\WINDOWS\System32\winrnr.dll
0x76f10000 - 0x76f3e000 C:\WINDOWS\system32\WLDAP32.dll
0x76f80000 - 0x76f85000 C:\WINDOWS\system32\rasadhlp.dll
0x067c0000 - 0x067c8000 C:\Program Files\Java\j2sdk1.4.2_15\jre\bin\nio.dll
0x06850000 - 0x06856000 C:\Program Files\Java\j2sdk1.4.2_15\jre\bin\ioser12.dll
0x5f270000 - 0x5f2ca000 C:\WINDOWS\system32\hnetcfg.dll
0x71ae0000 - 0x71ae8000 C:\WINDOWS\System32\wshtcpip.dll
0x06a20000 - 0x06a25000 D:\serverapps\bea\weblogic81\server\bin\stackdump.dll
0x06f30000 - 0x07044000 C:\Program Files\Java\j2sdk1.4.2_15\jre\bin\awt.dll
0x73070000 - 0x73097000 C:\WINDOWS\system32\WINSPOOL.DRV
0x76290000 - 0x762ad000 C:\WINDOWS\system32\IMM32.dll
0x77670000 - 0x777a9000 C:\WINDOWS\system32\ole32.dll
0x072a0000 - 0x072f2000 C:\Program Files\Java\j2sdk1.4.2_15\jre\bin\fontmanager.dll
0x73860000 - 0x738ab000 C:\WINDOWS\system32\ddraw.dll
0x73b30000 - 0x73b36000 C:\WINDOWS\system32\DCIMAN32.dll
0x738b0000 - 0x73980000 C:\WINDOWS\system32\D3DIM700.DLL
0x68000000 - 0x68035000 C:\WINDOWS\system32\rsaenh.dll
0x7c8d0000 - 0x7d0cf000 C:\WINDOWS\system32\SHELL32.dll
0x77da0000 - 0x77df2000 C:\WINDOWS\system32\SHLWAPI.dll
0x77420000 - 0x77523000 C:\WINDOWS\WinSxS\x86_Microsoft.Windows.Common-Controls_6595b64144ccf1df_6.0.3790.3959_x-ww_D8713E55\comctl32.dll
0x767a0000 - 0x767d6000 C:\WINDOWS\system32\spool\DRIVERS\W32X86\3\UNIDRVUI.DLL
0x767e0000 - 0x76825000 C:\WINDOWS\system32\spool\DRIVERS\W32X86\3\UNIDRV.DLL
0x762b0000 - 0x762f9000 C:\WINDOWS\system32\COMDLG32.DLL
0x77530000 - 0x775c7000 C:\WINDOWS\WinSxS\x86_Microsoft.Windows.Common-Controls_6595b64144ccf1df_5.82.3790.3959_x-ww_78FCF8D0\COMCTL32.dll
VM Arguments:
jvm_args: -Xms1024m -Xmx1024m -XX:MaxNewSize=128m -XX:MaxPermSize=128m -Xbootclasspath/p:./lib/ext/xalan.jar -Dweblogic.Stdout=D:/serverapps/bea\user_projects\domains\pedomain\stdout.txt -Dweblogic.Stderr=D:/serverapps/bea\user_projects\domains\pedomain\stderr.txt -Dweblogic.Name=peserver -Dweblogic.management.username= -Dweblogic.ProductionModeEnabled=true -Djava.security.policy=D:\SERVER~1\bea\WEBLOG~1\server\lib\weblogic.policy -Dweblogic.management.password=x= -Dweblogic.management.startmode=WinSvc exit
java_command: <unknown>
Launcher Type: generic
Environment Variables:
PATH=D:\SERVER~1\bea\WEBLOG~1\server\bin;C:/Program Files/Java/j2sdk1.4.2_15\bin;D:\serverapps\oracle\product\10.2.0\client_1\bin;C:\WINDOWS\system32;C:\WINDOWS;C:\WINDOWS\System32\Wbem;d:\serverapps\pstools;D:\Serverapps\Dell\SysMgt\RAC5;D:\Serverapps\Dell\SysMgt\oma\bin;D:\Serverapps\Dell\SysMgt\oma\oldiags\bin;D:\serverapps\Diskeeper Corporation\Diskeeper\
OS=Windows_NT
PROCESSOR_IDENTIFIER=x86 Family 6 Model 15 Stepping 11, GenuineIntel
--------------- S Y S T E M ---------------
OS: Windows Server 2003 family Build 3790 Service Pack 2
CPU:total 8 family 6, cmov, cx8, fxsr, mmx, sse, sse2
Memory: 4k page, physical 2097151k(2097151k free), swap 4194303k(4194303k free)
vm_info: Java HotSpot(TM) Server VM (1.4.2_15-b02) for windows-x86, built on May 22 2007 16:52:42 by "java_re" with MS VC++ 6.0