Integration

Announcement

For appeals, questions and feedback about Oracle Forums, please email oracle-forums-moderators_us@oracle.com. Technical questions should be asked in the appropriate category. Thank you!

Stuck thread in soa 11g

shan_jdevJan 24 2017 — edited Jan 26 2017

Dear Friends,

Please see the following stuck thread info and thread dump;which is the root cause?

my env is soa 11.1.1.7

Name: [STUCK] ExecuteThread: '28' for queue: 'weblogic.kernel.Default (self-tuning)'

Total Requests : 9171363

Current Request : Workmanager: default, Version: 0, Scheduled=true, Started=true, Started time: 158391062 ms [ POST /soa-infra/services/COMP/GBL_COMP_GraphicInfo/gbl_comp_graphicinfobpel_client_ep?WSDL

HTTP/1.1 Content-Type: text/xml; charset=utf-8 SOAPAction: "GetPersonalInfo" Content-Length: 451 User-Agent: Java1.6.0_45 Accept: text/html, image/gif, image/jpeg, */*; q=.2

ECID-Context: 1.005HelfshGD8XroLGUw0yf0007i1002^jm;kXjE9ZDLIPHCJVBSjHPBdUQPmHRBnLQSqPRO_JVB8HHG4VBH2SJN8HHG4VMLJKHPhVRHmHOScPRO9UQPjVBPYSRNcHPO^VMTnKPPhVRPmHOScPROdUQPjIOS_SRNZSPQ_UOTVLOS

Connection: Keep-Alive X-Forwarded-For: 10.XX.XX.93 Proxy-Client-IP: 10.XX.XX.100 X-WebLogic-KeepAliveSecs: 30 X-WebLogic-Force-JVMID: -2022805915 ]

THREAD DUMP

"[STUCK] ExecuteThread: '28' for queue: 'weblogic.kernel.Default (self-tuning)'" id=14322 idx=0x1b0 tid=29170 prio=1 alive, in native, daemon

at jrockit/net/SocketNativeIO.readBytesPinned(Ljava/io/FileDescriptor;[BIII)I(Native Method)

at jrockit/net/SocketNativeIO.socketRead(SocketNativeIO.java:32)[inlined]

at java/net/SocketInputStream.socketRead0(Ljava/io/FileDescriptor;[BIII)I(SocketInputStream.java)[inlined]

at java/net/SocketInputStream.read(SocketInputStream.java:129)[optimized]

at com/sun/net/ssl/internal/ssl/InputRecord.readFully(InputRecord.java:422)[optimized]

at com/sun/net/ssl/internal/ssl/InputRecord.read(InputRecord.java:460)[inlined]

at com/sun/net/ssl/internal/ssl/SSLSocketImpl.readRecord(SSLSocketImpl.java:863)[inlined]

at com/sun/net/ssl/internal/ssl/SSLSocketImpl.readDataRecord(SSLSocketImpl.java:820)[inlined]

at com/sun/net/ssl/internal/ssl/AppInputStream.read(AppInputStream.java:75)[optimized]

^-- Holding lock: java/lang/Object@0xbbefefa8[thin lock]

^-- Holding lock: com/sun/net/ssl/internal/ssl/AppInputStream@0xbbeff080[biased lock]

at HTTPClient/BufferedInputStream.fillBuff(BufferedInputStream.java:206)[optimized]

at HTTPClient/BufferedInputStream.read(BufferedInputStream.java:126)[optimized]

at HTTPClient/StreamDemultiplexor.read(StreamDemultiplexor.java:362)[optimized]

^-- Holding lock: HTTPClient/StreamDemultiplexor@0xc3721828[recursive]

at HTTPClient/RespInputStream.read(RespInputStream.java:151)[inlined]

at HTTPClient/RespInputStream.read(RespInputStream.java:112)[optimized]

^-- Holding lock: HTTPClient/StreamDemultiplexor@0xc3721828[recursive]

at HTTPClient/Response.readResponseHeaders(Response.java:1144)[optimized]

at HTTPClient/Response.getHeaders(Response.java:867)[inlined]

at HTTPClient/Response.getStatusCode(Response.java:331)[inlined]

at HTTPClient/RetryModule.responsePhase1Handler(RetryModule.java:94)[optimized]

^-- Holding lock: HTTPClient/StreamDemultiplexor@0xc3721828[thin lock]

at HTTPClient/HTTPResponse.handleResponseImpl(HTTPResponse.java:872)[optimized]

at HTTPClient/HTTPResponse.access$000(HTTPResponse.java:62)[inlined]

at HTTPClient/HTTPResponse$2.run(HTTPResponse.java:839)[optimized]

at HTTPClient/HTTPResponse$2.run(HTTPResponse.java:837)

at HTTPClient/HttpClientConfiguration.doAction(HttpClientConfiguration.java:708)[optimized]

at HTTPClient/HTTPResponse.handleResponse(HTTPResponse.java:837)

^-- Holding lock: HTTPClient/HTTPResponse@0xc37219e0[biased lock]

at HTTPClient/HTTPResponse.getStatusCode(HTTPResponse.java:242)[inlined]

at HTTPClient/HttpURLConnection.getResponseCode(HttpURLConnection.java:449)[inlined]

at oracle/j2ee/ws/saaj/client/p2p/HttpSOAPConnection.processHttpResponseCode(HttpSOAPConnection.java:562)[optimized]

at oracle/j2ee/ws/saaj/client/p2p/HttpSOAPConnection.post2(HttpSOAPConnection.java:501)[inlined]

at oracle/j2ee/ws/saaj/client/p2p/HttpSOAPConnection$PrivilegedPost.run(HttpSOAPConnection.java:1287)[optimized]

at jrockit/vm/AccessController.doPrivileged(AccessController.java:254)[inlined]

at jrockit/vm/AccessController.doPrivileged(AccessController.java:268)[inlined]

at oracle/j2ee/ws/saaj/client/p2p/HttpSOAPConnection.call2(HttpSOAPConnection.java:229)[inlined]

at oracle/j2ee/ws/common/transport/HttpTransport.transmit(HttpTransport.java:75)[optimized]

at oracle/j2ee/ws/common/async/MessageSender.call(MessageSender.java:67)[inlined]

at oracle/j2ee/ws/common/async/Transmitter.transmitSync(Transmitter.java:134)[inlined]

at oracle/j2ee/ws/common/async/Transmitter.transmit(Transmitter.java:90)[optimized]

at oracle/j2ee/ws/common/async/RequestorImpl.transmit(RequestorImpl.java:273)[inlined]

at oracle/j2ee/ws/common/async/RequestorImpl.invoke(RequestorImpl.java:94)[inlined]

at oracle/j2ee/ws/client/jaxws/DispatchImpl.invoke(DispatchImpl.java:824)[optimized]

at oracle/j2ee/ws/client/jaxws/OracleDispatchImpl.synchronousInvocationWithRetry(OracleDispatchImpl.java:235)[inlined]

at oracle/j2ee/ws/client/jaxws/OracleDispatchImpl.invoke(OracleDispatchImpl.java:106)[optimized]

at oracle/integration/platform/blocks/soap/AbstractWebServiceBindingComponent.dispatchRequest(AbstractWebServiceBindingComponent.java:563)[inlined]

at oracle/integration/platform/blocks/soap/WebServiceExternalBindingComponent.processOutboundMessage(WebServiceExternalBindingComponent.java:287)[optimized]

at oracle/integration/platform/blocks/soap/WebServiceExternalBindingComponent.sendSOAPMessage(WebServiceExternalBindingComponent.java:1191)[inlined]

at oracle/integration/platform/blocks/soap/WebServiceExternalBindingComponent.request(WebServiceExternalBindingComponent.java:785)[optimized]

at oracle/integration/platform/blocks/mesh/SynchronousMessageHandler.doRequest(SynchronousMessageHandler.java:139)[optimized]

at oracle/integration/platform/blocks/mesh/MessageRouter.request(MessageRouter.java:182)[optimized]

at oracle/integration/platform/blocks/mesh/MeshImpl.request(MeshImpl.java:190)[optimized]

at sun/reflect/GeneratedMethodAccessor2002.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;(Unknown Source)[optimized]

at sun/reflect/DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)[optimized]

at java/lang/reflect/Method.invoke(Method.java:597)[optimized]

at org/springframework/aop/support/AopUtils.invokeJoinpointUsingReflection(AopUtils.java:307)[inlined]

at org/springframework/aop/framework/ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:182)[inlined]

at org/springframework/aop/framework/ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:149)[optimized]

at oracle/integration/platform/metrics/PhaseEventAspect.invoke(PhaseEventAspect.java:71)[optimized]

at org/springframework/aop/framework/ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:171)[optimized]

at org/springframework/aop/framework/JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)[optimized]

at com/sun/proxy/$Proxy356.request(Loracle/fabric/common/NormalizedMessage;Loracle/fabric/common/Operation;Loracle/fabric/common/InvocationContext;)Loracle/fabric/common/NormalizedMessage;(Unknown Source)[optimized]

at oracle/fabric/CubeServiceEngine.requestToMesh(CubeServiceEngine.java:858)[optimized]

at com/collaxa/cube/ws/WSInvocationManager.invoke(WSInvocationManager.java:267)[optimized]

at com/collaxa/cube/engine/ext/common/InvokeHandler.__invoke(InvokeHandler.java:1099)[optimized]

at com/collaxa/cube/engine/ext/common/InvokeHandler.handleNormalInvoke(InvokeHandler.java:594)[optimized]

at com/collaxa/cube/engine/ext/common/InvokeHandler.handle(InvokeHandler.java:132)[inlined]

at com/collaxa/cube/engine/ext/bpel/common/wmp/BPELInvokeWMP.__executeStatements(BPELInvokeWMP.java:74)[optimized]

at com/collaxa/cube/engine/ext/bpel/common/wmp/BaseBPELActivityWMP.perform(BaseBPELActivityWMP.java:173)[optimized]

at com/collaxa/cube/engine/CubeEngine.performActivity(CubeEngine.java:2718)[optimized]

at com/collaxa/cube/engine/CubeEngine._handleWorkItem(CubeEngine.java:1197)[optimized]

at com/collaxa/cube/engine/CubeEngine.handleWorkItem(CubeEngine.java:1100)[optimized]

at com/collaxa/cube/engine/dispatch/message/instance/PerformMessageHandler.handleLocal(PerformMessageHandler.java:76)[optimized]

at com/collaxa/cube/engine/dispatch/DispatchHelper.handleLocalMessage(DispatchHelper.java:251)[inlined]

at com/collaxa/cube/engine/dispatch/DispatchHelper.sendMemory(DispatchHelper.java:330)[optimized]

at com/collaxa/cube/engine/CubeEngine.endRequest(CubeEngine.java:4652)[inlined]

at com/collaxa/cube/engine/CubeEngine.endRequest(CubeEngine.java:4583)[inlined]

at com/collaxa/cube/engine/CubeEngine._createAndInvoke(CubeEngine.java:714)[inlined]

at com/collaxa/cube/engine/CubeEngine.createAndInvoke(CubeEngine.java:559)[optimized]

at com/collaxa/cube/engine/ejb/impl/CubeEngineBean.createAndInvoke(CubeEngineBean.java:103)[inlined]

at com/collaxa/cube/engine/ejb/impl/CubeEngineBean.syncCreateAndInvokeParticipate(CubeEngineBean.java:181)[optimized]

at sun/reflect/GeneratedMethodAccessor2258.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;(Unknown Source)[optimized]

at sun/reflect/DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)[optimized]

at java/lang/reflect/Method.invoke(Method.java:597)[optimized]

at com/bea/core/repackaged/springframework/aop/support/AopUtils.invokeJoinpointUsingReflection(AopUtils.java:310)[inlined]

at com/bea/core/repackaged/springframework/aop/framework/ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:182)[inlined]

at com/bea/core/repackaged/springframework/aop/framework/ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:149)[optimized]

at com/oracle/pitchfork/intercept/MethodInvocationInvocationContext.proceed(MethodInvocationInvocationContext.java:103)[optimized]

at oracle/security/jps/ee/ejb/JpsAbsInterceptor$1.run(JpsAbsInterceptor.java:113)[optimized]

at jrockit/vm/AccessController.doPrivileged(AccessController.java:254)[inlined]

at oracle/security/jps/util/JpsSubject.doAsPrivileged(JpsSubject.java:324)[inlined]

at oracle/security/jps/ee/util/JpsPlatformUtil.runJaasMode(JpsPlatformUtil.java:460)[inlined]

at oracle/security/jps/ee/ejb/JpsAbsInterceptor.runJaasMode(JpsAbsInterceptor.java:100)[inlined]

at oracle/security/jps/ee/ejb/JpsAbsInterceptor.intercept(JpsAbsInterceptor.java:154)[optimized]

at oracle/security/jps/ee/ejb/JpsInterceptor.intercept(JpsInterceptor.java:113)[inlined]

at sun/reflect/GeneratedMethodAccessor1311.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;(Unknown Source)[optimized]

at sun/reflect/DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)[optimized]

at java/lang/reflect/Method.invoke(Method.java:597)[optimized]

at com/bea/core/repackaged/springframework/aop/support/AopUtils.invokeJoinpointUsingReflection(AopUtils.java:310)[inlined]

at com/oracle/pitchfork/intercept/JeeInterceptorInterceptor.invoke(JeeInterceptorInterceptor.java:68)[optimized]

at com/bea/core/repackaged/springframework/aop/framework/ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:171)[optimized]

at com/bea/core/repackaged/springframework/aop/support/DelegatingIntroductionInterceptor.doProceed(DelegatingIntroductionInterceptor.java:131)[inlined]

at com/bea/core/repackaged/springframework/aop/support/DelegatingIntroductionInterceptor.invoke(DelegatingIntroductionInterceptor.java:119)[optimized]

at com/bea/core/repackaged/springframework/aop/framework/ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:171)[optimized]

at com/oracle/pitchfork/spi/MethodInvocationVisitorImpl.visit(MethodInvocationVisitorImpl.java:34)[optimized]

at weblogic/ejb/container/injection/EnvironmentInterceptorCallbackImpl.callback(EnvironmentInterceptorCallbackImpl.java:54)[optimized]

at com/oracle/pitchfork/spi/EnvironmentInterceptor.invoke(EnvironmentInterceptor.java:42)[optimized]

at com/bea/core/repackaged/springframework/aop/framework/ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:171)[optimized]

at com/bea/core/repackaged/springframework/aop/interceptor/ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:89)[optimized]

at com/bea/core/repackaged/springframework/aop/framework/ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:171)[optimized]

at com/bea/core/repackaged/springframework/aop/support/DelegatingIntroductionInterceptor.doProceed(DelegatingIntroductionInterceptor.java:131)[inlined]

at com/bea/core/repackaged/springframework/aop/support/DelegatingIntroductionInterceptor.invoke(DelegatingIntroductionInterceptor.java:119)[optimized]

at com/bea/core/repackaged/springframework/aop/framework/ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:171)[optimized]

at com/bea/core/repackaged/springframework/aop/framework/JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)[optimized]

at com/sun/proxy/$Proxy342.syncCreateAndInvokeParticipate(Loracle/soa/management/ComponentDN;Ljava/lang/String;Ljava/lang/String;Loracle/fabric/common/NormalizedMessage;)Lcom/collaxa/cube/engine/dispatch/message/IMessage;(Unknown Source)

at com/collaxa/cube/engine/ejb/impl/bpel/BPELEngineBean_51369e_ICubeEngineLocalBeanImpl.__WL_invoke(Ljava/lang/Object;[Ljava/lang/Object;I)Ljava/lang/Object;(Unknown Source)[inlined]

at weblogic/ejb/container/internal/SessionLocalMethodInvoker.invoke(SessionLocalMethodInvoker.java:39)[inlined]

at com/collaxa/cube/engine/ejb/impl/bpel/BPELEngineBean_51369e_ICubeEngineLocalBeanImpl.syncCreateAndInvokeParticipate(Loracle/soa/management/ComponentDN;Ljava/lang/String;Ljava/lang/String;Loracle/fabric/common/NormalizedMessage;)Lcom/collaxa/cube/engine/dispatch/message/IMessage;(Unknown Source)[optimized]

at com/collaxa/cube/engine/delivery/DeliveryHandler.callCreateAndInvoke(DeliveryHandler.java:914)[optimized]

at com/collaxa/cube/engine/delivery/DeliveryHandler.initialRequestAnyType(DeliveryHandler.java:631)[optimized]

at com/collaxa/cube/engine/delivery/DeliveryHandler.initialRequest(DeliveryHandler.java:565)[inlined]

at com/collaxa/cube/engine/delivery/DeliveryHandler.request(DeliveryHandler.java:238)[optimized]

at com/collaxa/cube/engine/ejb/impl/CubeDeliveryBean.request(CubeDeliveryBean.java:541)[optimized]

at sun/reflect/GeneratedMethodAccessor2257.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;(Unknown Source)[optimized]