We have two node WebLogic (10.3.6) cluster and Two Node RAC (18c) at backend. Recently we are experiencing HIGH CPU
on second weblogic Node for a Managed server process and end use experiencing performance degradation due to this issue in managed server on node 2.
As a workaround we have stopped the managed server on node as now load balancer is servicing the end user requests from Node 1 as there is no high CPU issue.
NOTE: Load balancer is service end user from both the nodes for other Managed servers.
Below is the THREAD DUMP from the Problem managed server PID.
Dear Experts any insight or issue finding or pointing root cause will be highly valuable for us.
2023-06-16 10:25:01
Full thread dump Java HotSpot(TM) 64-Bit Server VM (24.80-b11 mixed mode):
"RMI TCP Connection(20)-10.1.1.187" daemon prio=6 tid=0x0000000044d68000 nid=0x3078 runnable [0x000000005c37e000]
java.lang.Thread.State: RUNNABLE
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.read(Unknown Source)
at java.net.SocketInputStream.read(Unknown Source)
at java.io.BufferedInputStream.fill(Unknown Source)
at java.io.BufferedInputStream.read(Unknown Source)
- locked <0x0000000754574010> (a java.io.BufferedInputStream)
at java.io.FilterInputStream.read(Unknown Source)
at sun.rmi.transport.tcp.TCPTransport.handleMessages(Unknown Source)
at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run0(Unknown Source)
at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.access$400(Unknown Source)
at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler$1.run(Unknown Source)
at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler$1.run(Unknown Source)
at java.security.AccessController.doPrivileged(Native Method)
at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run(Unknown Source)
at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.lang.Thread.run(Unknown Source)
Locked ownable synchronizers:
- <0x0000000754573788> (a java.util.concurrent.ThreadPoolExecutor$Worker)
"Worker-3" daemon prio=6 tid=0x0000000044d6b800 nid=0x3568 in Object.wait() [0x000000005d37f000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x0000000586c85908> (a oracle.ias.cache.TaskQ)
at oracle.ias.cache.TaskQ.waitForWork(TaskQ.java:255)
- eliminated <0x0000000586c85908> (a oracle.ias.cache.TaskQ)
at oracle.ias.cache.TaskQ.getTask(TaskQ.java:138)
- locked <0x0000000586c85908> (a oracle.ias.cache.TaskQ)
at oracle.ias.cache.WorkerThread.run(ThreadPool.java:303)
Locked ownable synchronizers:
- None
"Worker-1" daemon prio=6 tid=0x0000000044d6b000 nid=0x35f8 in Object.wait() [0x000000005932e000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x0000000586c85908> (a oracle.ias.cache.TaskQ)
at oracle.ias.cache.TaskQ.waitForWork(TaskQ.java:255)
- eliminated <0x0000000586c85908> (a oracle.ias.cache.TaskQ)
at oracle.ias.cache.TaskQ.getTask(TaskQ.java:138)
- locked <0x0000000586c85908> (a oracle.ias.cache.TaskQ)
at oracle.ias.cache.WorkerThread.run(ThreadPool.java:303)
Locked ownable synchronizers:
- None
"Worker-0" daemon prio=6 tid=0x0000000044d63800 nid=0x3480 in Object.wait() [0x0000000058eaf000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x0000000586c85908> (a oracle.ias.cache.TaskQ)
at oracle.ias.cache.TaskQ.waitForWork(TaskQ.java:255)
- eliminated <0x0000000586c85908> (a oracle.ias.cache.TaskQ)
at oracle.ias.cache.TaskQ.getTask(TaskQ.java:138)
- locked <0x0000000586c85908> (a oracle.ias.cache.TaskQ)
at oracle.ias.cache.WorkerThread.run(ThreadPool.java:303)
Locked ownable synchronizers:
- None
"Worker-4" daemon prio=6 tid=0x0000000044d65000 nid=0x305c in Object.wait() [0x00000000579ef000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x0000000586c85908> (a oracle.ias.cache.TaskQ)
at oracle.ias.cache.TaskQ.waitForWork(TaskQ.java:255)
- eliminated <0x0000000586c85908> (a oracle.ias.cache.TaskQ)
at oracle.ias.cache.TaskQ.getTask(TaskQ.java:138)
- locked <0x0000000586c85908> (a oracle.ias.cache.TaskQ)
at oracle.ias.cache.WorkerThread.run(ThreadPool.java:303)
Locked ownable synchronizers:
- None
"Timer-50" daemon prio=6 tid=0x0000000044d66800 nid=0x2d14 in Object.wait() [0x000000005c8ef000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x000000074a348750> (a java.util.TaskQueue)
at java.util.TimerThread.mainLoop(Unknown Source)
- locked <0x000000074a348750> (a java.util.TaskQueue)
at java.util.TimerThread.run(Unknown Source)
Locked ownable synchronizers:
- None
"Thread-10822" daemon prio=6 tid=0x0000000044d67000 nid=0x3520 runnable [0x000000005d52e000]
java.lang.Thread.State: RUNNABLE
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.read(Unknown Source)
at java.net.SocketInputStream.read(Unknown Source)
at java.io.BufferedInputStream.fill(Unknown Source)
at java.io.BufferedInputStream.read1(Unknown Source)
at java.io.BufferedInputStream.read(Unknown Source)
- locked <0x0000000747439558> (a java.io.BufferedInputStream)
at com.sun.jndi.ldap.Connection.run(Unknown Source)
at java.lang.Thread.run(Unknown Source)
Locked ownable synchronizers:
- None
"Worker-2" daemon prio=6 tid=0x0000000044d64000 nid=0x34ac in Object.wait() [0x000000005abcf000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x0000000586c85908> (a oracle.ias.cache.TaskQ)
at oracle.ias.cache.TaskQ.waitForWork(TaskQ.java:255)
- eliminated <0x0000000586c85908> (a oracle.ias.cache.TaskQ)
at oracle.ias.cache.TaskQ.getTask(TaskQ.java:138)
- locked <0x0000000586c85908> (a oracle.ias.cache.TaskQ)
at oracle.ias.cache.WorkerThread.run(ThreadPool.java:303)
Locked ownable synchronizers:
- None
"[STANDBY] ExecuteThread: '128' for queue: 'weblogic.kernel.Default (self-tuning)'" daemon prio=6 tid=0x0000000044d61000 nid=0x3550 in Object.wait() [0x000000005d91f000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000006e46c5230> (a weblogic.work.ExecuteThread)
at java.lang.Object.wait(Object.java:503)
at weblogic.work.ExecuteThread.waitForRequest(ExecuteThread.java:205)
- locked <0x00000006e46c5230> (a weblogic.work.ExecuteThread)
at weblogic.work.ExecuteThread.run(ExecuteThread.java:226)
Locked ownable synchronizers:
- None
"[STANDBY] ExecuteThread: '127' for queue: 'weblogic.kernel.Default (self-tuning)'" daemon prio=6 tid=0x0000000044d60800 nid=0x355c in Object.wait() [0x00000000591df000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000006e43bc3b8> (a weblogic.work.ExecuteThread)
at java.lang.Object.wait(Object.java:503)
at weblogic.work.ExecuteThread.waitForRequest(ExecuteThread.java:205)
- locked <0x00000006e43bc3b8> (a weblogic.work.ExecuteThread)
at weblogic.work.ExecuteThread.run(ExecuteThread.java:226)
Locked ownable synchronizers:
- None
"[ACTIVE] ExecuteThread: '126' for queue: 'weblogic.kernel.Default (self-tuning)'" daemon prio=6 tid=0x0000000044d5f800 nid=0x33a0 in Object.wait() [0x000000005d7df000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000006e43bd8b8> (a weblogic.work.ExecuteThread)
at java.lang.Object.wait(Object.java:503)
at weblogic.work.ExecuteThread.waitForRequest(ExecuteThread.java:205)
- locked <0x00000006e43bd8b8> (a weblogic.work.ExecuteThread)
at weblogic.work.ExecuteThread.run(ExecuteThread.java:226)
Locked ownable synchronizers:
- None
"JMX server connection timeout 11423" daemon prio=6 tid=0x0000000043935800 nid=0x37c8 in Object.wait() [0x000000005d03f000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000006e2b87388> (a [I)
at com.sun.jmx.remote.internal.ServerCommunicatorAdmin$Timeout.run(Unknown Source)
- locked <0x00000006e2b87388> (a [I)
at java.lang.Thread.run(Unknown Source)
Locked ownable synchronizers:
- None
"RMI Scheduler(0)" daemon prio=6 tid=0x0000000054487000 nid=0x30bc waiting on condition [0x00000000599be000]
java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000006e03d8f30> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(Unknown Source)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(Unknown Source)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(Unknown Source)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(Unknown Source)
at java.util.concurrent.ThreadPoolExecutor.getTask(Unknown Source)
at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.lang.Thread.run(Unknown Source)
Locked ownable synchronizers:
- None
"RMI TCP Connection(19)-10.1.1.187" daemon prio=6 tid=0x0000000054482800 nid=0x33dc runnable [0x000000005cefe000]
java.lang.Thread.State: RUNNABLE
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.read(Unknown Source)
at java.net.SocketInputStream.read(Unknown Source)
at java.io.BufferedInputStream.fill(Unknown Source)
at java.io.BufferedInputStream.read(Unknown Source)
- locked <0x00000007543638d8> (a java.io.BufferedInputStream)
at java.io.FilterInputStream.read(Unknown Source)
at sun.rmi.transport.tcp.TCPTransport.handleMessages(Unknown Source)
at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run0(Unknown Source)
at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.access$400(Unknown Source)
at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler$1.run(Unknown Source)
at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler$1.run(Unknown Source)
at java.security.AccessController.doPrivileged(Native Method)
at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run(Unknown Source)
at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.lang.Thread.run(Unknown Source)
Locked ownable synchronizers:
- <0x00000006e00f81b0> (a java.util.concurrent.ThreadPoolExecutor$Worker)
"RMI TCP Accept-0" daemon prio=6 tid=0x0000000054485800 nid=0x1278 runnable [0x000000005cd1e000]
java.lang.Thread.State: RUNNABLE
at java.net.DualStackPlainSocketImpl.accept0(Native Method)
at java.net.DualStackPlainSocketImpl.socketAccept(Unknown Source)
at java.net.AbstractPlainSocketImpl.accept(Unknown Source)
at java.net.PlainSocketImpl.accept(Unknown Source)
- locked <0x00000006e00f8d40> (a java.net.SocksSocketImpl)
at java.net.ServerSocket.implAccept(Unknown Source)
at java.net.ServerSocket.accept(Unknown Source)
at sun.management.jmxremote.LocalRMIServerSocketFactory$1.accept(Unknown Source)
at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(Unknown Source)
at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(Unknown Source)
at java.lang.Thread.run(Unknown Source)
Locked ownable synchronizers:
- None
"[STANDBY] ExecuteThread: '125' for queue: 'weblogic.kernel.Default (self-tuning)'" daemon prio=6 tid=0x0000000046f28000 nid=0x2b8c in Object.wait() [0x000000005cb5f000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000006ca3cb0a0> (a weblogic.work.ExecuteThread)
at java.lang.Object.wait(Object.java:503)
at weblogic.work.ExecuteThread.waitForRequest(ExecuteThread.java:205)
- locked <0x00000006ca3cb0a0> (a weblogic.work.ExecuteThread)
at weblogic.work.ExecuteThread.run(ExecuteThread.java:226)
Locked ownable synchronizers:
- None
"[ACTIVE] ExecuteThread: '124' for queue: 'weblogic.kernel.Default (self-tuning)'" daemon prio=6 tid=0x0000000046f27000 nid=0x3348 in Object.wait() [0x000000005ca2f000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000006ca3bbc18> (a weblogic.work.ExecuteThread)
at java.lang.Object.wait(Object.java:503)
at weblogic.work.ExecuteThread.waitForRequest(ExecuteThread.java:205)
- locked <0x00000006ca3bbc18> (a weblogic.work.ExecuteThread)
at weblogic.work.ExecuteThread.run(ExecuteThread.java:226)
Locked ownable synchronizers:
- None
"[STANDBY] ExecuteThread: '123' for queue: 'weblogic.kernel.Default (self-tuning)'" daemon prio=6 tid=0x00000000502cc000 nid=0x312c in Object.wait() [0x0000000051f6f000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000006ca3b30b0> (a weblogic.work.ExecuteThread)
at java.lang.Object.wait(Object.java:503)
at weblogic.work.ExecuteThread.waitForRequest(ExecuteThread.java:205)
- locked <0x00000006ca3b30b0> (a weblogic.work.ExecuteThread)
at weblogic.work.ExecuteThread.run(ExecuteThread.java:226)
Locked ownable synchronizers:
- None
"[STANDBY] ExecuteThread: '122' for queue: 'weblogic.kernel.Default (self-tuning)'" daemon prio=6 tid=0x00000000502bd800 nid=0x3378 in Object.wait() [0x000000005623e000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000006ca3d0ee0> (a weblogic.work.ExecuteThread)
at java.lang.Object.wait(Object.java:503)
at weblogic.work.ExecuteThread.waitForRequest(ExecuteThread.java:205)
- locked <0x00000006ca3d0ee0> (a weblogic.work.ExecuteThread)
at weblogic.work.ExecuteThread.run(ExecuteThread.java:226)
Locked ownable synchronizers:
- None
"[STANDBY] ExecuteThread: '121' for queue: 'weblogic.kernel.Default (self-tuning)'" daemon prio=6 tid=0x00000000502c1000 nid=0x32b0 in Object.wait() [0x000000005c7bf000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000006ca3ba7c8> (a weblogic.work.ExecuteThread)
at java.lang.Object.wait(Object.java:503)
at weblogic.work.ExecuteThread.waitForRequest(ExecuteThread.java:205)
- locked <0x00000006ca3ba7c8> (a weblogic.work.ExecuteThread)
at weblogic.work.ExecuteThread.run(ExecuteThread.java:226)
Locked ownable synchronizers:
- None
"[STANDBY] ExecuteThread: '120' for queue: 'weblogic.kernel.Default (self-tuning)'" daemon prio=6 tid=0x00000000502bd000 nid=0x3328 in Object.wait() [0x000000005c5ef000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000006ca3b6630> (a weblogic.work.ExecuteThread)
at java.lang.Object.wait(Object.java:503)
at weblogic.work.ExecuteThread.waitForRequest(ExecuteThread.java:205)
- locked <0x00000006ca3b6630> (a weblogic.work.ExecuteThread)
at weblogic.work.ExecuteThread.run(ExecuteThread.java:226)
Locked ownable synchronizers:
- None
"[STANDBY] ExecuteThread: '119' for queue: 'weblogic.kernel.Default (self-tuning)'" daemon prio=6 tid=0x000000004a4e2000 nid=0x307c in Object.wait() [0x000000005c47f000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000006ca3be5e8> (a weblogic.work.ExecuteThread)
at java.lang.Object.wait(Object.java:503)
at weblogic.work.ExecuteThread.waitForRequest(ExecuteThread.java:205)
- locked <0x00000006ca3be5e8> (a weblogic.work.ExecuteThread)
at weblogic.work.ExecuteThread.run(ExecuteThread.java:226)
Locked ownable synchronizers:
- None
"[STANDBY] ExecuteThread: '118' for queue: 'weblogic.kernel.Default (self-tuning)'" daemon prio=6 tid=0x000000004a4e1000 nid=0x1c60 in Object.wait() [0x000000005908f000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000006ca3ad3c8> (a weblogic.work.ExecuteThread)
at java.lang.Object.wait(Object.java:503)
at weblogic.work.ExecuteThread.waitForRequest(ExecuteThread.java:205)
- locked <0x00000006ca3ad3c8> (a weblogic.work.ExecuteThread)
at weblogic.work.ExecuteThread.run(ExecuteThread.java:226)
Locked ownable synchronizers:
- None
"[STANDBY] ExecuteThread: '117' for queue: 'weblogic.kernel.Default (self-tuning)'" daemon prio=6 tid=0x000000004a4df800 nid=0x3024 in Object.wait() [0x000000005c26f000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000006ca3c9c20> (a weblogic.work.ExecuteThread)
at java.lang.Object.wait(Object.java:503)
at weblogic.work.ExecuteThread.waitForRequest(ExecuteThread.java:205)
- locked <0x00000006ca3c9c20> (a weblogic.work.ExecuteThread)
at weblogic.work.ExecuteThread.run(ExecuteThread.java:226)
Locked ownable synchronizers:
- None
"[STANDBY] ExecuteThread: '116' for queue: 'weblogic.kernel.Default (self-tuning)'" daemon prio=6 tid=0x000000004a4e9800 nid=0x32c4 in Object.wait() [0x0000000057b4f000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000006ca3a9cf0> (a weblogic.work.ExecuteThread)
at java.lang.Object.wait(Object.java:503)
at weblogic.work.ExecuteThread.waitForRequest(ExecuteThread.java:205)
- locked <0x00000006ca3a9cf0> (a weblogic.work.ExecuteThread)
at weblogic.work.ExecuteThread.run(ExecuteThread.java:226)
Locked ownable synchronizers:
- None
"[STANDBY] ExecuteThread: '115' for queue: 'weblogic.kernel.Default (self-tuning)'" daemon prio=6 tid=0x000000004a4e0800 nid=0x31fc in Object.wait() [0x000000005aebf000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000006ca3ac258> (a weblogic.work.ExecuteThread)
at java.lang.Object.wait(Object.java:503)
at weblogic.work.ExecuteThread.waitForRequest(ExecuteThread.java:205)
- locked <0x00000006ca3ac258> (a weblogic.work.ExecuteThread)
at weblogic.work.ExecuteThread.run(ExecuteThread.java:226)
Locked ownable synchronizers:
- None
"[STANDBY] ExecuteThread: '114' for queue: 'weblogic.kernel.Default (self-tuning)'" daemon prio=6 tid=0x000000005447b000 nid=0x3030 in Object.wait() [0x000000005ad2f000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x000000062e447a08> (a weblogic.work.ExecuteThread)
at java.lang.Object.wait(Object.java:503)
at weblogic.work.ExecuteThread.waitForRequest(ExecuteThread.java:205)
- locked <0x000000062e447a08> (a weblogic.work.ExecuteThread)
at weblogic.work.ExecuteThread.run(ExecuteThread.java:226)
Locked ownable synchronizers:
- None
"[STANDBY] ExecuteThread: '113' for queue: 'weblogic.kernel.Default (self-tuning)'" daemon prio=6 tid=0x00000000502c9000 nid=0x2f44 in Object.wait() [0x000000005a33f000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000005a25c6528> (a weblogic.work.ExecuteThread)
at java.lang.Object.wait(Object.java:503)
at weblogic.work.ExecuteThread.waitForRequest(ExecuteThread.java:205)
- locked <0x00000005a25c6528> (a weblogic.work.ExecuteThread)
at weblogic.work.ExecuteThread.run(ExecuteThread.java:226)
Locked ownable synchronizers:
- None
"[ACTIVE] ExecuteThread: '112' for queue: 'weblogic.kernel.Default (self-tuning)'" daemon prio=6 tid=0x00000000502b1800 nid=0x3124 runnable [0x000000005b0ab000]
java.lang.Thread.State: RUNNABLE
at java.util.Vector.<init>(Unknown Source)
at java.util.Vector.<init>(Unknown Source)
at java.util.Vector.<init>(Unknown Source)
at oracle.adf.share.security.authorization.ADFPermission.parseActions(ADFPermission.java:169)
at oracle.adf.share.security.authorization.ADFPermission.<init>(ADFPermission.java:46)
at oracle.adf.controller.security.TaskFlowPermission.<init>(TaskFlowPermission.java:42)
at sun.reflect.GeneratedConstructorAccessor558.newInstance(Unknown Source)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(Unknown Source)
at java.lang.reflect.Constructor.newInstance(Unknown Source)
at oracle.adf.share.security.SecurityContextImpl.createPermissionInstance(SecurityContextImpl.java:821)
at oracle.adf.share.security.providers.jps.JpsSecurityContext.createPermissionInstance(JpsSecurityContext.java:380)
at oracle.adf.share.security.binding.BindingPermission.createPermissionInstance(BindingPermission.java:88)
at oracle.adf.share.security.binding.BindingPermission.hasPermission(BindingPermission.java:93)
at oracle.adf.model.binding.DCBindingContainer.internalIsViewable(DCBindingContainer.java:3829)
at oracle.adf.model.binding.DCBindingContainer.isViewable(DCBindingContainer.java:3789)
at oracle.adf.controller.internal.binding.TaskFlowRegionController.resetViewableFlag(TaskFlowRegionController.java:443)
at oracle.adf.controller.internal.binding.TaskFlowRegionController.doRegionRefresh(TaskFlowRegionController.java:262)
at oracle.adf.controller.internal.binding.TaskFlowRegionController.refreshRegion(TaskFlowRegionController.java:119)
at oracle.adf.model.binding.DCBindingContainer.internalRefreshControl(DCBindingContainer.java:3204)
at oracle.adf.model.binding.DCBindingContainer.refresh(DCBindingContainer.java:2876)
at com.fadata.insis.view.security.InsisPageControler.refreshRegion(InsisPageControler.java:134)
at oracle.adf.controller.internal.binding.TaskFlowRegionController.doRegionRefresh(TaskFlowRegionController.java:274)
at oracle.adf.controller.internal.binding.TaskFlowRegionController.refreshRegion(TaskFlowRegionController.java:119)
at oracle.adf.model.binding.DCBindingContainer.internalRefreshControl(DCBindingContainer.java:3204)
at oracle.adf.model.binding.DCBindingContainer.refresh(DCBindingContainer.java:2876)
at com.fadata.insis.view.security.InsisFesPageControler.refreshRegion(InsisFesPageControler.java:139)
at oracle.adf.controller.internal.binding.TaskFlowRegionController.doRegionRefresh(TaskFlowRegionController.java:274)
at oracle.adf.controller.internal.binding.TaskFlowRegionController.refreshRegion(TaskFlowRegionController.java:119)
at oracle.adf.model.binding.DCBindingContainer.internalRefreshControl(DCBindingContainer.java:3204)
at oracle.adf.model.binding.DCBindingContainer.refresh(DCBindingContainer.java:2876)
at oracle.adf.controller.v2.lifecycle.PageLifecycleImpl.prepareModel(PageLifecycleImpl.java:115)
at oracle.adf.controller.faces.lifecycle.FacesPageLifecycle.prepareModel(FacesPageLifecycle.java:359)
at com.fadata.insis.view.frameworkext.InsisFacesPageLifecycle.prepareModel(InsisFacesPageLifecycle.java:105)
at oracle.adf.controller.v2.lifecycle.Lifecycle$2.execute(Lifecycle.java:137)
at oracle.adfinternal.controller.lifecycle.LifecycleImpl.executePhase(LifecycleImpl.java:197)
at oracle.adfinternal.controller.faces.lifecycle.ADFPhaseListener.access$400(ADFPhaseListener.java:23)
at oracle.adfinternal.controller.faces.lifecycle.ADFPhaseListener$PhaseInvokerImpl.startPageLifecycle(ADFPhaseListener.java:238)
at oracle.adfinternal.controller.faces.lifecycle.ADFPhaseListener$1.after(ADFPhaseListener.java:274)
at oracle.adfinternal.controller.faces.lifecycle.ADFPhaseListener.afterPhase(ADFPhaseListener.java:75)
at oracle.adfinternal.controller.faces.lifecycle.ADFLifecyclePhaseListener.afterPhase(ADFLifecyclePhaseListener.java:53)
at oracle.adfinternal.view.faces.lifecycle.LifecycleImpl._executePhase(LifecycleImpl.java:472)
at oracle.adfinternal.view.faces.lifecycle.LifecycleImpl.execute(LifecycleImpl.java:194)
at javax.faces.webapp.FacesServlet.service(FacesServlet.java:265)
at weblogic.servlet.internal.StubSecurityHelper$ServletServiceAction.run(StubSecurityHelper.java:227)
at weblogic.servlet.internal.StubSecurityHelper.invokeServlet(StubSecurityHelper.java:125)
at weblogic.servlet.internal.ServletStubImpl.execute(ServletStubImpl.java:301)
at weblogic.servlet.internal.TailFilter.doFilter(TailFilter.java:26)
at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:60)
at oracle.adf.model.servlet.ADFBindingFilter.doFilter(ADFBindingFilter.java:205)
at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:60)
at oracle.adfinternal.view.faces.webapp.rich.RegistrationFilter.doFilter(RegistrationFilter.java:106)
at org.apache.myfaces.trinidadinternal.webapp.TrinidadFilterImpl$FilterListChain.doFilter(TrinidadFilterImpl.java:446)
at oracle.adfinternal.view.faces.activedata.AdsFilter.doFilter(AdsFilter.java:60)
at org.apache.myfaces.trinidadinternal.webapp.TrinidadFilterImpl$FilterListChain.doFilter(TrinidadFilterImpl.java:446)
at org.apache.myfaces.trinidadinternal.webapp.TrinidadFilterImpl._doFilterImpl(TrinidadFilterImpl.java:271)
at org.apache.myfaces.trinidadinternal.webapp.TrinidadFilterImpl.doFilter(TrinidadFilterImpl.java:177)
at org.apache.myfaces.trinidad.webapp.TrinidadFilter.doFilter(TrinidadFilter.java:92)
at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:60)
at com.fadata.insis.servlet.ContextInterceptor.doFilter(ContextInterceptor.java:122)
at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:60)
at oracle.adf.library.webapp.LibraryFilter.doFilter(LibraryFilter.java:179)
at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:60)
at oracle.security.jps.ee.http.JpsAbsFilter$1.run(JpsAbsFilter.java:119)
at java.security.AccessController.doPrivileged(Native Method)
at oracle.security.jps.util.JpsSubject.doAsPrivileged(JpsSubject.java:315)
at oracle.security.jps.ee.util.JpsPlatformUtil.runJaasMode(JpsPlatformUtil.java:442)
at oracle.security.jps.ee.http.JpsAbsFilter.runJaasMode(JpsAbsFilter.java:103)
at oracle.security.jps.ee.http.JpsAbsFilter.doFilter(JpsAbsFilter.java:171)
at oracle.security.jps.ee.http.JpsFilter.doFilter(JpsFilter.java:71)
at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:60)
at oracle.dms.servlet.DMSServletFilter.doFilter(DMSServletFilter.java:139)
at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:60)
at weblogic.servlet.internal.RequestEventsFilter.doFilter(RequestEventsFilter.java:27)
at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:60)
at weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.wrapRun(WebAppServletContext.java:3739)
at weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.run(WebAppServletContext.java:3705)
at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:321)
at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:120)
at weblogic.servlet.internal.WebAppServletContext.securedExecute(WebAppServletContext.java:2282)
at weblogic.servlet.internal.WebAppServletContext.execute(WebAppServletContext.java:2181)
at weblogic.servlet.internal.ServletRequestImpl.run(ServletRequestImpl.java:1491)
at weblogic.work.ExecuteThread.execute(ExecuteThread.java:256)
at weblogic.work.ExecuteThread.run(ExecuteThread.java:221)
Locked ownable synchronizers:
- <0x00000005a3621b90> (a java.util.concurrent.locks.ReentrantLock$NonfairSync)
"[ACTIVE] ExecuteThread: '111' for queue: 'weblogic.kernel.Default (self-tuning)'" daemon prio=6 tid=0x00000000502c4800 nid=0x2e5c in Object.wait() [0x000000005aa3f000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000005a25c43a8> (a weblogic.work.ExecuteThread)
at java.lang.Object.wait(Object.java:503)
at weblogic.work.ExecuteThread.waitForRequest(ExecuteThread.java:205)
- locked <0x00000005a25c43a8> (a weblogic.work.ExecuteThread)
at weblogic.work.ExecuteThread.run(ExecuteThread.java:226)
Locked ownable synchronizers:
- None
"[STANDBY] ExecuteThread: '110' for queue: 'weblogic.kernel.Default (self-tuning)'" daemon prio=6 tid=0x00000000502ce800 nid=0x30b0 in Object.wait() [0x000000005635f000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000005a1285d40> (a weblogic.work.ExecuteThread)
at java.lang.Object.wait(Object.java:503)
at weblogic.work.ExecuteThread.waitForRequest(ExecuteThread.java:205)
- locked <0x00000005a1285d40> (a weblogic.work.ExecuteThread)
at weblogic.work.ExecuteThread.run(ExecuteThread.java:226)
Locked ownable synchronizers:
- None
"Timer-35" daemon prio=6 tid=0x00000000502c4000 nid=0x3204 in Object.wait() [0x000000004d13f000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x000000059a9cd038> (a java.util.TaskQueue)
at java.util.TimerThread.mainLoop(Unknown Source)
- locked <0x000000059a9cd038> (a java.util.TaskQueue)
at java.util.TimerThread.run(Unknown Source)
Locked ownable synchronizers:
- None
"[STANDBY] ExecuteThread: '109' for queue: 'weblogic.kernel.Default (self-tuning)'" daemon prio=6 tid=0x00000000502b6000 nid=0x2d5c in Object.wait() [0x000000005a88f000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x000000059a8db228> (a weblogic.work.ExecuteThread)
at java.lang.Object.wait(Object.java:503)
at weblogic.work.ExecuteThread.waitForRequest(ExecuteThread.java:205)
- locked <0x000000059a8db228> (a weblogic.work.ExecuteThread)
at weblogic.work.ExecuteThread.run(ExecuteThread.java:226)
Locked ownable synchronizers:
- None
"[ACTIVE] ExecuteThread: '108' for queue: 'weblogic.kernel.Default (self-tuning)'" daemon prio=6 tid=0x00000000502b5800 nid=0x1b90 runnable [0x000000005a6dc000]
java.lang.Thread.State: RUNNABLE
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.read(Unknown Source)
at java.net.SocketInputStream.read(Unknown Source)
at oracle.net.nt.MetricsEnabledInputStream.read(TcpNTAdapter.java:730)
at oracle.net.ns.Packet.receive(Packet.java:302)
at oracle.net.ns.DataPacket.receive(DataPacket.java:108)
at oracle.net.ns.NetInputStream.getNextPacket(NetInputStream.java:317)
at oracle.net.ns.NetInputStream.read(NetInputStream.java:262)
at oracle.net.ns.NetInputStream.read(NetInputStream.java:187)
at oracle.net.ns.NetInputStream.read(NetInputStream.java:104)
at oracle.jdbc.driver.T4CSocketInputStreamWrapper.readNextPacket(T4CSocketInputStreamWrapper.java:126)
at oracle.jdbc.driver.T4CSocketInputStreamWrapper.read(T4CSocketInputStreamWrapper.java:82)
at oracle.jdbc.driver.T4CMAREngine.unmarshalUB1(T4CMAREngine.java:1178)
at oracle.jdbc.driver.T4CTTIfun.receive(T4CTTIfun.java:314)
at oracle.jdbc.driver.T4CTTIfun.doRPC(T4CTTIfun.java:205)
at oracle.jdbc.driver.T4C8Oall.doOALL(T4C8Oall.java:548)
at oracle.jdbc.driver.T4CCallableStatement.doOall8(T4CCallableStatement.java:213)
at oracle.jdbc.driver.T4CCallableStatement.executeForRows(T4CCallableStatement.java:1111)
at oracle.jdbc.driver.OracleStatement.doExecuteWithTimeout(OracleStatement.java:1488)
at oracle.jdbc.driver.OraclePreparedStatement.executeInternal(OraclePreparedStatement.java:3769)
at oracle.jdbc.driver.OraclePreparedStatement.execute(OraclePreparedStatement.java:3954)
- locked <0x0000000726