We're working on the upgrade from 5.1.2 to 20.1 in one of the applications, editing any page fails with 500 Internal Error from ORDS. There are 15 other apps on this workspace that have no issues.
This app is a little different in that it has several subscriptions to another app (which we can edit fine)
The failing process is the AJAX call to getPageData
This is a new environment, as a copy of 5.1.2 that was upgraded to 20.1
Help, where do we start troubleshooting? Thank you!
DB: Oracle Database 12c Enterprise Edition Release 12.2.0.1.0 - 64bit Production
We do have the following errors on catalina.out
Jun 09, 2020 12:30:25 PM
SEVERE: java.sql.SQLException: ORA-00600: internal error code, arguments: [15216], [], [], [], [], [], [], [], [], [], [], []
ORA-06512: at "SYS.DBMS_SQL", line 2144
ORA-06512: at "APEX_200100.WWV_FLOW_EXEC_LOCAL", line 216
ORA-06512: at "APEX_200100.WWV_FLOW_EXEC_LOCAL", line 1500
ORA-06512: at "APEX_200100.WWV_FLOW_EXEC_LOCAL", line 1551
ORA-06512: at "APEX_200100.WWV_FLOW_EXEC", line 4245
ORA-06512: at "APEX_200100.WWV_FLOW_EXEC_DEV", line 380
ORA-06512: at "APEX_200100.WWV_FLOW_PROPERTY_DEV", line 3290
ORA-06512: at "APEX_200100.WWV_FLOW_PROPERTY_DEV", line 4309
ORA-06512: at "APEX_200100.WWV_FLOW_PROPERTY_DEV", line 4400
ORA-06512: at line 2
ORA-06512: at "SYS.DBMS_SYS_SQL", line 2120
ORA-06512: at "SYS.WWV_DBMS_SQL_APEX_200100", line 590
ORA-06512: at "APEX_200100.WWV_FLOW_DYNAMIC_EXEC", line 2621
ORA-06512: at "APEX_200100.WWV_FLOW_DYNAMIC_EXEC", line 1514
ORA-06512: at "APEX_200100.WWV_FLOW_PPR_UTIL", line 197
ORA-06512: at "APEX_200100.WWV_FLOW", line 2908
ORA-06512: at "APEX_200100.WWV_FLOW", line 4300
ORA-06512: at line 2
InternalServerException [statusCode=500, reasons=[]]
at oracle.dbtools.apex.ModApexContext.handleError(ModApexContext.java:288)
at oracle.dbtools.apex.OWA.execute(OWA.java:206)
at oracle.dbtools.apex.ModApex.handleRequest(ModApex.java:310)
at oracle.dbtools.apex.ModApex.doPost(ModApex.java:188)
at oracle.dbtools.apex.ModApex.service(ModApex.java:112)
at oracle.dbtools.http.entrypoint.Dispatcher.dispatch(Dispatcher.java:143)
at oracle.dbtools.http.entrypoint.EntryPoint$FilteredServlet.service(EntryPoint.java:243)
at oracle.dbtools.http.filters.FilterChainImpl.doFilter(FilterChainImpl.java:73)
at oracle.dbtools.http.forwarding.QueryFilteringRewrite.doFilter(QueryFilteringRewrite.java:90)
at oracle.dbtools.http.filters.HttpFilter.doFilter(HttpFilter.java:47)
at oracle.dbtools.http.filters.FilterChainImpl.doFilter(FilterChainImpl.java:64)
at oracle.dbtools.http.forwarding.ForwardingFilter.doFilter(ForwardingFilter.java:68)
at oracle.dbtools.http.filters.HttpFilter.doFilter(HttpFilter.java:47)
at oracle.dbtools.http.filters.FilterChainImpl.doFilter(FilterChainImpl.java:64)
at oracle.dbtools.http.cors.CORSPreflightFilter.doFilter(CORSPreflightFilter.java:68)
at oracle.dbtools.http.filters.HttpFilter.doFilter(HttpFilter.java:47)
at oracle.dbtools.http.filters.FilterChainImpl.doFilter(FilterChainImpl.java:64)
at oracle.dbtools.http.cookies.auth.CookieSessionCSRFFilter.doFilter(CookieSessionCSRFFilter.java:75)
at oracle.dbtools.http.filters.HttpFilter.doFilter(HttpFilter.java:47)
at oracle.dbtools.http.filters.FilterChainImpl.doFilter(FilterChainImpl.java:64)
at oracle.dbtools.http.auth.AuthenticationFilter.authenticate(AuthenticationFilter.java:101)
at oracle.dbtools.http.auth.AuthenticationFilter.doFilter(AuthenticationFilter.java:64)
at oracle.dbtools.http.filters.HttpFilter.doFilter(HttpFilter.java:47)
at oracle.dbtools.http.filters.FilterChainImpl.doFilter(FilterChainImpl.java:64)
at oracle.dbtools.url.mapping.RequestMapperImpl.doFilter(RequestMapperImpl.java:160)
at oracle.dbtools.url.mapping.URLMappingBase.doFilter(URLMappingBase.java:95)
at oracle.dbtools.url.mapping.filter.URLMappingFilter.doFilter(URLMappingFilter.java:130)
at oracle.dbtools.http.filters.HttpFilter.doFilter(HttpFilter.java:47)
at oracle.dbtools.http.filters.FilterChainImpl.doFilter(FilterChainImpl.java:64)
at oracle.dbtools.http.auth.external.ExternalSessionFilter.doFilter(ExternalSessionFilter.java:59)
at oracle.dbtools.http.filters.HttpFilter.doFilter(HttpFilter.java:47)
at oracle.dbtools.http.filters.FilterChainImpl.doFilter(FilterChainImpl.java:64)
at oracle.dbtools.rt.authentication.apex.ApexSessionQueryRewriteFilter.doFilter(ApexSessionQueryRewriteFilter.java:58)
at oracle.dbtools.http.filters.HttpFilter.doFilter(HttpFilter.java:47)
at oracle.dbtools.http.filters.FilterChainImpl.doFilter(FilterChainImpl.java:64)
at oracle.dbtools.http.cors.CORSResponseFilter.doFilter(CORSResponseFilter.java:88)
at oracle.dbtools.http.filters.HttpResponseFilter.doFilter(HttpResponseFilter.java:45)
at oracle.dbtools.http.filters.FilterChainImpl.doFilter(FilterChainImpl.java:64)
at oracle.dbtools.http.filters.AbsoluteLocationFilter.doFilter(AbsoluteLocationFilter.java:65)
at oracle.dbtools.http.filters.HttpResponseFilter.doFilter(HttpResponseFilter.java:45)
at oracle.dbtools.http.filters.FilterChainImpl.doFilter(FilterChainImpl.java:64)
at oracle.dbtools.http.errors.ErrorPageFilter.doFilter(ErrorPageFilter.java:85)
at oracle.dbtools.http.filters.HttpFilter.doFilter(HttpFilter.java:47)
at oracle.dbtools.http.filters.FilterChainImpl.doFilter(FilterChainImpl.java:64)
at oracle.dbtools.http.secure.ForceHttpsFilter.doFilter(ForceHttpsFilter.java:74)
at oracle.dbtools.http.filters.HttpFilter.doFilter(HttpFilter.java:47)
at oracle.dbtools.http.filters.FilterChainImpl.doFilter(FilterChainImpl.java:64)
at oracle.dbtools.http.auth.ForceAuthFilter.doFilter(ForceAuthFilter.java:44)
at oracle.dbtools.http.filters.HttpFilter.doFilter(HttpFilter.java:47)
at oracle.dbtools.http.filters.FilterChainImpl.doFilter(FilterChainImpl.java:64)
at oracle.dbtools.http.filters.Filters.filter(Filters.java:67)
at oracle.dbtools.http.entrypoint.EntryPoint.service(EntryPoint.java:82)
at oracle.dbtools.http.entrypoint.EntryPointServlet.service(EntryPointServlet.java:102)
at oracle.dbtools.entrypoint.WebApplicationRequestEntryPoint.service(WebApplicationRequestEntryPoint.java:50)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:731)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:218)
at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:110)
at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:506)
at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:169)
at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103)
at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:962)
at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:116)
at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:445)
at org.apache.coyote.ajp.AjpProcessor.process(AjpProcessor.java:190)
at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:637)
at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:316)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.sql.SQLException: ORA-00600: internal error code, arguments: [15216], [], [], [], [], [], [], [], [], [], [], []
ORA-06512: at "SYS.DBMS_SQL", line 2144
ORA-06512: at "APEX_200100.WWV_FLOW_EXEC_LOCAL", line 216
ORA-06512: at "APEX_200100.WWV_FLOW_EXEC_LOCAL", line 1500
ORA-06512: at "APEX_200100.WWV_FLOW_EXEC_LOCAL", line 1551
ORA-06512: at "APEX_200100.WWV_FLOW_EXEC", line 4245
ORA-06512: at "APEX_200100.WWV_FLOW_EXEC_DEV", line 380
ORA-06512: at "APEX_200100.WWV_FLOW_PROPERTY_DEV", line 3290
ORA-06512: at "APEX_200100.WWV_FLOW_PROPERTY_DEV", line 4309
ORA-06512: at "APEX_200100.WWV_FLOW_PROPERTY_DEV", line 4400
ORA-06512: at line 2
ORA-06512: at "SYS.DBMS_SYS_SQL", line 2120
ORA-06512: at "SYS.WWV_DBMS_SQL_APEX_200100", line 590
ORA-06512: at "APEX_200100.WWV_FLOW_DYNAMIC_EXEC", line 2621
ORA-06512: at "APEX_200100.WWV_FLOW_DYNAMIC_EXEC", line 1514
ORA-06512: at "APEX_200100.WWV_FLOW_PPR_UTIL", line 197
ORA-06512: at "APEX_200100.WWV_FLOW", line 2908
ORA-06512: at "APEX_200100.WWV_FLOW", line 4300
ORA-06512: at line 2
at oracle.jdbc.driver.T4CTTIoer11.processError(T4CTTIoer11.java:509)
at oracle.jdbc.driver.T4CTTIoer11.processError(T4CTTIoer11.java:461)
at oracle.jdbc.driver.T4C8Oall.processError(T4C8Oall.java:1104)
at oracle.jdbc.driver.T4CTTIfun.receive(T4CTTIfun.java:550)
at oracle.jdbc.driver.T4CTTIfun.doRPC(T4CTTIfun.java:268)
at oracle.jdbc.driver.T4C8Oall.doOALL(T4C8Oall.java:655)
at oracle.jdbc.driver.T4CCallableStatement.doOall8(T4CCallableStatement.java:265)
at oracle.jdbc.driver.T4CCallableStatement.doOall8(T4CCallableStatement.java:86)
at oracle.jdbc.driver.T4CCallableStatement.executeForRows(T4CCallableStatement.java:965)
at oracle.jdbc.driver.OracleStatement.doExecuteWithTimeout(OracleStatement.java:1205)
at oracle.jdbc.driver.OraclePreparedStatement.executeInternal(OraclePreparedStatement.java:3666)
at oracle.jdbc.driver.T4CCallableStatement.executeInternal(T4CCallableStatement.java:1358)
at oracle.jdbc.driver.OraclePreparedStatement.execute(OraclePreparedStatement.java:3778)
at oracle.jdbc.driver.OracleCallableStatement.execute(OracleCallableStatement.java:4251)
at oracle.jdbc.driver.OraclePreparedStatementWrapper.execute(OraclePreparedStatementWrapper.java:1081)
at oracle.ucp.jdbc.proxy.oracle$1ucp$1jdbc$1proxy$1oracle$1StatementProxy$2oracle$1jdbc$1internal$1OracleCallableStatement$$$Proxy.execute(Unknown Source)
at oracle.dbtools.apex.OWA.execute(OWA.java:161)
... 73 more
Caused by: Error : 600, Position : 0, Sql = begin
wwv_flow.ajax(p_request=>:1 ,
p_json=>:2 ,
p_instance=>:3 ,
p_flow_step_id=>:4 ,
p_flow_id=>:5 ,
x01=>:6 ,
p_debug=>:7 );
commit;
end;, OriginalSql = begin
wwv_flow.ajax(p_request=>?,
p_json=>?,
p_instance=>?,
p_flow_step_id=>?,
p_flow_id=>?,
x01=>?,
p_debug=>?);
commit;
end;, Error Msg = ORA-00600: internal error code, arguments: [15216], [], [], [], [], [], [], [], [], [], [], []
ORA-06512: at "SYS.DBMS_SQL", line 2144
ORA-06512: at "APEX_200100.WWV_FLOW_EXEC_LOCAL", line 216
ORA-06512: at "APEX_200100.WWV_FLOW_EXEC_LOCAL", line 1500
ORA-06512: at "APEX_200100.WWV_FLOW_EXEC_LOCAL", line 1551
ORA-06512: at "APEX_200100.WWV_FLOW_EXEC", line 4245
ORA-06512: at "APEX_200100.WWV_FLOW_EXEC_DEV", line 380
ORA-06512: at "APEX_200100.WWV_FLOW_PROPERTY_DEV", line 3290
ORA-06512: at "APEX_200100.WWV_FLOW_PROPERTY_DEV", line 4309
ORA-06512: at "APEX_200100.WWV_FLOW_PROPERTY_DEV", line 4400
ORA-06512: at line 2
ORA-06512: at "SYS.DBMS_SYS_SQL", line 2120
ORA-06512: at "SYS.WWV_DBMS_SQL_APEX_200100", line 590
ORA-06512: at "APEX_200100.WWV_FLOW_DYNAMIC_EXEC", line 2621
ORA-06512: at "APEX_200100.WWV_FLOW_DYNAMIC_EXEC", line 1514
ORA-06512: at "APEX_200100.WWV_FLOW_PPR_UTIL", line 197
ORA-06512: at "APEX_200100.WWV_FLOW", line 2908
ORA-06512: at "APEX_200100.WWV_FLOW", line 4300
ORA-06512: at line 2
at oracle.jdbc.driver.T4CTTIoer11.processError(T4CTTIoer11.java:513)
... 89 more
Addec ora-600 from catalina.out Message was edited by: Jorge Rimblas