Hi,
Last night suddenly Uptime robot reported our Apex Builder environment had become inaccessible. All our Apex applications were fine, just the builder gave us an Internal Server Error and continues to do so. This happened in the early hours of the morning. We now cannot get the builder back, but our applications continue to run fine. The Tomcat logs list this error:
23-Dec-2020 16:37:58.946 SEVERE [http-nio-8080-exec-5] . java.sql.SQLException: ORA-00600: internal error code, arguments: [kdsgrp1], [], [], [], [], [], [], [], [], [], [], []
InternalServerException [statusCode=500, reasons=[]]
at oracle.dbtools.apex.ModApexContext.handleError(ModApexContext.java:276)
at oracle.dbtools.apex.OWA.execute(OWA.java:226)
at oracle.dbtools.apex.ModApex.handleRequest(ModApex.java:270)
at oracle.dbtools.apex.ModApex.doGet(ModApex.java:139)
......... and then lower down......
Caused by: Error : 600, Position : 0, Sql = begin
f(p=>:1 );
commit;
end;, OriginalSql = begin
f(p=>?);
commit;
end;, Error Msg = ORA-00600: internal error code, arguments: [kdsgrp1], [], [], [], [], [], [], [], [], [], [], []
at oracle.jdbc.driver.T4CTTIoer11.processError(T4CTTIoer11.java:498)
And the trace file had the following error:
*** 2020-12-23T16:44:39.814739+00:00
*** SESSION ID:(613.36917) 2020-12-23T16:44:39.814764+00:00
*** CLIENT ID:(nobody:11761822269388) 2020-12-23T16:44:39.814772+00:00
*** SERVICE NAME:(SYS$USERS) 2020-12-23T16:44:39.814782+00:00
*** MODULE NAME:(APEX_050100/APEX:APP 4550:1) 2020-12-23T16:44:39.814791+00:00
*** ACTION NAME:(PAGE 1) 2020-12-23T16:44:39.814800+00:00
*** CLIENT DRIVER:(jdbcthin : 12.2.0.1.0) 2020-12-23T16:44:39.814808+00:00
DDE: Problem Key 'ORA 600 [kdsgrp1]' was flood controlled (0x4) (incident: 8829)
ORA-00600: internal error code, arguments: [kdsgrp1], [], [], [], [], [], [], [], [], [], [], []
kdsDumpState: cdb: 0 dspdb: 0 type: 1
info: 0x5
Does anyone know what might be causing this and any suggestions on how to bring the builder back to life?
We're using Apex 5.1.4 on Oracle 12r2 and ORDS 17.4.1
Thanks,
Barry