ORA-08103 Error consistently on Insert
575748Sep 10 2008 — edited Sep 11 2008Hello,
We ran into a production issue last week where inserts into a particular oracle table were failing with: ORA-08103: object no longer exists. This issue occurred mid-day during production out of nowhere.
I have searched for issues relating to this, but they all refer to scripts that were run, but usually the problem was concurrency. In this case, there was no concurrency, nothing was being deleted. It was inserts, and it was consistent. This table would not allow inserts. It has ~260million records.
After we brought down our production machines, I tried single inserts against the table through SQL Developer and received the same error. We rebooted the database instance and experienced the same issue. The application is java and use the Oracle JDBC drivers, and the database is oracle 10g.
We analyzed the table and the indexes. The table and 2 of 3 indexes returned healthy within 15-20min, the 3rd index hung during the analysis and we stopped it after 40min. After dropping this index, the inserts worked and the table is fixed.
There is nothing specifying anything had gone wrong in the oracle logs.
Has this happened to anyone? I'm hesitant to say we ran into some 1-in-a-trillion fluke, where the earth aligned with some stars and it caused a magnetic beam on a Raid-5 disk which corrupted an index.
Any ideas?
Thanks,
Branden