association rules - memory issue
743000Dec 24 2009 — edited Jan 14 2010Hi everyone,
I'm testing oracle data mining to generate a high number of association rules, starting from a table containing around 100 columns and 1800 lines. I transformed the table in a view as shown with the market basket demo, but I'm still having a memory error each time I'm trying to launch the data mining process.
I've tried with a table containing less columns and lines, and it worked fine.
Is there a way to set ODM to allow it to process this big table and generate millions of association rules without having some memory errors ?
Is it possible to find how exactly the apriori algorithm works, I mean to find if the sql process is only working with the RAM and writes in the database in the end, or if it commits into the database during the process (before exploding memory).
Merry christmas by the way !!!!!