Data Warehousing Design
520013Jun 24 2006 — edited Jun 25 2006In our datawarehouse we expect to load about 4 Million records per day into a single table. We need to keep this data for three years which means this table will have about 3 billion records. At any given time we will have 5 loads loading data into this table. Will there be any issues regarding 5 loads into the same table at the same time while some queries running.
Regarding partitioning the table, since our users will be accessing data for the whole year for a given security, I don't think we can partition by date. Please share your thoughts on any other partitioning mechanisms. We have roughly 10000 different securities.