ODI - Data Reconciliation when using large volumne of data
NagarajYOct 30 2012 — edited Oct 31 2012Hi Experts,
I want to do a data reconciliation b/w my source and target systems once in a 30 days. So, all the data of 30 days should bring into staging to compare and need to validate the entire record of source is same as target (I assume comparing the key column is a good practice) .
The data volume may be around 3 to 4 million or may be higher. So, when I do the table comparison with the large volume of data will it a bottle neck?
Any alternate solution to achieve this data comparison using ODI and any other tool capable of doing a better way.
Thanks in Advance , looking for your suggestions .
Regards,
Yellanki