Checking ETL Process accurately succeed
723004Jan 5 2010 — edited Jan 5 2010Hi,
simplifying the scenario, assuming we have 2 databases, 1 production and 1 BI. Everynight, an ETL Process will take place, syncing production db to bi db. Now, what is the best way to check that he ETL have successfully sync across.
My initial thought is for each table in production and BI, do a
select * from tableA where update_date < a_date_n_time
export the result to a file and do an MD5 checksum on both file.
is this solution viable? table size hover around 5 million records and growing.
is there any oracle function or what is the best way to export the result to a temporary file?
Please advice
V