We have a job running on a scheduled basis that outputs data quality issues to a spreadsheet.
We would like to keep a history of specific error details (e.g. which records had which data quality issues) over time (i.e. more details than the simple measures that can be published to the Dashboard for seeing trends over time).
I believe we could do this kind of thing using an export to an external database table (or even a file in the EDQ server's landing area) using the 'Append to current data' option however is that a recommended way to go or is there any alternative e.g. is it possible for the job to write to
(a) a spreadsheet/file with a different name each time it runs (e.g. suffixed with the run timestamp) or
(b) an EDQ staged data area without deleting what was previously in the table (we could include a run timestamp column to distinguish the runs).
Thanks, Nik