Parallel processing in ODI
Hi experts,
I have 30+ files in text format, that hold partitions of the same table. These partitions can/must go through the same processing in parallel, and then must be appended back to a single large file.
I'd have no problem designing the transformations in ODI (since I have the SQL code), but I'm looking for an "elegant" way to tackle the problem. By elegant I mean modular, with minimal replication of work, etc.
Thank you very much.
Joan