Automating a MDM Solution
437985Mar 26 2007 — edited Mar 27 2007Hi all.
I'm new to Oracle Data Integrator, and I'd like to know the best approach to automating a MDM solution.
For example, I have a sample scenario with two interfaces, one for an ETL between DB1 and MASTERDB and other for an ETL between MASTERDB and DB2
So far, I'm doing the folloing in order to automate this scenario:
1 - Create a CDC for DB1 and for MASTERDB
2 - Create a package for the integration between DB1 and MASTERDB:
- The package has a OdiWaitForData step that listens to the DB1 journaling table.
- Once it detects new data, the process starts and the interface gets executed.
- The process returns to the OdiWaitForData ( loop )
3 - Create a package for the integration between MASTERDB and DB2, using the same steps as defined for the previous package.
The packages stays running in loop.
Now I have two questions:
1 - Am I doing the right thing, or there is a better approach for making these components get automated?
2 - Regarding the OdiWaitForData step, I note that it makes a new connection to the data store in every pooling activity. So, if a need a pooling frequency of, say, half second, I'll have lots of opening and closing connections, maybe degrading the overall performance. Is there a way to keep the component connected?
Thanks in advance.
Denis