We have a requirement in Fixed Assets, need your suggestions on solution approach and ideal design.
Requirement: Fetch the data into ADW Table from Fusion Dynamic tables created for each request submitted for “Perform What-If analysis”. Each Request will be submitted for each book. Extract data from Fusion and Load into Data base Stage Table. We have 200 books currently. It is monthly once activity.
We have tried below approach:
Created a custom ESS job to run the specified report with Two parameters as Book Name and Request ID.
In OIC, we designed integration to invoke exportBulkdata operation by passing the above job details and parameters – 200times. Upon completion of the job, call back will get triggered.
Stored the 200 Document IDs.
Designed another Scheduled integration to fetch Document IDs as batch of 20 and download the file from UCM, unzip, read in segments and insert into Table using a procedure. This integration scheduled for hourly once.
Major Issue: There are instances where the file size for single Document ID is more than 250MB. We see the OIC servers are unable to handle the load for those many requests and with current file size. OIC servers are getting auto restarted with network timeout.
Any thoughts on handling such a huge files for 200 times in OIC? or any other better solution for the same?