How do I consolidate in FDM AFTER all files load to target?
802636Oct 3 2010 — edited Jun 29 2011Hi,
We are using FDM to import and export out to HFM forecasting data. The files are sent via ETL to the OpenBatch folder and then I am using parallel processing to import, validate, and consolidate the files to the target system, which is HFM. The problem is the performance. As each file is loaded using the batch loader script, it loads and consolidates each file as each file processes. I would like to find a way to load and export all files FIRST to HFM - and then when the last file is encountered (the 12th file), I would like to run a consolidate on the file to HFM so that the consolidation will consolidate all at once and help save some time. Here are the steps I would like to accomplish:
1. Import, Validate, and Export the first 11 files to HFM
2. Import, Validate, Export, and Consolidate the 12th file to HFM - the idea is that all previous 11 files will consolidate atone time instead of the out of the box way using the standard BatchLoader script.
Does anyone know HOW I can make this happen? Out of the box this is not possible without some major script customization. Could someone please give me some sort of idea where I can make this happen? I really appreciate the help. Below is the standard Batch Loader script I am using and I would like to somehow customize:
Sub webBatchStdParallel()
'------------------------------------------------------------------
'Oracle Hyperion FDM CUSTOM Script:
'Parallel Processing
'
'------------------------------------------------------------------
'STANDARD Batch Parallel Processing
'-----------------------------------
'Declare Local Variables
Dim lngProcessLevel
Dim strDelimiter
Dim blnAutoMapCorrect
Dim lngParallelProcessCount
Dim strLoadBalanceServerName
Dim BATCHENG
Set BATCHENG = CreateObject("upsWBatchLoaderDM.clsBatchLoader")
BATCHENG.mInitialize API, SCRIPTENG
'Initialize variables Variables
lngProcessLevel = 10 'Up-To-Consolidate
strDelimiter = "_" 'File Name Delimiter
blnAutoMapCorrect = True 'Auto Map Correction is On
lngParallelProcessCount = 2 'Number of Parallel Processes (Should equal # of Processors)
strLoadBalanceServerName = "Everest0555" 'Load balance server for parallel process
'Create the file collection
Set BATCHENG.PcolFiles = BATCHENG.fFileCollectionCreate(CStr(strDelimiter))
'Execute a Standard Parallel batch
BATCHENG.mFileCollectionProcessParallel BATCHENG.PcolFiles, CLng(lngProcessLevel), CLng(lngParallelProcessCount), CStr(strLoadBalanceServerName), , CBool(blnAutoMapCorrect)
End Sub