Dear friends,
One of my customer is facing the following issue with execution of three workflows which share the same mapplets (log file below):
My challenge is to understand the issue. I found many posts where the solution to this problem is to go to Session properties --> config object tab --> Additional Concurrent Pipelines for Lookup Cache Creation instead of auto set this to 0 or any numerical value.
But when I look at the log the cache files PMLKUP21053_327682_0_864013W32.[dat/idx] to support mplt_VZA_DIM_ASSET_WID_LKP.LKPTRANS mapplet was successfully created. This means we are not experiencing lack of free space issue.
There are about 15 tasks which we execute simultaneously which all share mplt_VZA_DIM_ASSET_WID_LKP and mplt_VZA_DIM_ORGANIZATION_WID_LKP mapplets. And it is only recenty three tasks started to fail. However if we restart the execution plan all complete successfully.
Could it be that we are facing Informatica setup limits on how many mapplets could be simultaneously executed? Any suggestions are welcome. This is the production issue.
Thank you!
2013-10-24 20:48:11 : INFO : (9068 | DIRECTOR) : (IS | Integration_Service) : node01_obieesvr11 : TT_11183 : Enabled using [1 (auto)] additional concurrent pipelines to build lookup caches. (Session likely will build or refresh [2] lookup caches; [0] on-demand only).
2013-10-24 20:48:11 : INFO : (9068 | MAPPING) : (IS | Integration_Service) : node01_obieesvr11 : TM_6660 : Total Buffer Pool size is 22013248 bytes and Block size is 1220736 bytes.
2013-10-24 20:48:11 : INFO : (9068 | LKPDP_1) : (IS | Integration_Service) : node01_obieesvr11 : DBG_21312 : Lookup Transformation [mplt_VZA_DIM_ORGANIZATION_WID_LKP.LKPTRANS]: Lookup override sql to create cache: SELECT INTEGRATION_ID AS INTEGRATION_ID, SOURCE_SYSTEM_ID AS SOURCE_SYSTEM_ID, SOURCE_INSTANCE_ID AS SOURCE_INSTANCE_ID, ORGANIZATION_ID AS ORGANIZATION_ID FROM T_VZA_DIM_ORGANIZATION ORDER BY SOURCE_SYSTEM_ID,SOURCE_INSTANCE_ID,ORGANIZATION_ID,INTEGRATION_ID
2013-10-24 20:48:11 : INFO : (9068 | LKPDP_2) : (IS | Integration_Service) : node01_obieesvr11 : DBG_21312 : Lookup Transformation [mplt_VZA_DIM_ASSET_WID_LKP.LKPTRANS]: Lookup override sql to create cache: SELECT INTEGRATION_ID AS INTEGRATION_ID, SOURCE_SYSTEM_ID AS SOURCE_SYSTEM_ID, SOURCE_INSTANCE_ID AS SOURCE_INSTANCE_ID, ASSET_ID AS ASSET_ID FROM T_VZA_DIM_ASSET ORDER BY SOURCE_SYSTEM_ID,SOURCE_INSTANCE_ID,ASSET_ID,INTEGRATION_ID
2013-10-24 20:48:11 : INFO : (9068 | DIRECTOR) : (IS | Integration_Service) : node01_obieesvr11 : TT_11184 : Starting additional concurrent pipeline to build the lookup cache needed by Lookup transformation [mplt_VZA_DIM_ORGANIZATION_WID_LKP.LKPTRANS].
2013-10-24 20:48:11 : INFO : (9068 | LKPDP_1) : (IS | Integration_Service) : node01_obieesvr11 : TM_6660 : Total Buffer Pool size is 609824 bytes and Block size is 65536 bytes.
2013-10-24 20:48:11 : INFO : (9068 | LKPDP_1:TRANSF_1_1) : (IS | Integration_Service) : node01_obieesvr11 : CMN_1671 : Created new cache files PMLKUP21053_393219_0_864013W32.[dat/idx] in directory C:\Infa861\server\infa_shared\Cache for Lookup [mplt_VZA_DIM_ORGANIZATION_WID_LKP.LKPTRANS].
2013-10-24 20:48:11 : INFO : (9068 | LKPDP_1:TRANSF_1_1) : (IS | Integration_Service) : node01_obieesvr11 : DBG_21641 : mplt_VZA_DIM_ORGANIZATION_WID_LKP.LKPTRANS: Index cache size = [89616384], Data cache size = [178962432]
2013-10-24 20:48:11 : INFO : (9068 | DIRECTOR) : (IS | Integration_Service) : node01_obieesvr11 : TT_11184 : Starting additional concurrent pipeline to build the lookup cache needed by Lookup transformation [mplt_VZA_DIM_ASSET_WID_LKP.LKPTRANS].
2013-10-24 20:48:17 : INFO : (9068 | LKPDP_2:TRANSF_1_1) : (IS | Integration_Service) : node01_obieesvr11 : DBG_21294 : DBG_21294 Lookup cache creation completed : (Thu Oct 24 20:48:17 2013)
2013-10-24 20:48:17 : INFO : (9068 | LKPDP_2:TRANSF_1_1) : (IS | Integration_Service) : node01_obieesvr11 : CMN_1671 : Created new cache files PMLKUP21053_327682_0_864013W32.[dat/idx] in directory C:\Infa861\server\infa_shared\Cache for Lookup [mplt_VZA_DIM_ASSET_WID_LKP.LKPTRANS].
2013-10-24 20:48:17 : INFO : (9068 | LKPDP_2:TRANSF_1_1) : (IS | Integration_Service) : node01_obieesvr11 : DBG_21641 : mplt_VZA_DIM_ASSET_WID_LKP.LKPTRANS: Index cache size = [89616384], Data cache size = [178962432]
2013-10-24 20:48:17 : INFO : (9068 | DIRECTOR) : (IS | Integration_Service) : node01_obieesvr11 : TT_11185 : No more lookup cache to build by additional concurrent pipeline in the current concurrent source set.