Hi,
when we try to import via fdmee import is getting failed with the below error.
2019-07-15 19:00:40,722 INFO [AIF]: FDMEE Process: 14591, Log Level: 5, Log File: /oracleshared/FDMEE/outbox/logs/SCB_14591.log
2019-07-15 19:00:40,722 INFO [AIF]: Location : Pipeline_SCB (Partitionkey:4)
2019-07-15 19:00:40,722 INFO [AIF]: Period Name : Jan-19 (Period Key:1/31/19 12:00 AM)
2019-07-15 19:00:40,722 INFO [AIF]: Category Name: Actual (Category key:1)
2019-07-15 19:00:40,722 INFO [AIF]: Rule Name : TY_Pipeline_Act_SCB (Rule ID:25)
2019-07-15 19:00:42,685 INFO [AIF]: FDM Version: 11.1.2.4.210
2019-07-15 19:00:42,685 INFO [AIF]: Log File Encoding: UTF-8
2019-07-15 19:00:44,372 INFO [AIF]: -------START IMPORT STEP-------
2019-07-15 19:00:44,468 DEBUG [AIF]: CommData.preImportData - START
2019-07-15 19:00:44,477 DEBUG [AIF]: CommData.getRuleInfo - START
2019-07-15 19:00:44,525 DEBUG [AIF]:
SELECT adim.BALANCE_COLUMN_NAME DIMNAME, adim.DIMENSION_ID, adim.TARGET_DIMENSION_CLASS_NAME, tiie.IMPCONCATCHAR
,(SELECT COA_SEGMENT_NAME FROM AIF_COA_SEGMENTS cs WHERE cs.COA_LINE_ID = tiie.IMPSOURCECOALINEID1) COA_SEGMENT_NAME1
FROM TPOVPARTITION tpp
INNER JOIN AIF_TARGET_APPL_DIMENSIONS adim
ON adim.APPLICATION_ID = 5
LEFT OUTER JOIN TBHVIMPITEMERPI tiie
ON tiie.IMPGROUPKEY = tpp.PARTIMPGROUP AND tiie.IMPFLDFIELDNAME = adim.BALANCE_COLUMN_NAME AND tiie.IMPMAPTYPE = 'ERP'
WHERE tpp.PARTITIONKEY = 4
AND adim.BALANCE_COLUMN_NAME IS NOT NULL
AND adim.TARGET_DIMENSION_CLASS_NAME <> 'ICPTRANS'
AND (adim.VALID_FOR_PLAN1 = 1 OR adim.TARGET_DIMENSION_CLASS_NAME = 'LOOKUP')
ORDER BY adim.BALANCE_COLUMN_NAME
2019-07-15 19:00:44,526 DEBUG [AIF]: {'APPLICATION_ID': 5L, 'IMPORT_FROM_SOURCE_FLAG': u'Y', 'PLAN_TYPE': u'PLAN1', 'RULE_NAME': u'TY_Pipeline_Act_SCB', 'IS_INCREMENTAL_LOAD': False, 'EPM_ORACLE_INSTANCE': u'/oracle/Middleware/user_projects/epmsystemWEB1', 'CATKEY': 1L, 'INCLUDE_ADJ_PERIODS_FLAG': u'N', 'PERIOD_MAPPING_TYPE': u'DEFAULT', 'SOURCE_SYSTEM_TYPE': u'FILE', 'CHECK_FLAG': u'N', 'LEDGER_GROUP': None, 'TARGET_APPLICATION_NAME': u'SCB', 'RECALCULATE_FLAG': u'Y', 'SOURCE_SYSTEM_ID': 1L, 'KK_FLAG': u'N', 'IMPGROUPKEY': u'Pipeline_SCB', 'EXPORT_TO_TARGET_FLAG': u'N', 'TARGET_SOURCE_SYSTEM_TYPE': None, 'JOURNAL_FLAG': None, 'SOURCE_APPLICATION_ID': None, 'DIMNAME_LIST': [u'ACCOUNT', u'ENTITY', u'UD1', u'UD10', u'UD11', u'UD12', u'UD2', u'UD3', u'UD4', u'UD5', u'UD6', u'UD7', u'UD8', u'UD9'], 'FCI_FLAG': 'N', 'IMPSOURCECOAID': 0L, 'LAST_UPDATED_BY': u'scb_admin', 'DIMNAME_MAP': {u'UD6': {'TARGET_DIMENSION_CLASS_NAME': u'Generic', 'DIMNAME': u'UD6'}, u'UD3': {'TARGET_DIMENSION_CLASS_NAME': u'Generic', 'DIMNAME': u'UD3'}, u'UD8': {'TARGET_DIMENSION_CLASS_NAME': u'Generic', 'DIMNAME': u'UD8'}, u'ENTITY': {'TARGET_DIMENSION_CLASS_NAME': u'Entity', 'DIMNAME': u'ENTITY'}, u'UD7': {'TARGET_DIMENSION_CLASS_NAME': u'Generic', 'DIMNAME': u'UD7'}, u'UD9': {'TARGET_DIMENSION_CLASS_NAME': u'LOOKUP', 'DIMNAME': u'UD9'}, u'UD5': {'TARGET_DIMENSION_CLASS_NAME': u'Generic', 'DIMNAME': u'UD5'}, u'UD11': {'TARGET_DIMENSION_CLASS_NAME': u'LOOKUP', 'DIMNAME': u'UD11'}, u'UD4': {'TARGET_DIMENSION_CLASS_NAME': u'Generic', 'DIMNAME': u'UD4'}, u'ACCOUNT': {'TARGET_DIMENSION_CLASS_NAME': u'Account', 'DIMNAME': u'ACCOUNT'}, u'UD2': {'TARGET_DIMENSION_CLASS_NAME': u'Generic', 'DIMNAME': u'UD2'}, u'UD12': {'TARGET_DIMENSION_CLASS_NAME': u'LOOKUP', 'DIMNAME': u'UD12'}, u'UD10': {'TARGET_DIMENSION_CLASS_NAME': u'LOOKUP', 'DIMNAME': u'UD10'}, u'UD1': {'TARGET_DIMENSION_CLASS_NAME': u'Version', 'DIMNAME': u'UD1'}}, 'TARGET_APPLICATION_TYPE': u'HPL', 'PARTITIONKEY': 4L, 'IMPGROUPFILETYPE': u'MULTIPER', 'RULE_ID': 25L, 'SOURCE_ADAPTER_FLAG': u'N', 'CALENDAR_ID': None, 'PARTVALGROUP': u'[NONE]', 'WEB_SERVICE_URL': u'http://HKLVAPHYP01:6550/aif', 'LEDGER_GROUP_CODE': u'NONE', 'INCLUDE_ZERO_BALANCE_FLAG': None, 'DATA_LOAD_METHOD': u'CLASSIC_VIA_EPMI', 'EXECUTION_MODE': u'REPLACE', 'PLAN_NUMBER': 1L, 'IMPTARGETSOURCESYSTEMID': 0L, 'PS_LEDGER': None}
2019-07-15 19:00:44,527 DEBUG [AIF]: {u'Currency': {'BCN': u'UD7', 'DCN': u'Generic'}, u'Version': {'BCN': u'UD1', 'DCN': u'Version'}, u'View': {'BCN': u'UD3', 'DCN': u'Generic'}, u'Entity': {'BCN': u'ENTITY', 'DCN': u'Entity'}, u'Period': {'BCN': None, 'DCN': u'Period'}, u'Custom2': {'BCN': u'UD6', 'DCN': u'Generic'}, u'Account': {'BCN': u'ACCOUNT', 'DCN': u'Account'}, u'Custom4': {'BCN': u'UD8', 'DCN': u'Generic'}, u'Custom1': {'BCN': u'UD5', 'DCN': u'Generic'}, u'Layer': {'BCN': u'UD2', 'DCN': u'Generic'}, u'Scenario': {'BCN': None, 'DCN': u'Scenario'}, u'Custom3': {'BCN': u'UD4', 'DCN': u'Generic'}, u'Years': {'BCN': None, 'DCN': u'Year'}}
2019-07-15 19:00:44,528 DEBUG [AIF]: {u'UD3': {'IMPFLDSOURCECOLNAME': u'Function'}, u'UD6': {'IMPFLDSOURCECOLNAME': u'Product'}, u'UD8': {'IMPFLDSOURCECOLNAME': u'Custom4'}, u'ENTITY': {'IMPFLDSOURCECOLNAME': u'Organisation'}, u'UD7': {'IMPFLDSOURCECOLNAME': u'Currency'}, u'AMOUNT': {'IMPFLDSOURCECOLNAME': u'Amount'}, u'UD2': {'IMPFLDSOURCECOLNAME': u'Layer'}, u'UD12': {'IMPFLDSOURCECOLNAME': u'YTD_MTD'}, u'UD5': {'IMPFLDSOURCECOLNAME': u'Customer'}, u'UD4': {'IMPFLDSOURCECOLNAME': u'Custom3'}, u'ACCOUNT': {'IMPFLDSOURCECOLNAME': u'Account'}, u'UD1': {'IMPFLDSOURCECOLNAME': u'Version'}}
2019-07-15 19:00:44,528 DEBUG [AIF]: CommData.getRuleInfo - END
2019-07-15 19:00:44,533 DEBUG [AIF]: CommData.insertFilePeriods - START
2019-07-15 19:00:44,537 DEBUG [AIF]: doAppPeriodMappingsExist - SCB: N
2019-07-15 19:00:44,537 DEBUG [AIF]: SELECT 1 FROM AIF_BAL_RULE_LOAD_PARAMS WHERE LOADID = 14591 AND PARAMETER_TYPE = 'SOURCE_PERIODS'
2019-07-15 19:00:44,538 DEBUG [AIF]: Period mapping section: MULTI-COLUMN
2019-07-15 19:00:44,539 DEBUG [AIF]:
SELECT pp.PERIODKEY, pp.PERIODDESC, pp.YEARTARGET, pp.PERIODTARGET, brl.FILE_NAME_STATIC, brl.FILE_NAME_SUFFIX_TYPE, brl.FILE_NAME_DATE_FORMAT
,COALESCE(brp.parameter_id,0) GL_EFFECTIVE_PERIOD_NUM, 0 GL_PERIOD_NUM, '0' GL_PERIOD_NAME, 0 GL_PERIOD_YEAR
FROM AIF_BAL_RULE_LOADS brl
INNER JOIN TPOVCATEGORY pc
ON pc.CATKEY = brl.CATKEY
INNER JOIN TPOVPERIOD_FLAT_V pp
ON pp.PERIODFREQ = pc.CATFREQ
INNER JOIN AIF_BAL_RULE_LOAD_PARAMS brp
ON brp.loadid = brl.loadid AND to_date(brp.parameter_value,'yyyy/MM/dd') = pp.periodkey
WHERE brl.LOADID = 14591
AND brp.parameter_type = 'SOURCE_PERIODS'
ORDER BY PERIODKEY
2019-07-15 19:00:44,549 INFO [AIF]: File Name: Data_Actuals_Y2019.txt
2019-07-15 19:00:44,549 DEBUG [AIF]:
INSERT INTO AIF_PROCESS_PERIODS (
PROCESS_ID, PERIODKEY, ADJUSTMENT_PERIOD_FLAG, GL_PERIOD_YEAR, GL_PERIOD_CODE, GL_PERIOD_NAME, GL_PERIOD_NUM, GL_EFFECTIVE_PERIOD_NUM
,YEARTARGET, PERIODTARGET, IMP_ENTITY_TYPE, IMP_ENTITY_NAME, TRANS_ENTITY_TYPE, TRANS_ENTITY_NAME, PRIOR_PERIOD_FLAG, GL_PERIOD_YEAR_CHAR)
VALUES (14591,'2019-01-31','N',0,'0' ,'0',0,9,'FY19','Jan', 'PROCESS_BAL_IMP_FILE','Data_Actuals_Y2019.txt','PROCESS_BAL_TRANS','Jan-19','N', 0)
2019-07-15 19:00:44,552 DEBUG [AIF]: CommData.insertFilePeriods - END
2019-07-15 19:00:44,555 DEBUG [AIF]: CommData.getPovList - START
2019-07-15 19:00:44,555 DEBUG [AIF]:
SELECT DISTINCT brl.PARTITIONKEY, part.PARTNAME, brl.CATKEY, cat.CATNAME, pprd.PERIODKEY
,COALESCE(pp.PERIODDESC, TO_CHAR(pprd.PERIODKEY,'YYYY-MM-DD HH24:MI:SS')) PERIODDESC
,brl.RULE_ID, br.RULE_NAME, CASE WHEN (tlp.INTLOCKSTATE = 60) THEN 'Y' ELSE 'N' END LOCK_FLAG
FROM AIF_BAL_RULE_LOADS brl
INNER JOIN AIF_BALANCE_RULES br
ON br.RULE_ID = brl.RULE_ID
INNER JOIN TPOVPARTITION part
ON part.PARTITIONKEY = brl.PARTITIONKEY
INNER JOIN TPOVCATEGORY cat
ON cat.CATKEY = brl.CATKEY
INNER JOIN AIF_PROCESS_PERIODS pprd
ON pprd.PROCESS_ID = brl.LOADID
LEFT OUTER JOIN TPOVPERIOD pp
ON pp.PERIODKEY = pprd.PERIODKEY
LEFT OUTER JOIN TLOGPROCESS tlp
ON tlp.PARTITIONKEY = brl.PARTITIONKEY AND tlp.CATKEY = brl.CATKEY AND tlp.PERIODKEY = pprd.PERIODKEY AND tlp.RULE_ID = brl.RULE_ID
WHERE brl.LOADID = 14591
ORDER BY brl.PARTITIONKEY, brl.CATKEY, pprd.PERIODKEY, brl.RULE_ID
2019-07-15 19:00:44,558 DEBUG [AIF]: CommData.getPovList - END
2019-07-15 19:00:44,560 DEBUG [AIF]: CommData.insertImportProcessDetails - START
2019-07-15 19:00:44,560 DEBUG [AIF]:
INSERT INTO AIF_PROCESS_DETAILS (
PROCESS_ID, ENTITY_TYPE, ENTITY_ID, ENTITY_NAME, ENTITY_NAME_ORDER, TARGET_TABLE_NAME, EXECUTION_START_TIME
,EXECUTION_END_TIME, RECORDS_PROCESSED, STATUS, LAST_UPDATED_BY, LAST_UPDATE_DATE
)
SELECT PROCESS_ID, ENTITY_TYPE, ENTITY_ID, ENTITY_NAME, ENTITY_NAME_ORDER, 'TDATASEG' TARGET_TABLE_NAME, CURRENT_TIMESTAMP EXECUTION_START_TIME
,NULL EXECUTION_END_TIME, 0 RECORDS_PROCESSED, 'PENDING' STATUS, 'scb_admin' LAST_UPDATED_BY, CURRENT_TIMESTAMP LAST_UPDATE_DATE
FROM (
SELECT DISTINCT PROCESS_ID, IMP_ENTITY_TYPE ENTITY_TYPE, IMP_ENTITY_ID ENTITY_ID, IMP_ENTITY_NAME ENTITY_NAME
,(COALESCE(SOURCE_LEDGER_ID,0) * 100000000 + GL_EFFECTIVE_PERIOD_NUM) ENTITY_NAME_ORDER
FROM AIF_PROCESS_PERIODS
WHERE PROCESS_ID = 14591
) q
ORDER BY ENTITY_NAME_ORDER
2019-07-15 19:00:44,569 DEBUG [AIF]: CommData.insertImportProcessDetails - END
2019-07-15 19:00:44,575 DEBUG [AIF]: Comm.doScriptInit - START
2019-07-15 19:00:44,678 DEBUG [AIF]: fdmContext: {BATCHSCRIPTDIR=/oracle/Middleware/user_projects/epmsystemWEB1/FinancialDataQuality, INBOXDIR=/oracleshared/FDMEE/inbox, LOCNAME=Pipeline_SCB, SOURCENAME=File, APPID=5, SOURCEID=1, APPROOTDIR=/oracleshared/FDMEE, IMPORTFORMAT=Pipeline_SCB, SCRIPTSDIR=/oracleshared/FDMEE/data/scripts, EPMORACLEHOME=/oracle/Middleware/EPMSystem11R1, TARGETAPPTYPE=HPL, RULEID=25, CATNAME=Actual, EPMORACLEINSTANCEHOME=/oracle/Middleware/user_projects/epmsystemWEB1, LOADID=14591, PERIODNAME=Jan-19, IMPORTMODE=REPLACE, SOURCETYPE=FILE, PERIODKEY=2019-01-31, EXPORTFLAG=N, TARGETAPPDB=PLAN1, TARGETAPPNAME=SCB, FILENAME=Data_Actuals_Y2019.txt, LOCKEY=4, RULENAME=TY_Pipeline_Act_SCB, OUTBOXDIR=/oracleshared/FDMEE/outbox, MULTIPERIODLOAD=N, EXPORTMODE=null, CATKEY=1, USERNAME=scb_admin, FILEDIR=inbox/pipeline, IMPORTFLAG=Y, USERLOCALE=null}
2019-07-15 19:00:44,682 DEBUG [AIF]: The executeEventScript is set to: YES
2019-07-15 19:00:44,682 DEBUG [AIF]: The AppRootFolder is set to: /oracleshared/FDMEE
2019-07-15 19:00:44,682 DEBUG [AIF]: The JavaHome is set to: %EPM_ORACLE_HOME%/../jdk160_35
2019-07-15 19:00:44,682 DEBUG [AIF]: The OleDatabaseProvider is set to: ORAOLEDB.ORACLE
2019-07-15 19:00:44,682 DEBUG [AIF]: Comm.doScriptInit - END
2019-07-15 19:00:44,682 DEBUG [AIF]: Comm.executeScript - START
2019-07-15 19:00:44,683 INFO [AIF]: Executing the following script: /oracleshared/FDMEE/data/scripts/event/BefImport.py
2019-07-15 19:00:44,691 DEBUG [AIF]: Comm.executeVBScript - START
2019-07-15 19:00:44,691 DEBUG [AIF]: The WindowsTempFolder is set to: /tmp
2019-07-15 19:00:44,691 DEBUG [AIF]: The following script does not exist: \oracleshared\FDMEE\data\scripts\event\BefImport.vbs
2019-07-15 19:00:44,691 DEBUG [AIF]: Comm.executeVBScript - END
2019-07-15 19:00:44,691 DEBUG [AIF]: Comm.executeScript - END
2019-07-15 19:00:44,691 DEBUG [AIF]: CommData.preImportData - END
2019-07-15 19:00:48,635 DEBUG [AIF]: FileData.importData - START
2019-07-15 19:00:48,636 DEBUG [AIF]: Importing data for load id: 14591
2019-07-15 19:00:48,643 DEBUG [AIF]: CommData.getRuleInfo - START
2019-07-15 19:00:48,649 DEBUG [AIF]:
SELECT adim.BALANCE_COLUMN_NAME DIMNAME, adim.DIMENSION_ID, adim.TARGET_DIMENSION_CLASS_NAME, tiie.IMPCONCATCHAR
,(SELECT COA_SEGMENT_NAME FROM AIF_COA_SEGMENTS cs WHERE cs.COA_LINE_ID = tiie.IMPSOURCECOALINEID1) COA_SEGMENT_NAME1
FROM TPOVPARTITION tpp
INNER JOIN AIF_TARGET_APPL_DIMENSIONS adim
ON adim.APPLICATION_ID = 5
LEFT OUTER JOIN TBHVIMPITEMERPI tiie
ON tiie.IMPGROUPKEY = tpp.PARTIMPGROUP AND tiie.IMPFLDFIELDNAME = adim.BALANCE_COLUMN_NAME AND tiie.IMPMAPTYPE = 'ERP'
WHERE tpp.PARTITIONKEY = 4
AND adim.BALANCE_COLUMN_NAME IS NOT NULL
AND adim.TARGET_DIMENSION_CLASS_NAME <> 'ICPTRANS'
AND (adim.VALID_FOR_PLAN1 = 1 OR adim.TARGET_DIMENSION_CLASS_NAME = 'LOOKUP')
ORDER BY adim.BALANCE_COLUMN_NAME
2019-07-15 19:00:48,650 DEBUG [AIF]: {'APPLICATION_ID': 5L, 'IMPORT_FROM_SOURCE_FLAG': u'Y', 'PLAN_TYPE': u'PLAN1', 'RULE_NAME': u'TY_Pipeline_Act_SCB', 'IS_INCREMENTAL_LOAD': False, 'EPM_ORACLE_INSTANCE': u'/oracle/Middleware/user_projects/epmsystemWEB1', 'CATKEY': 1L, 'INCLUDE_ADJ_PERIODS_FLAG': u'N', 'PERIOD_MAPPING_TYPE': u'DEFAULT', 'SOURCE_SYSTEM_TYPE': u'FILE', 'CHECK_FLAG': u'N', 'LEDGER_GROUP': None, 'TARGET_APPLICATION_NAME': u'SCB', 'RECALCULATE_FLAG': u'Y', 'SOURCE_SYSTEM_ID': 1L, 'KK_FLAG': u'N', 'IMPGROUPKEY': u'Pipeline_SCB', 'EXPORT_TO_TARGET_FLAG': u'N', 'TARGET_SOURCE_SYSTEM_TYPE': None, 'JOURNAL_FLAG': None, 'SOURCE_APPLICATION_ID': None, 'DIMNAME_LIST': [u'ACCOUNT', u'ENTITY', u'UD1', u'UD10', u'UD11', u'UD12', u'UD2', u'UD3', u'UD4', u'UD5', u'UD6', u'UD7', u'UD8', u'UD9'], 'FCI_FLAG': 'N', 'IMPSOURCECOAID': 0L, 'LAST_UPDATED_BY': u'scb_admin', 'DIMNAME_MAP': {u'UD6': {'TARGET_DIMENSION_CLASS_NAME': u'Generic', 'DIMNAME': u'UD6'}, u'UD3': {'TARGET_DIMENSION_CLASS_NAME': u'Generic', 'DIMNAME': u'UD3'}, u'UD8': {'TARGET_DIMENSION_CLASS_NAME': u'Generic', 'DIMNAME': u'UD8'}, u'ENTITY': {'TARGET_DIMENSION_CLASS_NAME': u'Entity', 'DIMNAME': u'ENTITY'}, u'UD7': {'TARGET_DIMENSION_CLASS_NAME': u'Generic', 'DIMNAME': u'UD7'}, u'UD9': {'TARGET_DIMENSION_CLASS_NAME': u'LOOKUP', 'DIMNAME': u'UD9'}, u'UD5': {'TARGET_DIMENSION_CLASS_NAME': u'Generic', 'DIMNAME': u'UD5'}, u'UD11': {'TARGET_DIMENSION_CLASS_NAME': u'LOOKUP', 'DIMNAME': u'UD11'}, u'UD4': {'TARGET_DIMENSION_CLASS_NAME': u'Generic', 'DIMNAME': u'UD4'}, u'ACCOUNT': {'TARGET_DIMENSION_CLASS_NAME': u'Account', 'DIMNAME': u'ACCOUNT'}, u'UD2': {'TARGET_DIMENSION_CLASS_NAME': u'Generic', 'DIMNAME': u'UD2'}, u'UD12': {'TARGET_DIMENSION_CLASS_NAME': u'LOOKUP', 'DIMNAME': u'UD12'}, u'UD10': {'TARGET_DIMENSION_CLASS_NAME': u'LOOKUP', 'DIMNAME': u'UD10'}, u'UD1': {'TARGET_DIMENSION_CLASS_NAME': u'Version', 'DIMNAME': u'UD1'}}, 'TARGET_APPLICATION_TYPE': u'HPL', 'PARTITIONKEY': 4L, 'IMPGROUPFILETYPE': u'MULTIPER', 'RULE_ID': 25L, 'SOURCE_ADAPTER_FLAG': u'N', 'PARTVALGROUP': u'[NONE]', 'WEB_SERVICE_URL': u'http://HKLVAPHYP01:6550/aif', 'LEDGER_GROUP_CODE': u'NONE', 'INCLUDE_ZERO_BALANCE_FLAG': None, 'DATA_LOAD_METHOD': u'CLASSIC_VIA_EPMI', 'EXECUTION_MODE': u'REPLACE', 'PLAN_NUMBER': 1L, 'IMPTARGETSOURCESYSTEMID': 0L, 'PS_LEDGER': None}
2019-07-15 19:00:48,651 DEBUG [AIF]: {u'Currency': {'BCN': u'UD7', 'DCN': u'Generic'}, u'Version': {'BCN': u'UD1', 'DCN': u'Version'}, u'View': {'BCN': u'UD3', 'DCN': u'Generic'}, u'Entity': {'BCN': u'ENTITY', 'DCN': u'Entity'}, u'Period': {'BCN': None, 'DCN': u'Period'}, u'Custom2': {'BCN': u'UD6', 'DCN': u'Generic'}, u'Account': {'BCN': u'ACCOUNT', 'DCN': u'Account'}, u'Custom4': {'BCN': u'UD8', 'DCN': u'Generic'}, u'Custom1': {'BCN': u'UD5', 'DCN': u'Generic'}, u'Layer': {'BCN': u'UD2', 'DCN': u'Generic'}, u'Scenario': {'BCN': None, 'DCN': u'Scenario'}, u'Custom3': {'BCN': u'UD4', 'DCN': u'Generic'}, u'Years': {'BCN': None, 'DCN': u'Year'}}
2019-07-15 19:00:48,651 DEBUG [AIF]: {u'UD3': {'IMPFLDSOURCECOLNAME': u'Function'}, u'UD6': {'IMPFLDSOURCECOLNAME': u'Product'}, u'UD8': {'IMPFLDSOURCECOLNAME': u'Custom4'}, u'ENTITY': {'IMPFLDSOURCECOLNAME': u'Organisation'}, u'UD7': {'IMPFLDSOURCECOLNAME': u'Currency'}, u'AMOUNT': {'IMPFLDSOURCECOLNAME': u'Amount'}, u'UD2': {'IMPFLDSOURCECOLNAME': u'Layer'}, u'UD12': {'IMPFLDSOURCECOLNAME': u'YTD_MTD'}, u'UD5': {'IMPFLDSOURCECOLNAME': u'Customer'}, u'UD4': {'IMPFLDSOURCECOLNAME': u'Custom3'}, u'ACCOUNT': {'IMPFLDSOURCECOLNAME': u'Account'}, u'UD1': {'IMPFLDSOURCECOLNAME': u'Version'}}
2019-07-15 19:00:48,651 DEBUG [AIF]: CommData.getRuleInfo - END
2019-07-15 19:00:48,653 DEBUG [AIF]: doAppPeriodMappingsExist - SCB: N
2019-07-15 19:00:48,653 DEBUG [AIF]: SELECT a.partitionkey,
a.catkey,
a.start_periodkey,
b.perioddesc,
coalesce(a.journal_flag,'N') JOURNAL_FLAG,
c.last_updated_by,
coalesce(a.FILE_NAME_STATIC,'') FILE_NAME_STATIC,
a.FILE_PATH,
a.RULE_ID,
a.application_id,
coalesce(br.MULTI_PERIOD_FILE_FLAG, 'N') MULTI_PERIOD_FILE_FLAG
FROM aif_bal_rule_loads a,
aif_balance_rules br,
tpovperiod b,
aif_processes c
WHERE a.loadid = 14591
AND a.start_periodkey=b.periodkey
AND a.loadid =c.process_id
AND br.rule_id = a.rule_id
2019-07-15 19:00:48,657 DEBUG [AIF]: FileData.py: Importing Text data for load id: 14591
2019-07-15 19:00:48,733 INFO [AIF]: EPMFDM-140274:Message - LOADID:PARTKEY:CATKEY:RULEID:CURRENCYKEY:FILEPATH:IMPGROUPFILETYPE::14591;4:1:25:[NONE]:/oracleshared/FDMEE/inbox/pipeline:MULTIPER
2019-07-15 19:00:48,737 INFO [AIF]: EPMFDM-140274:Message - File CharEncoding as per settings: UTF-8
2019-07-15 19:00:48,737 INFO [AIF]: EPMFDM-140274:Message - ImportTextData - Start
2019-07-15 19:00:48,737 DEBUG [AIF]: EPMFDM-140274:Message - SELECT pp.PERIODKEY,
pp.PERIODTARGET,
pp.GL_PERIOD_NAME,
en.FILE_ENTITY_NAME,
en.ENTITY_NAME_ORDER,
br.MULTI_PERIOD_FILE_FLAG,
pp.TRANS_ENTITY_NAME,
pp.GL_PERIOD_YEAR_CHAR,
pp.GL_PERIOD_NUM ,
pp.YEARTARGET
FROM AIF_PROCESS_PERIODS pp,
AIF_BALANCE_RULES br,
AIF_PROCESSES p,
(SELECT DISTINCT entity_name FILE_ENTITY_NAME,
pd.process_id,
pd.entity_name_order
FROM aif_process_details pd
WHERE pd.entity_type = 'PROCESS_BAL_IMP_FILE'
AND pd.target_table_name = 'TDATASEG'
AND pd.status = 'PENDING'
) en
WHERE pp.PROCESS_ID = ?
AND p.process_id = pp.process_id
AND en.process_id = pp.process_id
AND pp.IMP_ENTITY_NAME = en.file_entity_name
AND br.rule_id = p.rule_id
AND en.entity_name_order = pp.GL_EFFECTIVE_PERIOD_NUM
ORDER BY en.entity_name_order
2019-07-15 19:00:48,822 DEBUG [AIF]: Script- getRuleInfo
2019-07-15 19:00:48,822 DEBUG [AIF]: select t.TARGET_APPLICATION_TYPE,t.TARGET_APPLICATION_SUB_TYPE
from aif_target_applications t,
aif_processes p,
tpovpartition pt
where p.partitionkey = pt.partitionkey
AND p.process_id = ?
AND pt.PARTSOURCEAPPLICATIONID = t.application_id
2019-07-15 19:00:48,823 DEBUG [AIF]: SELECT COALESCE(p.partitionkey,0) PARTITIONKEY,
dir.FILE_PATH,
p.APPLICATION_ID,
ig.IMPGROUPFILETYPE,
COALESCE(p.LOG_FILE, ) LOG_FILE,
brl.FILE_NAME_STATIC,
tap.APPLICATION_NAME ,
COALESCE(br.IMPGROUPKEY, part.PARTIMPGROUP ) IMPGROUPKEY,
tdprd.TARGET_DIMENSION_NAME PERIOD_DIMENSION,
br.PERIOD_MAPPING_TYPE,
br.CALENDAR_ID,
tdact.TARGET_DIMENSION_NAME ACCOUNT_DIMENSION,
tdcur.TARGET_DIMENSION_NAME CURRENCY_DIMENSION
FROM aif_processes p,
aif_bal_rule_loads brl,
aif_balance_rules br,
tpovpartition part,
tbhvimpgroup ig,
aif_target_applications tap,
(SELECT COALESCE(
(SELECT PROFILE_OPTION_VALUE
|| /
FROM AIF_PROFILE_OPTION_VALUES
WHERE PROFILE_OPTION_NAME = PROFILE_APP_ROOT_DIRECTORY
AND LEVEL_ID = 1005
AND LEVEL_VALUE = brl.APPLICATION_ID
) ,COALESCE(
(SELECT PROFILE_OPTION_VALUE
|| /
FROM AIF_PROFILE_OPTION_VALUES
WHERE PROFILE_OPTION_NAME = PROFILE_APP_ROOT_DIRECTORY
AND LEVEL_ID = 1000
) ,' ) ,' )
|| COALESCE(brl.FILE_PATH, ') FILE_PATH,
brl.LOADID
FROM AIF_BAL_RULE_LOADS brl
) dir,
aif_target_applications td
LEFT OUTER JOIN aif_target_appl_dimensions tdprd
ON td.application_id = tdprd.application_id
AND tdprd.target_dimension_class_name = Period
LEFT OUTER JOIN aif_target_appl_dimensions tdact
ON td.application_id = tdact.application_id
AND tdact.target_dimension_class_name = Account
LEFT OUTER JOIN aif_target_appl_dimensions tdcur
ON td.application_id = tdcur.application_id
AND tdcur.target_dimension_class_name = Currency
WHERE p.process_id = ?
AND p.process_id = dir.loadid
AND brl.loadid = p.process_id
AND part.partitionkey = p.partitionkey
AND COALESCE(br.IMPGROUPKEY, part.PARTIMPGROUP ) = ig.IMPGROUPKEY
AND tap.application_id = p.application_id
AND br.rule_id = p.rule_id
AND brl.application_id = p.application_id AND ig.imptargetapplicationid = td.application_id
2019-07-15 19:00:48,825 DEBUG [AIF]: Peirod Dim Name:Period
2019-07-15 19:00:48,825 DEBUG [AIF]: FILE_CHARSET_ENCODING: UTF-8
2019-07-15 19:00:48,825 DEBUG [AIF]: SELECT fl.impgroupkey,
fl.impfldfieldname,
fl.impfldfixedtext,
fl.impfldstartpos,
fl.impfldlength,
fl.impfldsourcecolname,
ig.impgroupfiletype,
ig.impgroupdelimiter,
fl.impfldfieldname
FROM tbhvimpgroup ig,
tbhvimpitemfile fl,
tpovpartition part,
aif_processes pr,
aif_balance_rules b
WHERE pr.process_id = ?
AND part.partitionkey = pr.partitionkey
AND coalesce(b.IMPGROUPKEY,part.PARTIMPGROUP) = ig.impgroupkey
AND ig.impgroupkey = fl.impgroupkey
AND b.rule_id = pr.rule_id
AND (fl.impfldfieldname =DATA OR fl.impfldfieldname =AMOUNT) AND fl.impfldfixedtext is not null
2019-07-15 19:00:48,825 DEBUG [AIF]: SELECT fl.impgroupkey,
fl.impfldfieldname,
fl.impfldfixedtext,
fl.impfldstartpos,
fl.impfldlength,
fl.impfldsourcecolname,
ig.impgroupfiletype,
ig.impgroupdelimiter,
fl.impfldfieldname
FROM tbhvimpgroup ig,
tbhvimpitemfile fl,
tpovpartition part,
aif_processes pr,
aif_balance_rules b
WHERE pr.process_id = ?
AND part.partitionkey = pr.partitionkey
AND coalesce(b.IMPGROUPKEY,part.PARTIMPGROUP) = ig.impgroupkey
AND ig.impgroupkey = fl.impgroupkey
AND b.rule_id = pr.rule_id
AND (fl.impfldfieldname =DATA OR fl.impfldfieldname =AMOUNT) AND fl.impfldfixedtext is not null
2019-07-15 19:00:48,826 DEBUG [AIF]: select coalesce (td.balance_column_name, d.target_dimension_name) BALANCE_COLUMN_NAME
from aif_processes p,
aif_dimensions d,
aif_target_appl_dimensions td
where p.process_id = ?
and p.application_id = td.application_id
and td.dimension_id = d.dimension_id
and upper(d.target_dimension_name) = upper(?)
2019-07-15 19:00:48,826 DEBUG [AIF]: select coalesce (td.balance_column_name, d.target_dimension_name) BALANCE_COLUMN_NAME
from aif_processes p,
aif_dimensions d,
aif_target_appl_dimensions td
where p.process_id = ?
and p.application_id = td.application_id
and td.dimension_id = d.dimension_id
and upper(d.target_dimension_name) = upper(?)
2019-07-15 19:00:48,826 DEBUG [AIF]: SELECT CASE WHEN EXISTS (select 1 from aif_bal_rule_load_params where parameter_type = SOURCE_DRIVER_MEMBER and loadid = ? and PARAMETER_VALUE is not null )
THEN Y
ELSE N
END AS rec_exists
FROM AIF_VERSIONS
2019-07-15 19:00:48,827 DEBUG [AIF]: SELECT CASE WHEN EXISTS (SELECT 1 FROM TPOVPERIODADAPTOR WHERE INTSYSTEMKEY = ?)
THEN Y
ELSE N
END AS rec_exists
FROM AIF_VERSIONS
2019-07-15 19:00:48,827 DEBUG [AIF]: SELECT pp.PERIODKEY, pp.PERIODDESC
,0 GL_EFFECTIVE_PERIOD_NUM
FROM AIF_BAL_RULE_LOADS brl
INNER JOIN TPOVCATEGORY pc
ON pc.CATKEY = brl.CATKEY INNER JOIN TPOVPERIOD_FLAT_V pp
ON pp.PERIODFREQ = pc.CATFREQ AND pp.PERIODKEY >= brl.START_PERIODKEY AND pp.PERIODKEY <= brl.END_PERIODKEY
WHERE brl.LOADID = ?
ORDER BY PERIODKEY
2019-07-15 19:00:48,828 DEBUG [AIF]: SELECT
periodkey
FROM
TPOVPERIOD
WHERE
perioddesc = ?
2019-07-15 19:00:48,828 DEBUG [AIF]: SELECT
periodkey
FROM
TPOVPERIOD
WHERE
perioddesc = ?
2019-07-15 19:00:48,828 DEBUG [AIF]: Jan-19:2019-01-31
2019-07-15 19:00:48,828 DEBUG [AIF]: ColumnList: [9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20]
2019-07-15 19:00:48,828 DEBUG [AIF]: MemberList: [Jan-19]
2019-07-15 19:00:48,828 DEBUG [AIF]: Driver:Period
2019-07-15 19:00:48,828 DEBUG [AIF]: SELECT CASE WHEN EXISTS (select 1 from aif_bal_rule_load_params where parameter_type = SOURCE_PERIODS and loadid = ?)
THEN Y
ELSE N
END AS rec_exists
FROM AIF_VERSIONS
2019-07-15 19:00:48,829 DEBUG [AIF]: Source periods already exist in AIF_BAL_RULE_LOAD_PARAMS:
2019-07-15 19:00:48,829 DEBUG [AIF]: Fewer members provided as members than what was expected as per column expression.
2019-07-15 19:00:48,829 DEBUG [AIF]: Unequal list size.
2019-07-15 19:00:48,829 DEBUG [AIF]: ColumnList: [9]
2019-07-15 19:00:48,829 DEBUG [AIF]: MemberList: [Jan-19]
2019-07-15 19:00:48,829 DEBUG [AIF]: Driver:Period
2019-07-15 19:00:48,830 DEBUG [AIF]: Driver:Period
2019-07-15 19:00:48,830 DEBUG [AIF]: Member:[Jan-19]
2019-07-15 19:00:48,830 DEBUG [AIF]: Column:[9]
2019-07-15 19:00:48,886 DEBUG [AIF]: EPMFDM-140274:Message - ImpFieldName=AMOUNT9:ImpFieldText=Column=9,20;Driver=Period;:StartPos=9:SourceClName=Amount
2019-07-15 19:00:48,886 DEBUG [AIF]: EPMFDM-140274:Message - ImpFieldName=UD7:ImpFieldText=USD_Source:StartPos=1:SourceClName=Currency
2019-07-15 19:00:48,886 DEBUG [AIF]: EPMFDM-140274:Message - ImpFieldName=UD5:ImpFieldText=Script=Pipeline_C1.py:StartPos=5:SourceClName=Customer
2019-07-15 19:00:48,886 INFO [AIF]: EPMFDM-140274:Message - Instantiating JythonInterpreter
2019-07-15 19:00:49,009 DEBUG [AIF]: EPMFDM-140274:Message - Passing script file for execution to jython interpretor: /oracleshared/FDMEE/data/scripts/import/Pipeline_C1.py
2019-07-15 19:00:49,010 INFO [AIF]: Execute File: /oracleshared/FDMEE/data/scripts/import/Pipeline_C1.py
2019-07-15 19:00:49,010 DEBUG [AIF]: LOG_LEVEL: 5
2019-07-15 19:00:49,010 DEBUG [AIF]: Script File encoding: UTF-8
2019-07-15 19:00:49,011 DEBUG [AIF]: def Pipeline_C1(strField, strRecord):
segList = strRecord.split("\t")
C1=strField
if (len(segList) > 1):
#Return Custom1_NA for certain BS YTD and FFINF
#BSA Loans to Customers (BSA_LOAN_CUST_*)
#BSL Customer Deposits (BSL_DEP_CUST_*)
if segList[1].replace(",') == "YTD" and segList[3].replace(",') == "FFINF":
if segList[6].replace(",')[:14] == "BSA_LOAN_CUST_" or segList[6].replace(",')[:13] == "BSL_DEP_CUST_":
#C1="Custom1_NA"
C1=strField
if segList[6].replace(",')[:2] == "A_" and segList[6].replace(",') != "A_LOAN_CUST":
C1="C00"
if segList[6].replace(",')[:2] == "L_" and segList[6].replace(",') != "L_CUST_DEP":
C1="C00"
return C1
2019-07-15 19:00:49,025 DEBUG [AIF]: EPMFDM-140274:Message - compiling script:Pipeline_C1(strField,strRecord)
2019-07-15 19:00:49,026 DEBUG [AIF]: EPMFDM-140274:Message - ImpFieldName=UD6:ImpFieldText=Script=Pipeline_C2.py:StartPos=6:SourceClName=Product
2019-07-15 19:00:49,027 DEBUG [AIF]: EPMFDM-140274:Message - Passing script file for execution to jython interpretor: /oracleshared/FDMEE/data/scripts/import/Pipeline_C2.py
2019-07-15 19:00:49,027 INFO [AIF]: Execute File: /oracleshared/FDMEE/data/scripts/import/Pipeline_C2.py
2019-07-15 19:00:49,028 DEBUG [AIF]: LOG_LEVEL: 5
2019-07-15 19:00:49,028 DEBUG [AIF]: Script File encoding: UTF-8
2019-07-15 19:00:49,029 DEBUG [AIF]: def Pipeline_C2(strField, strRecord):
segList = strRecord.split("\t")
C2=strField
if (len(segList) > 1):
#Return P00 for certain BS YTD and FFINF
#BS Total Assets (A_*)
#BS Total Liabilities (L_*)
if segList[1].replace(",') == "YTD" and segList[3].replace(",') == "FFINF":
#if segList[6].replace(",') == "A_LOAN_CUST" or segList[6].replace(",') == "L_CUST_DEP":
if segList[6].replace(",')[:2] == "A_" or segList[6].replace(",')[:2] == "P_":
C2="P00"
return C2
2019-07-15 19:00:49,033 DEBUG [AIF]: EPMFDM-140274:Message - compiling script:Pipeline_C2(strField,strRecord)
2019-07-15 19:00:49,034 DEBUG [AIF]: EPMFDM-140274:Message - ImpFieldName=UD4:ImpFieldText=null:StartPos=6:SourceClName=Custom3
2019-07-15 19:00:49,034 DEBUG [AIF]: EPMFDM-140274:Message - ImpFieldName=ENTITY:ImpFieldText=null:StartPos=8:SourceClName=Organisation
2019-07-15 19:00:49,034 DEBUG [AIF]: EPMFDM-140274:Message - ImpFieldName=UD2:ImpFieldText=null:StartPos=3:SourceClName=Layer
2019-07-15 19:00:49,034 DEBUG [AIF]: EPMFDM-140274:Message - ImpFieldName=UD1:ImpFieldText=Final:StartPos=1:SourceClName=Version
2019-07-15 19:00:49,034 DEBUG [AIF]: EPMFDM-140274:Message - ImpFieldName=UD3:ImpFieldText=null:StartPos=4:SourceClName=Function
2019-07-15 19:00:49,034 DEBUG [AIF]: EPMFDM-140274:Message - ImpFieldName=ACCOUNT:ImpFieldText=Script=Account.py:StartPos=7:SourceClName=Account
2019-07-15 19:00:49,035 DEBUG [AIF]: EPMFDM-140274:Message - Passing script file for execution to jython interpretor: /oracleshared/FDMEE/data/scripts/import/Account.py
2019-07-15 19:00:49,035 INFO [AIF]: Execute File: /oracleshared/FDMEE/data/scripts/import/Account.py
2019-07-15 19:00:49,036 DEBUG [AIF]: LOG_LEVEL: 5
2019-07-15 19:00:49,036 DEBUG [AIF]: Script File encoding: UTF-8
2019-07-15 19:00:49,037 DEBUG [AIF]: def Account(strField, strRecord):
#Only keep MTD
segList = strRecord.split("\t")
if (len(segList) > 1):
if segList[1].replace(",') =="MTD":
return strField
else:
#Keep Certain BS YTD and FFINF
#BSA Loans to Customers (BSA_LOAN_CUST_*)
#BSL Customer Deposits (BSL_DEP_CUST_*)
#BS Total Assets (A_*)
#BS Total Liabilities (L_*)
if segList[3].replace(",') == "FFINF" and (strField[:2] == "A_" or strField[:2] == "L_" or strField[:14] == "BSA_LOAN_CUST_" or strField[:13] == "BSL_DEP_CUST_"):
return strField
elif strField == "NON_GRP_ASSETS_AV" or strField == "NON_GRP_LIABS_AV" or strField == "CONTINGENT_LIABS_AV" or strField == "RWA_AV_CR" or strField == "RWA_AV_OP" or strField == "RWA_AV_MKT":
#23/07/2017
#CR228 - Actual YTD Avg Balance alignment with Pipeline
#11/08/2017
#CR233 - Op RWA actuals - Added logic for Accounts: RWA_AV_CR, RWA_AV_OP, RWA_AV_MKT
return strField
else:
return fdmSkip
else:
return strField
2019-07-15 19:00:49,042 DEBUG [AIF]: EPMFDM-140274:Message - compiling script:Account(strField,strRecord)
2019-07-15 19:00:49,043 DEBUG [AIF]: EPMFDM-140274:Message - ImpFieldName=UD8:ImpFieldText=Custom4_NA;Script=Validate_file.py:StartPos=1:SourceClName=Custom4
2019-07-15 19:00:49,044 DEBUG [AIF]: EPMFDM-140274:Message - Passing script file for execution to jython interpretor: /oracleshared/FDMEE/data/scripts/import/Validate_file.py
2019-07-15 19:00:49,044 INFO [AIF]: Execute File: /oracleshared/FDMEE/data/scripts/import/Validate_file.py
2019-07-15 19:00:49,044 DEBUG [AIF]: LOG_LEVEL: 5
2019-07-15 19:00:49,044 DEBUG [AIF]: Script File encoding: UTF-8
2019-07-15 19:00:49,045 DEBUG [AIF]: cnt = 0
def Validate_file(strfield, strrecord):
global cnt
cnt = cnt + 1
linecount = 0
if strrecord[:11] == Line count::
footer = strrecord.split(:)
fdmAPI.logInfo(Footer is: %s % footer[1])
linecount = footer[1].strip().replace(.,').replace(\t,')
fdmAPI.logInfo(Linecount is: %s % linecount)
cnt = cnt - 1 # Remove the Footer
if int(linecount) == cnt:
fdmAPI.logInfo(File Validation count successful, number of lines: %s
% linecount)
else:
fdmAPI.logError(File Validation count failed, expected %s vs count %s
% (linecount, cnt))
errorFlagFile = %s/logs/%s_%s_valerr.flg \
% (fdmContext[OUTBOXDIR], fdmContext[TARGETAPPNAME
], fdmContext[LOADID])
fdmAPI.logInfo(%s % errorFlagFile)
flagFile = open(errorFlagFile, w)
flagFile.write(File Validation count failed, expected %s vs count %s
% (linecount, cnt))
flagFile.close()
return strfield
2019-07-15 19:00:49,051 DEBUG [AIF]: EPMFDM-140274:Message - compiling script:Validate_file(strField,strRecord)
2019-07-15 19:00:49,052 DEBUG [AIF]: EPMFDM-140274:Message - ImpFieldName=UD12:ImpFieldText=null:StartPos=2:SourceClName=YTD_MTD
2019-07-15 19:00:49,052 INFO [AIF]: EPMFDM-140274:Message - Initialize error maps
2019-07-15 19:00:49,052 INFO [AIF]: EPMFDM-140274:Message - File Name Data_Actuals_Y2019.txt
periodKey2019-01-31
2019-07-15 19:01:00,740 INFO [AIF]: EPMFDM-140274:Message - PROCESS ID: 14591
PARTITIONKEY: 4
IMPORT GROUP: Pipeline_SCB
FILE TYPE: MULTIPERIOD
DELIMITER:
SOURCE FILE: Data_Actuals_Y2019.txt
PROCESSING CODES:
-----------------------------------------------------------------------------------
2019-07-15 19:03:07,689 DEBUG [AIF]: multiDimSQL: [14591, 4L, '5470588']
2019-07-15 19:03:07,700 FATAL [AIF]: Error in COMM Init Process - Common Jython Functions
Traceback (most recent call last):
File "<string>", line 887, in _getMultiDimWhereClause
TypeError: cannot concatenate 'unicode' and 'NoneType' objects
2019-07-15 19:03:07,701 FATAL [AIF]: Error in CommMap.updateTDATASEG_T_TDATASEGW
Traceback (most recent call last):
File "<string>", line 1622, in updateTDATASEG_T_TDATASEGW
File "<string>", line 887, in _getMultiDimWhereClause
TypeError: cannot concatenate 'unicode' and 'NoneType' objects
2019-07-15 19:03:07,701 DEBUG [AIF]: Comm.executeScript - START
Please help to isolate the issue