Skip to Main Content

Analytics Software

Announcement

For appeals, questions and feedback about Oracle Forums, please email oracle-forums-moderators_us@oracle.com. Technical questions should be asked in the appropriate category. Thank you!

Ignoring all data load mappings but getting a successful DLR status

samlambertFeb 28 2020 — edited Mar 2 2020

I have a DLR where I ignore mappings for all members. In the process details I get a success status for import and transform, but the DLR stops after that and the status fails. I can see where it's happening from the DLR's log (I've attached the validate step below).

I only want the DLR to fail if any mappings are not ignored. e.g. If COUNT <= 0 return SUCCESS, ELSE: RETURN FAIL.

So during the validate step, the script should see that there are no records and flag that as success, and then export and consolidate should also be successful if this condition is met.

I'm pretty new to FDMEE though so I'm not really sure how I should complete this task. I think an SQL command could do the trick. I was thinking if I create 'like' mappings and then add a script rule to each of the mappings that might work. Any assistance would be much appreciated!

2020-02-28 14:57:24,798 INFO  [AIF]: -------START VALIDATE STEP-------
2020-02-28 14:57:24,898 DEBUG [AIF]: CommData.validateData - START
2020-02-28 14:57:24,898 DEBUG [AIF]: Comm.executeScript - START
2020-02-28 14:57:24,899 INFO  [AIF]: Executing the following script: C:\Oracle\Middleware\user_projects\epmsystem1\FDMEE/data/scripts/event/BefValidate.py
2020-02-28 14:57:24,910 DEBUG [AIF]: Comm.executeVBScript - START
2020-02-28 14:57:24,911 DEBUG [AIF]: The following script does not exist: C:\Oracle\Middleware\user_projects\epmsystem1\FDMEE\data\scripts\event\BefValidate.vbs
2020-02-28 14:57:24,911 DEBUG [AIF]: Comm.executeVBScript - END
2020-02-28 14:57:24,911 DEBUG [AIF]: Comm.executeScript - END
2020-02-28 14:57:24,931 DEBUG [AIF]: CommMap.validateData - START
2020-02-28 14:57:24,938 INFO  [AIF]:
Validate Data Mappings for Period 'Oct-19'
2020-02-28 14:57:24,938 DEBUG [AIF]:
      SELECT COUNT(*) ROW_COUNT
      FROM TDATASEG
      WHERE LOADID = 536
      AND (PARTITIONKEY = 24 AND CATKEY = 5 AND PERIODKEY = '2019-10-31' AND RULE_ID = 39 AND VALID_FLAG = 'Y')
     
2020-02-28 14:57:24,941 WARN  [AIF]: Warning: No records exist for Period 'Oct-19'
2020-02-28 14:57:24,941 DEBUG [AIF]: CommData.updateWorkflow - START
2020-02-28 14:57:24,941 DEBUG [AIF]:
        UPDATE TLOGPROCESS
        SET PROCESSENDTIME=CURRENT_TIMESTAMP
           ,PROCESSSTATUS=12,PROCESSVAL=0,BLNVALDIRTY=0
           ,PROCESSVALNOTE='AIF_WF_VAL_VALIDATE_ERR;0'
        WHERE PARTITIONKEY=24 AND CATKEY=5 AND PERIODKEY='2019-10-31' AND RULE_ID=39
       
2020-02-28 14:57:24,952 DEBUG [AIF]: CommData.updateWorkflow - END
2020-02-28 14:57:24,953 INFO  [AIF]: Total Data Rows available for Export to Target: 0
2020-02-28 14:57:24,953 DEBUG [AIF]: CommMap.validateData - END
2020-02-28 14:57:24,957 INFO  [AIF]:
Validate Data Members for Period 'Oct-19'
2020-02-28 14:57:24,957 DEBUG [AIF]:
      SELECT COUNT(*) ROW_COUNT
      FROM TDATASEG
      WHERE LOADID = 536
      AND (PARTITIONKEY = 24 AND CATKEY = 5 AND PERIODKEY = '2019-10-31' AND RULE_ID = 39 AND VALID_FLAG = 'Y')
     
2020-02-28 14:57:24,960 ERROR [AIF]: Error: No records exist for Period 'Oct-19'
2020-02-28 14:57:24,960 DEBUG [AIF]: CommData.updateWorkflow - START
2020-02-28 14:57:24,962 DEBUG [AIF]:
        UPDATE TLOGPROCESS
        SET PROCESSENDTIME=CURRENT_TIMESTAMP
           ,PROCESSSTATUS=12,PROCESSVAL=0,BLNVALDIRTY=0
           ,PROCESSVALNOTE='AIF_WF_VAL_VALIDATE_ERR;0'
        WHERE PARTITIONKEY=24 AND CATKEY=5 AND PERIODKEY='2019-10-31' AND RULE_ID=39
       
2020-02-28 14:57:24,969 DEBUG [AIF]: CommData.updateWorkflow - END
2020-02-28 14:57:24,969 INFO  [AIF]: Total Data Rows available for Export to Target: 0
2020-02-28 14:57:24,981 FATAL [AIF]: Error in CommData.validateData
Traceback (most recent call last):
  File "<string>", line 4459, in validateData
RuntimeError: [u"Error: No records exist for Period 'Oct-19'"]

2020-02-28 14:57:24,981 DEBUG [AIF]: CommData.updateWorkflow - START
2020-02-28 14:57:24,981 DEBUG [AIF]:
        UPDATE TLOGPROCESS
        SET PROCESSENDTIME=CURRENT_TIMESTAMP
           ,PROCESSSTATUS=12,PROCESSVAL=0,BLNVALDIRTY=0
           ,PROCESSVALNOTE='AIF_WF_VAL_VALIDATE_ERR;0'
        WHERE PARTITIONKEY=24 AND CATKEY=5 AND PERIODKEY='2019-10-31' AND RULE_ID=39
       
2020-02-28 14:57:24,988 DEBUG [AIF]: CommData.updateWorkflow - END
2020-02-28 14:57:24,989 DEBUG [AIF]: Comm.executeScript - START
2020-02-28 14:57:24,991 INFO  [AIF]: Executing the following script: C:\Oracle\Middleware\user_projects\epmsystem1\FDMEE/data/scripts/event/AftValidate.py
2020-02-28 14:57:25,000 DEBUG [AIF]: Comm.executeVBScript - START
2020-02-28 14:57:25,001 DEBUG [AIF]: The following script does not exist: C:\Oracle\Middleware\user_projects\epmsystem1\FDMEE\data\scripts\event\AftValidate.vbs
2020-02-28 14:57:25,001 DEBUG [AIF]: Comm.executeVBScript - END
2020-02-28 14:57:25,001 DEBUG [AIF]: Comm.executeScript - END
2020-02-28 14:57:25,253 DEBUG [AIF]: Comm.finalizeProcess - START
2020-02-28 14:57:25,256 DEBUG [AIF]: CommData.updateRuleStatus - START
2020-02-28 14:57:25,257 DEBUG [AIF]:
    UPDATE AIF_BALANCE_RULES
    SET STATUS = CASE 'FAILED'
      WHEN 'SUCCESS' THEN
        CASE ( SELECT COUNT(*) FROM AIF_PROCESS_DETAILS pd WHERE pd.PROCESS_ID = 536 AND pd.STATUS IN ('FAILED','WARNING') )
          WHEN 0 THEN 'SUCCESS'
          ELSE ( SELECT MIN(pd.STATUS) FROM AIF_PROCESS_DETAILS pd WHERE pd.PROCESS_ID = 536 AND pd.STATUS IN ('FAILED','WARNING') ) END
      ELSE 'FAILED' END
    WHERE RULE_ID = 39
   
2020-02-28 14:57:25,264 DEBUG [AIF]: CommData.updateRuleStatus - END
2020-02-28 14:57:25,266 FATAL [AIF]: Error in COMM Validate Data
2020-02-28 14:57:25,268 DEBUG [AIF]: Comm.updateProcess - START
2020-02-28 14:57:25,287 DEBUG [AIF]: Comm.updateProcess - END
2020-02-28 14:57:25,297 DEBUG [AIF]: The fdmAPI connection has been closed.
2020-02-28 14:57:25,300 INFO  [AIF]: FDMEE Process End, Process ID: 536

Comments