Services used by Merit FTT system

FTT Service Name	Tax Authority
SENDEMAILS	Common
MSGS	Common
ALTRADES	Common
BACKPOP	Common
INVCALC	Common
ADPIMP	FR
TRADESIMP	FR
DWIMP	FR
SLIMP	FR
ESTRADES	ES
ESDWIMP	ES
ESSLIMP	ES
ADPIMPES	ES
ITDWIMP	IT
ITHORIZON	IT
IT_SLIMP	IT
ADPIMPIT	IT
SYNTHIT	IT
ITTRADES	IT
STRUCTNTS	IT

FR Decision tree : M:\REGRESSIONTEST\BARCAP\FTT\FTT_FILES\FRANCE\FTT_FRENCH_DECISSION_TREE.vsd

IT Decision tree : M:\REGRESSIONTEST\BARCAP\FTT\FTT_FILES\ITALY\ IFTT Decision tree - Master Oct 17 - New Codes v3.vsd

ES Decision tree : M:\REGRESSIONTEST\BARCAP\FTT\FTT_FILES\SPAIN\ Spanish FTT Tree v1.3.vsd

TRADESIMP

Service is responsible for importing French trade data to the system from FISS data feed. The trade data gets saved to MRT_HFCLAIMSTRADES table. This is a cycling service (runs the activities one after other and repeats the activities once it reaches the end). The below table summarises the different stages of the service and the main functionalities of the activities:

Daily imp	Stage	Stage desc	Depends on stage	Min time	Give up time
TRADESIMP	100	Housekeeping		1200	2300
TRADESIMP	1000	Timelapse start		1200	2300
TRADESIMP	14000	Import FISS Trades	1000	1200	2330
TRADESIMP	20000	Reconciling trade counts in system and source file	14000	1200	2300
TRADESIMP	21000	Marking cancelled flag on amending trades	20000	1200	2300
TRADESIMP	55555	Restart scheduler	14000	1200	2300

Daily imp : Service identifier.
Stage : Service activity stage number. Starts from smaller to larger.
Stage desc : Brief description of the activity.
Depends on stage : If a number present the activity will run only after the dependent stage is successfully executed.
Min time : Minimum time in GMT when the activity will be running daily.
Give up time : Last time of the day the activity can be executed. If the activity is started and not finished it will run until it is finished.

Stage 100 : Housekeeping

Deletes files created temporarily during the import or older LOGS. The stage number must be below 1000. For the full list refer to the servicecustom_TRADESIMP.txt service file

Stage 1000 : Timelapse start

This stage reads and validates the import file and create an intermediate file which is then used for further processing. This stage calls a custom method called PreProcessClaims where it gets the source file from TRADESIMP_SRCFILE, eg. M:\MERITRESEARCH\BARCAP_FTT_UAT_20210108\Data\ALL_FR_Inst_20130726.csv, validates its name and opens the file. After reading the header content, it creates new header (for eg : "Company>CMPY|:|Counterparty>CPTY| etc). It expects 47 column names in it. After validating the same it processes whole data, deletes blank rows. It then deletes all txt files that starts with FTT_* from %TEMP% folder. Creates a new file %TEMP%FTT_"&DateT,".TXT", (eg : D:\Users\388802\AppData\Local\Temp\1\CMBARCLAYS_HF_SERVICE_TRADESIMP\I1\ FTT_2013072620210331-.txt) and copies the processed content to this file (Note : This is the file configured in system parameter Att.[TRADESIMP_IMPFILE] which is given as the preprocess source file in the scheduler)

During the data load it uses a post import rule with the name “143#TRADESIMP”. This rule will have all the post import enrichment and/or calculations for this trade data. Within this rule, it further imports data to CARDS, DECLARATIONS table which constitutes the invoice and declarations. The logic in the post import rule is as per the decision tree within FISS tab mentioned in FR Decision tree visio. The trades get saved in to MRT_HFCLAIMSTRADES.

Stage 20000 : Reconciling trade counts in system and source file

This stage compares record count in Source File and in System. It logs the error as ‘Record count in system did not Match with source count’ if there is a mismatch. Once the record count is successfully compared, the processed file is moved to Archive folder.

Stage 21000 : Marking cancelled flag on amending trades

This stage is for marking cancelled flag on trades being imported into the system wherever applicable based on the TRDFLAG column in the feed file. In case of any error a warning message “Error on stage(21000) TRADESIMP : Error while cancelling trades” is set and a notification email is triggered to the mail recipients configured in system parameter Att.[SRVSERRNFYEMAIL].

Stage 55555 : Restart scheduler

This activity is always the last activity of all the services. If the service is a cycling service and End of service time is not reached. The service will restart stage 1000. This stage will then run the activities based on the dependencies.

System parameters related to the service:

[Sender Email] – Sender visible in the incoming emails
[SRVSERRNFYEMAIL] – email address where error notifications will be send
[Email Server Params] – server parameters of the outbox used by services
[EMAIL_PWD] – encrypted password for mailbox saved in Att.[Email Server Params]
[IMPJOBSPLIT_TRADESIMP]– number of sub-processes started by the service during data processing
[TRADESIMP_SRCFILE] – source file which is fed to the system
[TRADESIMP_IMPFILE] – file which is given as the preprocess source file in the scheduler

DWIMP

Service is responsible for importing data into table MRT_HFCLAIMSTRADES with data feed DW. This is a cycling service (runs the activities one after other and repeats the activities once it reaches the end). The below table summarises the different stages of the service and the main functionalities of the activities.

Daily imp	Stage	Stage desc	Depends on stage	Min time	Give up time
DWIMP	100	Housekeeping		1300	2300
DWIMP	1000	Timelapse start		1300	2300
DWIMP	10000	Data import job to TRADES table	1000	1300	2300
DWIMP	11000	Check Record Count	10000	1300	2300
DWIMP	55555	Restart scheduler	11000	1300	2300

Stage : Service activity stage number. Starts from smaller to larger.
Stage desc : Brief description of the activity.
Depends on stage : If a number present the activity will run only after the dependant stage is successfully executed.
Min time : Minimum time in GMT when the activity will be running daily.
Give up time : Last time of the day the activity can be executed. If the activity is started and not finished it will run until it is finished.

Stage 100 : Housekeeping

Deletes files created temporarily during the import or older LOGS. The stage number must be below 1000. For the full list refer to the servicecustom_DWIMP.txt service file

Stage 1000 : Timelapse start

Stage 10000 : Data import job to TRADES table

In this stage, data is imported from source file using system parameter DWIMP_SRCFILE (eg: M:\MERITRESEARCH\BARCAP_FTT_UAT_20210108\Data\ DW_20130626.csv) into the MRT_HFCLAIMSTRADES table in a standard format. In this stage it calls a job 143#DWIMP under SERVICE_DWIMP in scheduler tab. This job is called every time a source file is picked. In this job initial column mapping with source file and standard table are done. Some column mappings are done by combining multiple columns.
Once column mapping is done it moves to next stage 10001 ImportCustomJob_10000. In this, there are some initial validations like, file exist, file size, file name (whether it ends with COB date ) on the source file is done. After file validation it validates the column header and throws exception if any column header is missing. Then it starts reading row by row data from the source file and write to a temporary file in Temp folder (eg: D:\Users\431250\AppData\Local\Temp\1\CMBARCLAYS_HF_SERVICE_DWIMP\I1\ DW_2013062620210331-.TXT) .

During the data load it uses a post import rule with the name “143#DWIMP”. This rule will have all the post import enrichment and/or calculations for this trade data.

Stage 11000: Check record count

In this stage it checks the record count for each COB date (source file) with database and if there is any mismatch it throws exception.

Stage 55555: Restart scheduler

[SVC_WAIT_FORFILE_TIME] – This is waiting for system before starting processing source file
[DWIMP_SRCFILE] – path of the source file where data needs to be processed
[SVC_DWIMP_IMP_RUNMODE] – To check for the run mode whether it is regression or not
[ ZIP_PROC_FILE] – Attribute to check whether file needs to be compressed or not
[MOVE_PROC_FILE_TO_ARCHIVE] – To check whether files need to be moved to archive folder or not

SLIMP

Service is responsible for importing French trade data to the system from Stock Loan and Global 1 data feeds. The trade data gets saved to MRT_HFCLAIMSTRADES table. This is a cycling service (runs the activities one after other and repeats the activities once it reaches the end). Barclays just uses Global 1 data feed and thus, the Daily import scheme stages related Stock Loan import is currently disabled in the system. The below table summarises the different stages of the service and the main functionalities of the activities:

Daily imp	Stage	Stage desc	Depends on stage	Min time	Give up time
SLIMP	100	Housekeeping		0100	2300
SLIMP	1000	Timelapse start		0100	2300
SLIMP	5000	Global 1 import for TRADES	1000	0100	2330
SLIMP	6000	Global 1, Marking cancelled flag on amending trades	5000	0100	2300
SLIMP	55555	Restart scheduler	6000	0100	2300

Daily imp : Service identifier.
Stage : Service activity stage number. Starts from smaller to larger.
Stage desc : Brief description of the activity.
Depends on stage : If a number present the activity will run only after the dependant stage is successfully executed.
Min time : Minimum time in GMT when the activity will be running daily.
Give up time : Last time of the day the activity can be executed. If the activity is started and not finished it will run until it is finished.

Stage 100 : Housekeeping

Deletes files created temporarily during the import or older LOGS. The stage number must be below 1000. For the full list refer to the servicecustom_SLIMP.txt service file

Stage 1000 : Timelapse start

Stage 5000 : Global 1 import for TRADES

This stage reads and validates the import file and create an intermediate file which is then used for further processing. This stage calls a custom method called PreProcess_GL1_File where it gets the source file from system parameter Att.[143#GL1IMP_SRCFILE] (eg: M:\REGRESSIONTEST\BARCAP\FTT\SLIMP\20130426\ GL1_20130426_20130528.csv), validates its name and opens the file. It expects 27 column names in it. After validating the same it processes whole data, deletes blank rows. It then deletes all txt files that starts with GL1_* from %TEMP% folder. Creates a new file %TEMP%GL1_"&DateT,".TXT" (eg : D:\Users\388802\AppData\Local\Temp\1\CMBARCLAYS_HF_SERVICE_SLIMP\I1\GL1_2013042620210401-.TXT ) and copies the processed content to this file (Note : This is the file configured in system parameter Att.[143#GL1IMP_IMPFILE] which is given as the pre-process source file in the scheduler)

During the data load it uses a post import rule with the name “143#GL1IMP”. This rule will have all the post import enrichment and/or calculations for this trade data. Within this rule, it further imports data to CARDS, DECLARATIONS table which constitutes the invoice and declarations. The logic in the post import rule is as per the decision tree within GOS tab mentioned in FR Decision tree visio. The trades get saved in to MRT_HFCLAIMSTRADES.

Stage 6000 : Global 1, Marking cancelled flag on amending trades

This stage is for marking cancelled flag on trades being imported into the system wherever applicable based on the TRDFLAG column in the feed file. In case of any error a warning message “Error on stage(6000) SLIMP : Error while cancelling trades” is set and a notification email is triggered to the mail recipients configured in system parameter Att.[SRVSERRNFYEMAIL].

Stage 55555 : Restart scheduler

System parameters related to the service:

[Sender Email] – Sender visible in the incoming emails
[SRVSERRNFYEMAIL] – email address where error notifications will be send
[Email Server Params] – server parameters of the outbox used by services
[EMAIL_PWD] – encrypted password for mailbox saved in Att.[Email Server Params]
[IMPJOBSPLIT_TRADESIMP]– number of sub-processes started by the service during data processing
[ 143#GL1IMP_SRCFILE] – source file which is fed to the system
[143#GL1IMP_IMPFILE] – file which is given as the pre-process source file in the scheduler

ITTRADES

Service is responsible for importing Italy trade data to the system from FISS data feed. This is a cycling service (runs the activities one after other and repeats the activities once it reaches the end). The below table summarises the different stages of the service and the main functionalities of the activities:

Daily imp	Stage	Stage desc	Depends on stage	Min time	Give up time
ITTRADES	100	Housekeeping		1230	2300
ITTRADES	1000	Timelapse start		1230	2300
ITTRADES	5000	Data Import Job to IT Trades	1000	1230	2330
ITTRADES	6000	Reconciling trade counts in system and source file	5000	1200	2300
ITTRADES	7000	Marking cancelled flag on amending trades	6000	1200	2300
ITTRADES	55555	Restart scheduler	14000	1200	2300

Daily imp : Service identifier.
Stage : Service activity stage number. Starts from smaller to larger.
Stage desc : Brief description of the activity.
Depends on stage : If a number present the activity will run only after the dependant stage is successfully executed.
Min time : Minimum time in GMT when the activity will be running daily.
Give up time : Last time of the day the activity can be executed. If the activity is started and not finished it will run until it is finished.

Stage 100 : Housekeeping

Deletes files created temporarily during the import or older LOGS. The stage number must be below 1000. For the full list refer to the servicecustom_ITTRADES.txt service file

Stage 1000 : Timelapse start

Stage 5000: Import FISS Trades

Import Stage looks for the Source file at the set system parameter Att.[157#ITTRADES_SRCFILE ] which is at M:\MERITRESEARCH\BARCAP_FTT_UAT_20210108\Data\ALL_FR_Inst_*.CSV")&"ALL_FRFTT_"&DateT&".TXT" and fetch the file to initiate a Pre-process activity where the column names and the columns counts are validated and creates new column headers. The date formats of the source data is also validated at this stage. A temporary file is generated for the Pre-processed data and is placed at the path Att.[157#ITTRADES _IMPFILE] (Ex : D:\Users\262465\AppData\Local\Temp\1\CMBARCLAYS_HF_SERVICE_ITTRADES\I1\IT_FTT_20140304.TXT) .Once the Temp File is created, Stage 5000 is executed, where a scheduler Job 157#ITTRADES picks the file from the temporary path and does the column mapping of the temporary file to the Database fields.

Calculated Fields : There are the calculated fields which are created based on the data in the temp file.“Key ” Value is generated using the Unique reference and COB Date in the Temp file. “Closed Field” is identified based on the TRADES_STATUS.“BUY/SELL” is identified based on the PURCH_SALE_IND fields. IPO Deal Type is hardcoded to “Not Applicable” FTT Applied Flag is Set Based on a Decision Tree where Charge_Type is FTT or not. Left side 10 Values of the DEPOT_ACCOUNT field is mapped to Depot column.Temp1 column in the Database is mapped to PRICE column in the Temp file.Temp2 column in the Database is mapped to CREATEDUP column in the Temp file.

After the Field mapping is loaded the system runs the POST IMPORT Rule 157#ITTRADES which is a Decision Tree. Inside the Tree the Temp2 column is checked for APPLY FLAG and later calls the fnTrades_IMP of the IT_TRADES Table. SDS is assigned at this Step and further proceeds to FS data Feed specific Processing. The logic in the post import rule is as per the decision tree within FISS tab mentioned in IT Decision tree visio. The trades get saved in to MRT_HFCLAIMSIT_TRADES

Stage 6000: Reconciling trade counts in system and source file

Stage 7000: Marking cancelled flag on amending trades

This stage is for marking cancelled flag on trades being imported into the system wherever applicable based on the TRDFLAG column in the feed file. In case of any error a warning message “Error on stage(7000) ITTRADES : Error while cancelling trades” is set and a notification email is triggered to the mail recipients configured in system parameter Att.[SRVSERRNFYEMAIL].

Stage 55555 : Restart scheduler

System parameters related to the service:

[Sender Email] – Sender visible in the incoming emails
[SRVSERRNFYEMAIL] – email address where error notifications will be send
[Email Server Params] – server parameters of the outbox used by services
[EMAIL_PWD] – encrypted password for mailbox saved in Att.[Email Server Params]
[ ITTRADES_SRCFILE] – source file which is fed to the system
[ ITTRADES_IMPFILE] – file which is given as the pre-process source file in the scheduler

ESTRADES

Service is responsible for importing Spanish trade data to the system from FISS data feed. The trade data gets saved to MRT_HFCLAIMSES_TRADES table. This is a cycling service (runs the activities one after other and repeats the activities once it reaches the end). The below table summarises the different stages of the service and the main functionalities of the activities:

Daily imp	Stage	Stage desc	Depends on stage	Min time	Give up time
ESTRADES	100	Housekeeping		1200	0800
ESTRADES	1000	Timelapse start		1200	0800
ESTRADES	14000	Import FISS Trades	1000	1200	0800
ESTRADES	20000	Reconciling trade counts in system and source file	2000	1200	0800
ESTRADES	21000	Marking cancelled flag on amending trades	20004	1200	0800
ESTRADES	55555	Restart scheduler	2000	1200	0800

Daily imp : Service identifier.
Stage : Service activity stage number. Starts from smaller to larger.
Stage desc : Brief description of the activity.
Depends on stage : If a number present the activity will run only after the dependant stage is successfully executed.
Min time : Minimum time in GMT when the activity will be running daily.
Give up time : Last time of the day the activity can be executed. If the activity is started and not finished it will run until it is finished.

Stage 100 : Housekeeping

Deletes files created temporarily during the import or older LOGS. The stage number must be below 1000. For the full list refer to the servicecustom_ESTRADES.txt service file

Stage 1000 : Timelapse start

Stage 14000 : Import FISS Trades

This stage reads and validates the import file and create an intermediate file which is then used for further processing. This stage calls a custom method called PreProcessClaims where it gets the source file from File.[2#ESTRADES_SRCFILE] eg: M:\REGRESSIONTEST\BARCAP\FTT\ESTRADES\20201209\ ALL_ES_Inst_20201209.csv, validates its name and opens the file. After reading the header content, it creates new header (for eg : "Company>CMPY|:|Counterparty>CPTY| etc). It expects 47 column names in it. After validating the same it processes whole data, deletes blank rows. It then deletes all txt files that starts with FTT_* from %TEMP% folder. Creates a new file %TEMP%ES_FTT_"&DateT,".TXT" (eg : D:\Users\388802\AppData\Local\Temp\1\CMBARCLAYS_HF_SERVICE_ESTRADES\I1\ ES_FTT_2020120920210408-.TXT) and copies the processed content to this file (Note : This is the file configured in system parameter Att.[ESTRADES_IMPFILE] which is given as the preprocess source file in the scheduler)

During the data load it uses a post import rule with the name “2#ES_TRADESIMPORT”. This rule will have all the post import enrichment and/or calculations for this trade data. Within this rule, it further imports data to CARDS, DECLARATIONS table which constitutes the invoice and declarations. The logic in the post import rule is as per the decision tree within FISS tab mentioned in ES Decision tree visio. The trades get saved in to MRT_HFCLAIMSES_TRADES.

Stage 20000 : Reconciling trade counts in system and source file

Stage 21000 : Marking cancelled flag on amending trades

This stage is for marking cancelled flag on trades being imported into the system wherever applicable based on the TRDFLAG column in the feed file. In case of any error a warning message “Error on stage(21000) ESTRADES : Error while cancelling trades” is set and a notification email is triggered to the mail recipients configured in system parameter Att.[SRVSERRNFYEMAIL].

Stage 55555 : Restart scheduler

System parameters related to the service:

[Sender Email] – Sender visible in the incoming emails
[SRVSERRNFYEMAIL] – email address where error notifications will be send
[Email Server Params] – server parameters of the outbox used by services
[EMAIL_PWD] – encrypted password for mailbox saved in Att.[Email Server Params]
[IMPJOBSPLIT_ESTRADES]– number of sub-processes started by the service during data processing
[ESTRADES_SRCFILE] – source file which is fed to the system
[ESTRADES_IMPFILE] – file which is given as the pre-process source file in the scheduler

ESSLIMP

This service is used to import Spain trades data to the system from Stock Loan and Global 1 data feeds. This is a cycling service (runs the activities one after other and repeats the activities once it reaches the end). Barclays only uses Global1 data feed and thus, the Daily import scheme stages related Stock Loan import is currently disabled in the system. The below table summarises the different stages of the service and the main functionalities of the activities:

Daily imp	Stage	Stage desc	Depends on stage	Min time	Give up time
ESSLIMP	100	Housekeeping		0100	2300
ESSLIMP	1000	Timelapse start		0100	2300
ESSLIMP	15000	Global 1 import to ES_TRADES	1000	0100	2330
ESSLIMP	15005	Global 1, Marking cancelled flag on amending trades	15000	0100	2300
ESSLIMP	55555	Restart scheduler	15005	0100	2300

Daily imp : Service identifier.
Stage : Service activity stage number. Starts from smaller to larger.
Stage desc : Brief description of the activity.
Depends on stage : If a number present the activity will run only after the dependant stage is successfully executed.
Min time : Minimum time in GMT when the activity will be running daily.
Give up time : Last time of the day the activity can be executed. If the activity is started and not finished it will run until it is finished.

Stage 100 : Housekeeping

Deletes files created temporarily during the import or older LOGS. The stage number must be below 1000. For the full list refer to the servicecustom_ESSLIMP.txt service file.

Stage 1000 : Timelapse start

Stage 15000 : Global 1 import for TRADES

Import Stage looks for the Source file at File.[2#ESGLIMP_SRCFILE] which is M:\MERITRESEARCH\BARCAP_FTT_UAT_20210108\Data\ES_GL1_*.CSV","*",DateT&"*")) and fetch the file to initiate a Pre-process activity where the columns counts are validated and there must be 27 columns in the source file. The System sets the value for the Brexit Cut off from the System Parameter at this stage and creates new column headers. Pre process the Validates for INPUT_DT, TRADE, INPUT_TIME,OS_ACCNR,C_MAJOR,BGNREF. Entities are updated in the Temp file based on the data Provided in the Source file using the following logic.

if datacol1="BARCAP.LDDATA" OR right(datacol1,8)="BCSLDATA" then entity="BCSL"

if datacol1="BARCAP.NYDATA" OR right(datacol1,7)="BCIDATA" then entity="BCI"

if datacol1="BBPLC.LDDATA" OR right(datacol1,9)="BBPLCDATA" then entity="BBPLC"

if right(datacol1,7)="BBIDATA" then entity="BBI"

Same headers which are provided in the Source is used while creating the temporary data file. This temporary file is placed at the path Att.[2#ESGL1IMP_IMPFILE ] (Ex: D:\Users\262465\AppData\Local\Temp\1\CMBARCLAYS_HF_SERVICE_ESSLIMP\I1\ES_GL1_20201021.TXT).Once the Temp File is created, Stage 15005 is executed, where a scheduler Job 157#ITTRADES picks the file from the temporary path and does the column mapping of the temporary file to the Database fields.

Calculated Fields : There are the calculated fields which are created based on the data in the temp file. “Key ” Value is generated using the unique ref, Input time and COB Date fields in the Temp file. “Closed Field” is identified based on the ACT_TYPE whether its XPR or XPL.“Nominal” is calculated from ACT_QTY fields.“BUY/SELL” is identified based on the BL field. Depot is calculated using a Decision Tree based on the OS_ACCNR field. Trade status is calculated using a Decision Tree based on the field ACT_TYPE .Temp1 column in the Database is mapped to ACT_PRC column in the Temp file. After the Field mapping is loaded the system runs the POST IMPORT Rule 2#ES_TRADES_GL1IMPORT. which is a Decision Tree. Inside the Tree the Data feed is checked for “G1” and then the Temp1 is set to Price column of the ES_TRADES and later calls the fnTrades_IMP of the ES_TRADES Table.

Inside the fnTrades_IMP , values for TAXAUTH, Charge Applied and Charge Category is Hardcoded to ES specific values and SDS is assigned and further proceeds to G1 data Feed specific Processing. The logic in the post import rule is as per the decision tree within FISS tab mentioned in ES Decision tree visio. The trades get saved in to MRT_HFCLAIMSES_TRADES.

Stage 15005: Global 1, Marking cancelled flag on amending trades

This stage is for marking cancelled flag on trades being imported into the system wherever applicable based on the TRDFLAG column in the feed file. In case of any error a warning message “Error on stage(15005) ESSLIMP : Error while cancelling trades” is set and a notification email is triggered to the mail recipients configured in system parameter Att.[SRVSERRNFYEMAIL].

Stage 55555 : Restart scheduler

System parameters related to the service:

[Sender Email] – Sender visible in the incoming emails
[SRVSERRNFYEMAIL] – email address where error notifications will be send
[Email Server Params] – server parameters of the outbox used by services
[EMAIL_PWD] – encrypted password for mailbox saved in Att.[Email Server Params]
[IMPJOBSPLIT_TRADESIMP]– number of sub-processes started by the service during data processing
[ 2#ESGL1IMP _SRCFILE] – source file which is fed to the system
[ 2#ESGL1IMP_IMPFILE] – file which is given as the pre-process source file in the scheduler

ITDWIMP

Service is responsible for importing data into table MRT_HFCLAIMSIT_TRADES with data feed DW. This is a cycling service (runs the activities one after other and repeats the activities once it reaches the end). The below table summarises the different stages of the service and the main functionalities of the activities.

Daily imp	Stage	Stage desc	Depends on stage	Min time	Give up time
ITDWIMP	100	Housekeeping		1300	2300
ITDWIMP	1000	Timelapse start		1300	2300
ITDWIMP	2000	Data import job to ITTRADES table	1000	1300	2300
ITDWIMP	3000	Check Record Count	10000	1300	2300
ITDWIMP	55555	Restart scheduler	11000	1300	2300

Stage 100 : Housekeeping

Deletes files created temporarily during the import or older LOGS. The stage number must be below 1000. For the full list refer to the servicecustom_INVCALC.txt service file

Stage 1000 : Time lapse start

Stage 2000: Data import job to ITTRADES table

Import Stage looks for the Source file at File.[157#ITDWIMP _SRCFILE] which is M:\MERITRESEARCH\BARCAP_FTT_UAT_20210108\Data\IT_DW_*.CSV","*",DateT&" and fetch the file to initiate a Pre-process activity where the columns counts are validated and there must be 30 columns in the source file. The source file headers are checked for Trade date, Currency, ISIN, Book, SIDE, Client SDS and IPO Deal type columns which are all required columns for pre-processing and if this header validation processing Interrupts. After this initial validation a Temp file is generated prefixing “IT_DW” inside the Temp folder mentioned in the system parameter Att.[157#ITDWIMP_IMPFILE] (Ex : D:\Users\262465\AppData\Local\Temp\1\CMBARCLAYS_HF_SERVICE_ITDWIMP\I1\IT_DW_20140304.TXT).Once the Temp File is created, Stage 2000 is executed, where a scheduler Job 157#ITDWIMP picks the file from the temporary path and does the column mapping of the temporary file to the Database fields.

Calculated Fields : There are the calculated fields which are created based on the data in the temp file. “Key” Value is generated using the unique ref and COB Date fields in the Temp file. “Nominal” is calculated from Quantity field. “BUY/SELL” is identified based on the “Side” field. Account Number is calculated based on the SDS ID using a Decision Tree Logic . Entity and Company is decided based on lglEntity field using a decision Tree . Temp1 column in the Database is mapped to Price column in the Temp file.

After the Field mapping is loaded the system runs the POST IMPORT Rule 157#ITDWIMP which is a Decision Tree. Inside the Tree the Data feed is checked for “G1” and then the Temp1 is set to Price column of the ES_TRADES and later calls the fnTrades_IMP of the IT_TRADES Table. Inside the fnTrades_IMP , values for TAXAUTH Hardcoded to ES specific values and SDS is assigned and further proceeds to DW data Feed specific Processing. The logic in the post import rule is as per the decision tree within FISS tab mentioned in FR Decision tree visio. The trades get saved in to MRT_HFCLAIMSIT_TRADES.

Stage 3000: Check record count

In this stage it checks the record count for each COB date (source file) with database and if there is any mismatch it throws exception.

Stage 55555: Restart scheduler

ADPIMP

Service is responsible for importing data into table MRT_HFCLAIMSTRADES with data feed AP. This is a cycling service (runs the activities one after other and repeats the activities once it reaches the end). The below table summarises the different stages of the service and the main functionalities of the activities.

Daily imp	Stage	Stage desc	Depends on stage	Min time	Give up time
ADPIMP	100	Housekeeping		0100	0000
ADPIMP	1000	Timelapse start		800	0000
ADPIMP	2000	Data import job to FXRATES	1000	800	2300
ADPIMP	5000	Data import job to ADPIMP	2000	800	2300
ADPIMP	6000	Marking cancelled flag on amending trades	5000	800	2300
ADPIMP	7000	Move processed files	6000	800	2300
ADPIMP	55555	Restart scheduler	6000	800	2300

Stage 100 : Housekeeping

Stage 2000 : Data import job to FXRATES

In this stage it calls a job 122#FXRATEIMP under SERVICE_ADPIMP in scheduler tab. Source file for this job is imported using system parameter ADPIMP_FXRATE _IMPFILE. (eg: M:\MERITRESEARCH\BARCAP_FTT_UAT_20210108\Data\<COBDATE>_newfile.dat). In this job initial column mapping with source file and standard table are done. Some column mappings are done by combining multiple columns. Apart from that some columns values are pre-set in this job (CCY= 5..7, GBP_RATE_1= 8..22, GBP_RATE_2= 23..37, USD_RATE_1= 38..52, USD_RATE_2= 53..67, IMPDATE= 68..76).
Once column mapping is done it moves to next stage 2001 PreProcessFXRateFile. In this stage, first it deletes all the previously imported files from temp folder. After deleting from temp folder, source file is read from the path and is looped row by row data from the source file and is written in to a temporary file in Temp folder (eg: D:\Users\431250\AppData\Local\Temp\1\CMBARCLAYS_HF_SERVICE_ADPIMP\I1\ ADPIMP_FXRATES_20130628_1446350020210407-.TXT).

Stage 5000: Data import job to ADPIMP

In this stage it calls a job 143#ADPIMP under SERVICE_ADPIMP in scheduler tab. Source file for this job is imported using system parameter ADPIMP_SRCFILE . (eg: M:\MERITRESEARCH\BARCAP_FTT_UAT_20210108\Data\FRT_extract_<COBDATE>). In this job initial column mapping with source file and standard table are done. Some column mappings are done by combining multiple columns.
Once column mapping is done it moves to next stage 5001 PreProcessADPIMP. In this, there are some initial validations like, file exist, file size, file name (whether it ends with COB date ) on the source file is done. After file validation it validates the column header and throws exception if any column header is missing. Then it starts reading row by row data from the source file and write to a temporary file in Temp folder(eg: D:\Users\431250\AppData\Local\Temp\1\CMBARCLAYS_HF_SERVICE_ADPIMP\I1\ ADPIMP_20130627_1401200020210407-.TXT). The logic in the post import rule is as per the decision tree within ADP tab mentioned in FR Decision tree visio.

During the data load it uses a post import rule with the name “143#DWIMP”. This rule will have all the post import enrichment and/or calculations for this trade data.

Stage 6000 : Marking cancelled flag on amending trades

This stage is for marking cancelled flag on trades being imported into the system wherever applicable based on the TRDFLAG column in the feed file. In case of any error a warning message “Error on stage(6000) ADPIMP : Error while cancelling trades” is set and a notification email is triggered to the mail recipients configured in system parameter Att.[SRVSERRNFYEMAIL].

Stage 55555: Restart scheduler

System parameters related to the service:

[ADPIMP_FXRATE_SRCFILE] – To get FX Rate source file
[ADPIMP_FXRATE_IMPFILE] – To get temp file path
[MOVE_PROC_FILE_TO_ARCHIVE] – To validate whether file should be moved to archive folder
[CREATE_ADP_BLANKFILE] – Validate whether to create black file in data folder if file not exist
[ADPIMP_IMPFILE] – To get temp file path

ESDWIMP

Service is responsible for importing data into table MRT_HFCLAIMSES_TRADES with data feed DW. This is a cycling service (runs the activities one after other and repeats the activities once it reaches the end). The below table summarises the different stages of the service and the main functionalities of the activities.

Daily imp	Stage	Stage desc	Depends on stage	Min time	Give up time
ESDWIMP	100	Housekeeping		800	2300
ESDWIMP	1000	Timelapse start		800	2300
ESDWIMP	11000	Data import job to ES_TRADES table	1000	800	2300
ESDWIMP	11005	Check Record Count	11000	800	2300
ESDWIMP	55555	Restart scheduler	11000	800	2300

Stage 100 : Housekeeping

Stage 11000 : Data import job to TRADES table

In this stage, data is imported from source file using system parameter File. 2#ESDWIMP _SRCFILE (eg: M:\MERITRESEARCH\BARCAP_FTT_UAT_20210108\Data\ES_DW_20201006.csv) into the MRT_HFCLAIMSTRADES table in a standard format. In this stage it calls a job 2#ES_TRADESDWIMPIMPORT under SERVICE_ESDWIMP in scheduler tab. This job is called every time a source file is picked. In this job initial column mapping with source file and standard table are done. Some column mappings are done by combining multiple columns.
Once column mapping is done it moves to next stage 11005 ImportCustomJob_11000. In this, there are some initial validations like, file exist, file size, file name (whether it ends with COB date ) on the source file is done. After file validation it validates the column header and throws exception if any column header is missing. Then it starts reading row by row data from the source file and write to a temporary file in Temp folder (eg: D:\Users\431250\AppData\Local\Temp\1\CMBARCLAYS_HF_SERVICE_DWIMP\I1\ ES_DW_2013062620210331-.TXT).

During the data load it uses a post import rule with the name “2#ES_TRADESDWIMPIMPORT”. This rule will have all the post import enrichment and/or calculations for this trade data. The logic in the post import rule is as per the decision tree within DW tab mentioned in ES Decision tree visio . The data is saved into table MRT_HFCLAIMES_TRADES.

Stage 11005: Check record count

In this stage it checks the record count for each COB date (source file) with database and if there is any mismatch it throws exception.

Stage 55555: Restart scheduler

System parameters related to the service:

[SVC_WAIT_FORFILE_TIME] – This is waiting for system before starting processing source file
[2#ESDWIMP_SRCFILE] – path of the source file where data needs to be processed
[SVC_ESDWIMP_IMP_RUNMODE] – To check for the run mode whether it is regression or not

IT_SLIMP

Service is responsible for importing data into table MRT_HFCLAIMSIT_TRADES with data feed G1. This is a cycling service (runs the activities one after other and repeats the activities once it reaches the end). The below table summarises the different stages of the service and the main functionalities of the activities.

Daily imp	Stage	Stage desc	Depends on stage	Min time	Give up time
IT_SLIMP	100	Housekeeping		800	2300
IT_SLIMP	1000	Timelapse start		800	2300
IT_SLIMP	3000	Data import job to IT_TRADES for Global 1 IMP	1000	800	2300
IT_SLIMP	55555	Restart scheduler	3000	800	2300

Stage 100 : Housekeeping

Stage 3000 : Data import job to IT_TRADES for Global 1 IMP

In this stage, data is imported from source file using system parameter File. 157#IT _GL1IMP_SRCFILE (eg: M:\REGRESSIONTEST\BARCAP\FTT\FTT_FILES\ITALY\STOCK_LOAN\ IT_GL1_20130301_20130925.csv) into the MRT_HFCLAIMSIT_TRADES table in a standard format. In this stage it calls a job 157#IT_GL1IMP under SERVICE_ITSLIMP in scheduler tab. This job is called every time a source file is picked. In this job initial column mapping with source file and standard table are done. Some column mappings are done by combining multiple columns.
Once column mapping is done it moves to next stage 3001 PreProcess_GL1_File. In this, there are some initial validations like, file exist, file size, file name (whether it ends with COB date ) on the source file is done. After file validation it validates the column header and throws exception if any column header is missing. Then it starts reading row by row data from the source file and write to a temporary file in Temp folder (eg: D:\Users\431250\AppData\Local\Temp\1\CMBARCLAYS_HF_SERVICE_IT_SLIMP\I1\ IT_GL1_2013030120210413-.TXT).

During the data load it uses a post import rule with the name “157#IT_GL1IMP”. This rule will have all the post import enrichment and/or calculations for this trade data. The logic in the post import rule is as per the decision tree within GL1 tab mentioned in IT Decision tree visio . The data is saved into table MRT_HFCLAIMIT_TRADES.

Stage 55555: Restart scheduler

[SVC_WAIT_FORFILE_TIME] – This is waiting for system before starting processing source file
[157#IT_GL1IMP_SRCFILE] – path of the source file where data needs to be processed
[DEMOENTITY1] – To set demo entity (eg:MER1)

STRUCTNTS

Service is responsible for importing data into table MRT_HFCLAIMSIT_TRADES with data feed SN. This is a cycling service (runs the activities one after other and repeats the activities once it reaches the end). The below table summarises the different stages of the service and the main functionalities of the activities.

Daily imp	Stage	Stage desc	Depends on stage	Min time	Give up time
STRUCTNTS	100	Housekeeping		800	2300
STRUCTNTS	1000	Timelapse start		800	2300
STRUCTNTS	2000	Importing Structured Notes FTTISO file	1000	800	2300
STRUCTNTS	3000	Reconciling trade counts in system and source file for ISO	2000	800	2300
STRUCTNTS	3500	Marking cacelled flag on amending trades ISO	3000	800	2300
STRUCTNTS	4000	Importing Structured Notes FTTIIO file	3500	800	2300
STRUCTNTS	5000	Reconciling trade counts in system and source file for IIO	4000	800	2300
STRUCTNTS	5500	Marking cacelled flag on amending trades IIO	5000	800	2300
STRUCTNTS	6000	Importing Structured Notes FTTIIE file	5500	800	2300
STRUCTNTS	7000	Reconciling trade counts in system and source file for IIE	6000	800	2300
STRUCTNTS	7500	Marking cacelled flag on amending trades IIE	7000	800	2300
STRUCTNTS	8000	Importing Structured Notes FTTISE file	7500	800	2300
STRUCTNTS	9000	Reconciling trade counts in system and source file for ISE	8000	800	2300
STRUCTNTS	9500	Marking cacelled flag on amending trades ISE	9000	800	2300
STRUCTNTS	55555	Restart scheduler	9500	800	2300

Stage 100 : Housekeeping

Stage 2000 : Importing Structured Notes FTTISO file

In this stage, data is imported from source file using system parameter File. 157#STRUCTNTS_ISO_SRCFILE (eg: M:\MERITRESEARCH\BARCAP_FTT_UAT_20210108\Data\FISS_ITT_ISO_ELIGIBLE_ISTR_20140304.CSV) into the MRT_HFCLAIMSIT_TRADES table in a standard format. In this stage it calls a job 157#STRUCTNTS_ISO under SERVICE_STRUCTNTS in scheduler tab. This job is called every time a source file is picked. In this job initial column mapping with source file and standard table are done. Some column mappings are done by combining multiple columns.
Once column mapping is done it moves to next stage 2001 PreProcessFTT. From this function it further calls method PreProcessFile. In this, there are some initial validations like, file exist, file size, file name (whether it ends with COB date ) on the source file is done. After file validation it validates the column header and throws exception if any column header is missing. Then it starts reading row by row data from the source file and write to a temporary file in Temp folder (eg: D:\Users\431250\AppData\Local\Temp\1\CMBARCLAYS_HF_SERVICE_STRUCTNTS\I1\FISS_ITT_ISO_ELIGIBLE_ISTR_20140304_0222150020210416-.TXT).

During the data load it uses a post import rule with the name “157#STRUCTNTS_ISO”. This rule will have all the post import enrichment and/or calculations for this trade data. The logic in the post import rule is as per the decision tree within SN tab mentioned in IT Decision tree visio. The data is saved into table MRT_HFCLAIMIT_TRADES.

Stage 3000 : Reconciling trade counts in system and source file for ISO

In this stage, it compares record count of source file with database (eg: MRTDATAFEED='SN' AND MRTPRODTYP='ISO' AND MRTUNIQUEREF NOT LIKE '%_BCDUP' AND MRTIMPDATE=20140304). If there is mismatch, it throws exception. If there is no exception, then the processed file is moved to archive folder.

Stage 3500 : Marking cacelled flag on amending trades ISO

This stage is for marking cancelled flag on trades being imported into the system wherever applicable based on the TRDFLAG column in the feed file. In case of any error a warning message “Error on stage(3500) STRUCTNTS : Error while cancelling trades” is set and a notification email is triggered to the mail recipients configured in system parameter Att.[SRVSERRNFYEMAIL].

Stage 4000 : Importing Structured Notes FTTIIO file

In this stage, data is imported from source file using system parameter File. 157#STRUCTNTS_IIO_SRCFILE (eg: M:\MERITRESEARCH\BARCAP_FTT_UAT_20210108\Data\FISS_ITT_IIO_ELIGIBLE_ISTR_20140304.CSV) into the MRT_HFCLAIMSIT_TRADES table in a standard format. In this stage it calls a job 157#STRUCTNTS_IIO under SERVICE_STRUCTNTS in scheduler tab. This job is called every time a source file is picked. In this job initial column mapping with source file and standard table are done. Some column mappings are done by combining multiple columns.
Once column mapping is done it moves to next stage 2001 PreProcessFTT. From this function it further calls method PreProcessFile. In this, there are some initial validations like, file exist, file size, file name (whether it ends with COB date ) on the source file is done. After file validation it validates the column header and throws exception if any column header is missing. Then it starts reading row by row data from the source file and write to a temporary file in Temp folder (eg: D:\Users\431250\AppData\Local\Temp\1\CMBARCLAYS_HF_SERVICE_STRUCTNTS\I1\FISS_ITT_IIO_ELIGIBLE_ISTR_20140304_0222150020210416-.TXT).

During the data load it uses a post import rule with the name “157#STRUCTNTS_IIO”. This rule will have all the post import enrichment and/or calculations for this trade data. The logic in the post import rule is as per the decision tree within SN tab mentioned in IT Decision tree visio. The data is saved into table MRT_HFCLAIMIT_TRADES.
All the records inserted via this import will be inserted with the below column field values :

Stage 5000 : Reconciling trade counts in system and source file for IIO

In this stage, it compares record count of source file with database (eg: MRTDATAFEED='SN' AND MRTPRODTYP='IIO' AND MRTUNIQUEREF NOT LIKE '%_BCDUP' AND MRTIMPDATE=20140304). If there is mismatch, it throws exception. If there is no exception, then the processed file is moved to archive folder.

Stage 5500 : Marking cacelled flag on amending trades IIO

This stage is for marking cancelled flag on trades being imported into the system wherever applicable based on the TRDFLAG column in the feed file. In case of any error a warning message “Error on stage(5500) STRUCTNTS : Error while cancelling trades” is set and a notification email is triggered to the mail recipients configured in system parameter Att.[SRVSERRNFYEMAIL].

Stage 6000 : Importing Structured Notes FTTIIE file

In this stage, data is imported from source file using system parameter File. 157#STRUCTNTS_IIE_SRCFILE (eg: M:\MERITRESEARCH\BARCAP_FTT_UAT_20210108\Data\FISS_ITT_IIE_ELIGIBLE_ISTR_20140304.CSV) into the MRT_HFCLAIMSIT_TRADES table in a standard format. In this stage it calls a job 157#STRUCTNTS_IIE under SERVICE_STRUCTNTS in scheduler tab. This job is called every time a source file is picked. In this job initial column mapping with source file and standard table are done. Some column mappings are done by combining multiple columns.
Once column mapping is done it moves to next stage 2001 PreProcessFTT. From this function it further calls PreProcessFile. In this, there are some initial validations like, file exist, file size, file name (whether it ends with COB date ) on the source file is done. After file validation it validates the column header and throws exception if any column header is missing. Then it starts reading row by row data from the source file and write to a temporary file in Temp folder (eg: D:\Users\431250\AppData\Local\Temp\1\CMBARCLAYS_HF_SERVICE_STRUCTNTS\I1\FISS_ITT_IIE_ELIGIBLE_ISTR_20140304_0222150020210416-.TXT).

During the data load it uses a post import rule with the name “157#STRUCTNTS_IIE”. This rule will have all the post import enrichment and/or calculations for this trade data. The logic in the post import rule is as per the decision tree within SN tab mentioned in IT Decision tree visio.

Stage 7000 : Reconciling trade counts in system and source file for IIE

In this stage, it compares record count of source file with database (eg: MRTDATAFEED='SN' AND MRTPRODTYP='IIE' AND MRTUNIQUEREF NOT LIKE '%_BCDUP' AND MRTIMPDATE=20140304). If there is mismatch, it throws exception. If there is no exception, then the processed file is moved to archive folder.

Stage 7500 : Marking cacelled flag on amending trades IIE

This stage is for marking cancelled flag on trades being imported into the system wherever applicable based on the TRDFLAG column in the feed file. In case of any error a warning message “Error on stage(7500) STRUCTNTS : Error while cancelling trades” is set and a notification email is triggered to the mail recipients configured in system parameter Att.[SRVSERRNFYEMAIL].

Stage 8000 : Importing Structured Notes FTTISE file

In this stage, data is imported from source file using system parameter File. 157#STRUCTNTS_ISE_SRCFILE (eg: M:\MERITRESEARCH\BARCAP_FTT_UAT_20210108\Data\FISS_ITT_ISE_ELIGIBLE_ISTR_20140304.CSV) into the MRT_HFCLAIMSIT_TRADES table in a standard format. In this stage it calls a job 157#STRUCTNTS_ISE under SERVICE_STRUCTNTS in scheduler tab. This job is called every time a source file is picked. In this job initial column mapping with source file and standard table are done. Some column mappings are done by combining multiple columns.
Once column mapping is done it moves to next stage 2001 PreProcessFTT. From this function it further calls PreProcessFile. In this, there are some initial validations like, file exist, file size, file name (whether it ends with COB date ) on the source file is done. After file validation it validates the column header and throws exception if any column header is missing. Then it starts reading row by row data from the source file and write to a temporary file in Temp folder (eg: D:\Users\431250\AppData\Local\Temp\1\CMBARCLAYS_HF_SERVICE_STRUCTNTS\I1\FISS_ITT_ISE_ELIGIBLE_ISTR_20140304_0222150020210416-.TXT).

During the data load it uses a post import rule with the name “157#STRUCTNTS_ISE”. This rule will have all the post import enrichment and/or calculations for this trade data. The logic in the post import rule is as per the decision tree within SN tab mentioned in IT Decision tree visio.

Stage 9000 : Reconciling trade counts in system and source file for ISE

In this stage, it compares record count of source file with database (eg: MRTDATAFEED='SN' AND MRTPRODTYP='ISE' AND MRTUNIQUEREF NOT LIKE '%_BCDUP' AND MRTIMPDATE=20140304). If there is mismatch, it throws exception. If there is no exception, then the processed file is moved to archive folder.

Stage 9500 : Marking cacelled flag on amending trades ISE

This stage is for marking cancelled flag on trades being imported into the system wherever applicable based on the TRDFLAG column in the feed file. In case of any error a warning message “Error on stage(6000) SLIMP : Error while cancelling trades” is set and a notification email is triggered to the mail recipients configured in system parameter Att.[SRVSERRNFYEMAIL].

Stage 55555: Restart scheduler

System parameters related to the service:

[ZIP_PROC_FILE] – To check whether file needs to be compressed.
[MOVE_PROC_FILE_TO_ARCHIVE] – To validate file needs to be moved to archive

ITHORIZON

Service is responsible for importing data into table MRT_HFCLAIMSIT_TRADES with data feed GM. This is a cycling service (runs the activities one after other and repeats the activities once it reaches the end). The below table summarises the different stages of the service and the main functionalities of the activities.

Daily imp	Stage	Stage desc	Depends on stage	Min time	Give up time
ITHORIZON	100	Housekeeping		800	2300
ITHORIZON	1000	Timelapse start		800	2300
ITHORIZON	5000	Importing ITHORIZON GMI data	1000	800	2300
ITHORIZON	5200	Checking record count in DB GMI	5000	800	2300
ITHORIZON	5500	Marking cacelled flag on amending trades GMI	5200	800	2300
ITHORIZON	55555	Restart scheduler	5500	800	2300

Stage 100 : Housekeeping

Stage 5000 : Importing ITHORIZON GMI data

In this stage, data is imported from source file using system parameter File.[157#FUTURESIT_HOR_SRCFILE] (eg: M:\MERITRESEARCH\BARCAP_FTT_UAT_20210108\Data\ODH_ACTIVITY_GMI_IFTT_USA_EMEA_20170914.TXT) into the MRT_HFCLAIMSIT_TRADES table in a standard format. In this stage it calls a job 157#FUTURESIT_GMI under SERVICE_ITHORIZON in scheduler tab. This job is called every time a source file is picked. In this job initial column mapping with source file and standard table are done. Some column mappings are done by combining multiple columns.
Once column mapping is done it moves to next stage 5001 PreProcessGMIFile. From this function it further calls PreProcessFile method. In this, there are some initial validations like, file exist, file size, file name (whether it ends with COB date ) on the source file is done. After file validation it validates the column header and throws exception if any column header is missing. Then it starts reading row by row data from the source file and write to a temporary file in Temp folder (eg: D:\Users\431250\AppData\Local\Temp\1\CMBARCLAYS_HF_SERVICE_ITHORIZON\I1\FUT_HOR_GMI_20170914.TXT).

During the data load it uses a post import rule with the name “157#FUTURESIT_GMI”. This rule will have all the post import enrichment and/or calculations for this trade data. The logic in the post import rule is as per the decision tree within SN tab mentioned in IT Decision tree visio. The data is saved into table MRT_HFCLAIMIT_TRADES.

Stage 5200 : Checking record count in DB GMI

In this stage, it call a method CheckRecordCountGMI in which it compares record count of source file with database (eg: MRTDATAFEED='GM' AND MRTORIGIN LIKE 'GMI%' AND MRTIMPDATE=20170914). If there is mismatch, it throws exception. If there is no exception, then the processed file is moved to archive folder.

Stage 5500 : Marking cacelled flag on amending trades GMI

This stage is for marking cancelled flag on trades being imported into the system wherever applicable based on the TRDFLAG column in the feed file. In case of any error a warning message “Error on stage(5500) SLIMP : Error while cancelling trades” is set and a notification email is triggered to the mail recipients configured in system parameter Att.[SRVSERRNFYEMAIL].

Stage 55555: Restart scheduler

[SVC_WAIT_FORFILE_TIME] – This is waiting for system before starting processing source file
[157#FUTURESIT_HOR_SRCFILE] – path of the source file where data needs to be processed

ALTRADES

Service is responsible for importing data into table MRT_HFCLAIMS_TRADES, MRT_HFCLAIMSIT_TRADES, MRT_HFCLAIMSES_TRADES with data feed AL. This is a cycling service (runs the activities one after other and repeats the activities once it reaches the end). The below table summarises the different stages of the service and the main functionalities of the activities.

Daily imp	Stage	Stage desc	Depends on stage	Min time	Give up time
ALTRADES	100	Housekeeping		800	2300
ALTRADES	1000	Timelapse start		800	2300
ALTRADES	1500	Agency Lending import for TRADES	1000	800	2300
ALTRADES	2000	Post process TRADES AL file	1500	800	2300
ALTRADES	2500	Agency Lending Data import job to IT_TRADES	2000	800	2300
ALTRADES	3000	Post process IT_TRADES AL file	2500	800	2300
ALTRADES	3500	Agency Lending data import job to ES_TRADES	3000	800	2300
ALTRADES	4000	Post process ES_TRADES AL file	3500	800	2300
ALTRADES	55555	Restart scheduler	5500	800	2300

Stage 100 : Housekeeping

Stage 1500 : Agency Lending import for TRADES

In this stage, data is imported from source file using system parameter File.[143#ALIMP_SRCFILE] (eg: M:\MERITRESEARCH\BARCAP_FTT_UAT_20210108\Data\Agency Lending FR FTT Report_20170208.csv) into the MRT_HFCLAIMS_TRADES table in a standard format. In this stage it calls a job 143#ALIMP under SERVICE_ALTRADES in scheduler tab. This job is called every time a source file is picked. In this job initial column mapping with source file and standard table are done. Some column mappings are done by combining multiple columns.
Once column mapping is done it moves to next stage 1200 PreProcess_AL_File. In this, there are some initial validations like, file exist, file size, file name (whether it ends with COB date ) on the source file is done. After file validation it validates the column header and throws exception if any column header is missing. Then it starts reading row by row data from the source file and write to a temporary file in Temp folder (eg: D:\Users\431250\AppData\Local\Temp\1\CMBARCLAYS_HF_SERVICE_ALTRADES\I1\ AL_2017020820210430-.TXT).

During the data load it uses a post import rule with the name “143#ALIMP”. This rule will have all the post import enrichment and/or calculations for this trade data. The logic in the post import rule is as per the decision tree within SN tab mentioned in IT Decision tree visio. The data is saved into table MRT_HFCLAIM_TRADES.

Stage 2000 : Post process TRADES AL file

In this stage, the processed files are moved to archive folder. If it not able to move the file then it will throw exception.

Stage 2500 : Agency Lending import for IT_TRADES

In this stage, data is imported from source file using system parameter File.[157#IT_ALIMP_SRCFILE] (eg: M:\MERITRESEARCH\BARCAP_FTT_UAT_20210108\Data\ Agency Lending IT FTT Report_20170208.csv) into the MRT_HFCLAIMSIT_TRADES table in a standard format. In this stage it calls a job 157#IT_ALIMP under SERVICE_ALTRADES in scheduler tab. This job is called every time a source file is picked. In this job initial column mapping with source file and standard table are done. Some column mappings are done by combining multiple columns.
Once column mapping is done it moves to next stage 2200 PreProcess_IT_AL_File. In this, there are some initial validations like, file exist, file size, file name (whether it ends with COB date ) on the source file is done. After file validation it validates the column header and throws exception if any column header is missing. Then it starts reading row by row data from the source file and write to a temporary file in Temp folder (eg: D:\Users\431250\AppData\Local\Temp\1\CMBARCLAYS_HF_SERVICE_ALTRADES\I1\ IT_AL_2017020820210430-.TXT).

During the data load it uses a post import rule with the name “157#IT_ALIMP”. This rule will have all the post import enrichment and/or calculations for this trade data. The logic in the post import rule is as per the decision tree within SN tab mentioned in IT Decision tree visio. The data is saved into table MRT_HFCLAIMIT_TRADES.

Stage 3000 : Post process TRADES AL file

In this stage, the processed files are moved to archive folder. If it not able to move the file then it will throw exception.

Stage 3500 : Agency Lending import for ES_TRADES

In this stage, data is imported from source file using system parameter File.[2#ES_ALIMP_SRCFILE] (eg: M:\MERITRESEARCH\BARCAP_FTT_UAT_20210108\Data\Agency Lending ES FTT Report_20170208.csv) into the MRT_HFCLAIMSES_TRADES table in a standard format. In this stage it calls a job 2#ES_TRADES_ALIMPORT under SERVICE_ALTRADES in scheduler tab. This job is called every time a source file is picked. In this job initial column mapping with source file and standard table are done. Some column mappings are done by combining multiple columns.
Once column mapping is done it moves to next stage 3200 PreProcess_ES_AL_File. In this, there are some initial validations like, file exist, file size, file name (whether it ends with COB date ) on the source file is done. After file validation it validates the column header and throws exception if any column header is missing. Then it starts reading row by row data from the source file and write to a temporary file in Temp folder (eg: D:\Users\431250\AppData\Local\Temp\1\CMBARCLAYS_HF_SERVICE_ALTRADES\I1\ ES_AL_2017020820210430-.TXT).

During the data load it uses a post import rule with the name “2#ES_TRADES_ALIMPORT”. This rule will have all the post import enrichment and/or calculations for this trade data. The logic in the post import rule is as per the decision tree within SN tab mentioned in IT Decision tree visio. The data is saved into table MRT_HFCLAIMES_TRADES.

Stage 4000 : Post process TRADES AL file

In this stage, the processed files are moved to archive folder. If it not able to move the file then it will throw exception.

Stage 55555: Restart scheduler

[143#ALIMP_SRCFILE], File.[157#IT_ALIMP_SRCFILE], File.[2#ES_ALIMP_SRCFILE] – path of the source file where data needs to be processed
[MOVE_PROC_FILE_TO_ARCHIVE] – To validate whether processed files ace be moved to archive.

SENDEMAILS

Service is responsible for sending email into corresponding email id. The below table summarises the different stages of the service and the main functionalities of the activities.

Daily imp	Stage	Stage desc	Depends on stage	Min time	Give up time
SENDEMAILS	100	Housekeeping		105	2300
SENDEMAILS	1000	Timelapse start		105	2300
SENDEMAILS	2000	Send emails	1000	105	2300
SENDEMAILS	55555	Restart scheduler	2000	105	2300

Stage 100 : Housekeeping

Stage 2000 : Send emails

In this stage, it calls standard file z_std_inccm_sendmails\servicecustom_script.txt. Here it calls function SendEmails. This function first deletes all the attachments files from temp folder that were used in previous mail and calls another function SendClaimEmailsExt1. This function is in file z_std_inccm_sendmails\z_std_inccm_SendEmailFromOGEM.txt. Inside this function it takes Val from table MRT_HFCLAIMSSYSDAT based on condition (MRTTYPE='EMAIL') AND (MRTNAME='OGEM_CONTROL'). After validating Val value mail will be send.

Stage 55555: Restart scheduler

ADPIMPES

Service is responsible for importing Spanish trade data to the system from ADP data feed. This also involves FX rate import which is fed along with the trade data as a separate daily file. The trade data gets saved to MRT_HFCLAIMSES_TRADES and fx rates are saved to MRT_HFCLAIMSFXRATES. This is a cycling service (runs the activities one after other and repeats the activities once it reaches the end). The below table summarises the different stages of the service and the main functionalities of the activities:

Daily imp	Stage	Stage desc	Depends on stage	Min time	Give up time
ADPIMPES	100	Housekeeping		0800	2300
ADPIMPES	1000	Timelapse start		0800	2300
ADPIMPES	12000	Data import job to FXRATES	1000	0800	2300
ADPIMPES	16000	Data import job to ADPIMPES	12000	0800	2300
ADPIMPES	17000	Marking cancelled flag on amending trades	16000	0800	2300
ADPIMPES	18000	Move processed files	17000	0800	2300
ADPIMPES	55555	Restart scheduler	18000	0800	2300

Daily imp : Service identifier.
Stage : Service activity stage number. Starts from smaller to larger.
Stage desc : Brief description of the activity.
Depends on stage : If a number present the activity will run only after the dependant stage is successfully executed.
Min time : Minimum time in GMT when the activity will be running daily.
Give up time : Last time of the day the activity can be executed. If the activity is started and not finished it will run until it is finished.

Stage 100 : Housekeeping

Deletes files created temporarily during the import or older LOGS. The stage number must be below 1000. For the full list refer to the servicecustom_ADPIMPES.txt service file

Stage 1000 : Timelapse start

Stage 12000 : Data import job to FXRATES

This stage reads and validates the input fx rate file to save the fx rates fed into MRT_HFCLAIMSFXRATES table . This stage calls a custom stage 12001 which implements the method PreProcessFXRateFile where it deletes all txt files of the form ADPIMPES_FXRATES*.TXT from %TEMP% folder. It then gets the source file from File.[ADPIMPES_FXRATE_SRCFILE] (eg: M:\REGRESSIONTEST\BARCAP\FTT\ADPIMPES\20201009\ 20201009_es_newfile.dat), validates its name and opens the file. Creates a new file %TEMP% ADPIMPES_FXRATES_"& DateT & "_" & timestamp,".TXT" (for eg : D:\Users\388802\AppData\Local\Temp\1\CMBARCLAYS_HF_SERVICE_ADPIMPES\I1\ES_ADPIMP_FXRATES_20201210_1420580020210409-.TXT) and copies the processed content to this file (Note : This is the file configured in system parameter Att.[ADPIMPES_FXRATE_IMPFILE] which is given as the preprocess source file in the scheduler)

Stage 16000 : Data import job to ADPIMPES

As the FX rates are processed in the previous stage, this stage moves the processed FX rate file to Archive folder.

This stage reads and validates the import file and create an intermediate file which is then used for further processing. The processed trade data gets saved to MRT_HFCLAIMSES_TRADES table. This stage calls a custom method called PreProcessADPIMP where it gets the source file from File.[2#ADPIMPES_SRCFILE] (eg : M:\REGRESSIONTEST\BARCAP\FTT\ADPIMPES\20201009\ EST_extract_20201009.txt), validates its name and opens the file. After reading the header content, it creates new header (for eg : "|CMPY|CPTY|CPTY_Name|INST|INST_NAME). It expects 25 column names in it. After validating the same it processes whole data, deletes blank rows. It then deletes all txt files that starts with FTT_* from %TEMP% folder. Creates a new file %TEMP%ES_ADPIMP_" DateT & "_" & timestamp".TXT" (for eg : D:\Users\388802\AppData\Local\Temp\1\CMBARCLAYS_HF_SERVICE_ADPIMPES\I1\ES_ADPIMP_20201210_1423440020210409-.TXT) and copies the processed content to this file (Note : This is the file configured in system parameter Att.[2#ADPIMPES_IMPFILE] which is given as the pre-process source file in the scheduler)

During the data load it uses a post import rule with the name “2#ES_TRADES_ADPIMPORT”. This rule will have all the post import enrichment and/or calculations for this trade data. Within this rule, it further imports data to CARDS, DECLARATIONS table which constitutes the invoice and declarations.

Stage 17000 : Marking cancelled flag on amending trades

This stage is for marking cancelled flag on trades being imported into the system wherever applicable based on the TRDFLAG column in the feed file. In case of any error a warning message “Error on stage(17000) ADPIMPES : Error while cancelling trades” is set and a notification email is triggered to the mail recipients configured in system parameter Att.[SRVSERRNFYEMAIL].

Stage 18000 : Move processed files

In this stage, the processed trade file is moved to ARCHIVE folder. In case of any error, a warning message “Error on stage (18000) ADPIMPES : Error while moving processed file to ARCHIEVE” is set and a notification email is triggered to the mail recipients configured in system parameter Att.[SRVSERRNFYEMAIL].

Stage 55555 : Restart scheduler

ADPIMPIT

Daily imp	Stage	Stage desc	Depends on stage	Min time	Give up time
ADPIMPIT	100	Housekeeping		0800	2300
ADPIMPIT	1000	Timelapse start		0800	2300
ADPIMPIT	4000	Import FX Rates	1000	0800	2300
ADPIMPIT	4500	Reval charge category for items where CCY is not EUR	4000	0800	2300
ADPIMPIT	5000	Data import Job to Italy ADP	4000	0800
ADPIMPIT	6000	Marking cancelled flag on Amending Trades	5000	0800	2300
ADPIMPIT	7000	Moving processed file	6000	0800	0800
ADPIMPIT	55555	Restart scheduler	7000	0800	2300

Stage 100 : Housekeeping

Stage 4000: Import FX Rates

This Stage looks for the FX Rate Source file at File.[ITADPIMP_FXRATE_SRCFILE] (eg: M:\REGRESSIONTEST\BARCAP\FTT\ADPIMPIT\20201009\<COBDATE>_it_newfile.dat)and fetch the file to initiate a Preprocess FXRate activity where it validates the headers and Data lines and then writes it to a temporary file and places at Att.[ITADPIMP_FXRATE_IMPFILE].Once the Temp File is created, a scheduler Job 122#IT_FXRATEIMP picks the file from the temporary path and does the column mapping of the temporary file to the Database fields.

Calculated Fields

There are the calculated fields which are created based on the data in the temp file. “Key” Value is generated using the CCY and COB Date fields in the Temp file. “Closed Field” is identified based on the ACT_TYPE whether its XPR or XPL.

After the Field mapping is loaded, the system runs the POST IMPORT Rule 122#IT_FXRATEIMP which is a Decision Tree. Inside the Tree the EURO FX Rates is Set.

Stage 4500: Reval charge category for items where CCY is not EUR

Logic is defined inside the Rule #157RECALC_CHARGECAT where the CCY is checked for EUR and if currency is not EUR , then Charge Applied is calculated accordingly based on the FX value calculated.

Stage 5000: Data Import Job to Italy ADP

Import Stage looks for the Source file at 157#ADPIMPIT_SRCFILE and fetch the file to initiate a Pre-process activity. The pre-process file Checks for the FX rate source file and moves the file to Archive. After that, based on the setting of the Attribute:Att.[CREATE_ADP_BLANKFILE]System Parameter a blank file is generated with the predefine header format, The file is named same as the 157#ADPIMPIT_SRCFILE , but attached by a COB date along with.

Input file is then validated for Header column count which should be 25 and later on checked for Column validations of the VALUE_DT,TRADE_DT,ENTRY_DATE,TRADE_TAG,COBDATE

It again validates all the Date formats. After Validation a temporary file is generated and placed at the Path mentioned in Att.[157#ADPIMPIT_IMPFILE].Once the Temp File is created, a scheduler Job 157#ADPIMPIT picks the file from the temporary path and does the column mapping of the temporary file to the Database fields.

Calculated Fields

There are the calculated fields which are created based on the data in the temp file. “Key” Value is generated using the unique ref and COB Date fields in the Temp file. “Closed Field” is identified based on the TRADE_STATUS. “Nominal” is calculated from NOM_QTY field. “BUY/SELL” is identified based on the “PURC_SALE_IND” field. Entity and Company is decided based on CMPY field. Temp1 column in the Database is mapped to Price column in the Temp file.

After the Field mapping is loaded the system runs the POST IMPORT Rule 157#ADPIMPIT which is a Decision Tree. <<Visio to be embedded>>

Stage 6000: Marking cancelled flag on Amending Trades

Stage 7000: Moving processed file

This stage moves the files once processed. It first checks if the destination archive directory exists and if it exists moves the file to the archive. While moving it checks whether the ZIP flag is set to true and if yes, then its compress the file and archives.

Stage 55555: Restart scheduler

[SVC_WAIT_FORFILE_TIME] – This is waiting for system before starting processing source file
[DWIMP_SRCFILE] – path of the source file where data needs to be processed
[SVC_DWIMP_IMP_RUNMODE] – To check for the run mode whether it is regression or not
[ ZIP_PROC_FILE] – Attribute to check whether file needs to be compressed or not
[MOVE_PROC_FILE_TO_ARCHIVE] – To check whether files need to be moved to archive folder or not

SYNTHIT

Service is responsible for importing French trade data to the system from Synthetics Sswap, Synthetics CFD and Synthetics Pswap data feeds. The trade data gets saved to MRT_HFCLAIMSIT_TRADES table. This is a cycling service (runs the activities one after other and repeats the activities once it reaches the end). The below table summarizes the different stages of the service and the main functionalities of the activities:

Daily imp	Stage	Stage desc	Depends on stage	Min time	Give up time
SYNTHIT	100	Housekeeping		100	800
SYNTHIT	1,000	Timelapse start		100	800
SYNTHIT	4,000	Data import job to Synthetic CFD	1000	100	800
SYNTHIT	5,000	Data import job to Synthetic PSwaps	4000	100	800
SYNTHIT	6,000	Data import job to Synthetic SSwaps	5000	100	800
SYNTHIT	55555	Restart scheduler	6000	100	800

Daily imp : Service identifier.
Stage : Service activity stage number. Starts from smaller to larger.
Stage desc : Brief description of the activity.
Depends on stage : If a number present the activity will run only after the dependant stage is successfully executed.
Min time : Minimum time in GMT when the activity will be running daily.
Give up time : Last time of the day the activity can be executed. If the activity is started and not finished it will run until it is finished.

Stage 100 : Housekeeping

Deletes files created temporarily during the import or older LOGS. The stage number must be below 1000. For the full list refer to the servicecustom_TRADESIMP.txt service file

Stage 1000 : Timelapse start

Stage 4000 : Data import job to Synthetic CFD

This stage reads and validates the import file from CFD datafeed and create an intermediate file which is then used for further processing. This stage calls a custom method called Preprocess_CFD where it gets the source file from File.[157#SYNTHIT_SRCFILE], eg. M:\REGRESSIONTEST\BARCAP\FTT\SYNTHIT\20140331\ IFTT_CFD_DERIVATIVES_20140331_20140401.csv, validates its name and opens the file. After reading the header content, it creates new header (for eg : "Legal Fund SDS,Sub Account SDS Id,Account Number etc). After validating the same it processes whole data, deletes blank rows. It then deletes all txt files that starts with SYNTH_CFD_ * from %TEMP% folder. Creates a new file %TEMP%SYNTH_CFD_ "&COBDATE,".TXT", (eg : D:\Users\388802\AppData\Local\Temp\1\CMBARCLAYS_HF_SERVICE_SYNTHIT\I1\SYNTH_CFD_2014033120210421-.TXT) and copies the processed content to this file (Note : This is the file configured in system parameter Att.[157#SYNTHIT_IMPFILE] which is given as the preprocess source file in the scheduler)

During the data load it uses a post import rule with the name “157#SYNTHIT”. This rule will have all the post import enrichment and/or calculations for this trade data. Within this rule, it further imports data to CARDS, DECLARATIONS table which constitutes the invoice and declarations. The logic in the post import rule is as per the decision tree within ‘Synthetics CFD SS’ tab mentioned in IT Decision tree visio. The trades get saved in to MRT_HFCLAIMSIT_TRADES.

Stage 5000 : Data import job to Synthetic PSwaps

This stage reads and validates the import file from PS datafeed and create an intermediate file which is then used for further processing. This stage calls a custom method called Preprocess_PSWAPS where it gets the source file from File.[157#SYNTHIT_PS_SRCFILE], eg. M:\REGRESSIONTEST\BARCAP\FTT\SYNTHIT\20140331\ IFTT_PSWAP_DERIVATIVES_20140331_20140401.csv, validates its name and opens the file. After reading the header content, it creates new header (for eg : "Legal Fund SDS,Sub Account SDS Id,Account Number etc). After validating the same it processes whole data, deletes blank rows. It then deletes all txt files that starts with SYNTH_PSWAPS_*.TXT from %TEMP% folder. Creates a new file %TEMP%SYNTH_PSWAPS_"&COBDATE,".TXT", (eg : D:\Users\388802\AppData\Local\Temp\1\CMBARCLAYS_HF_SERVICE_SYNTHIT\I1\SYNTH_PSWAPS_2014033120210421-.TXT) and copies the processed content to this file (Note : This is the file configured in system parameter Att.[157#SYNTHIT_PS_IMPFILE] which is given as the preprocess source file in the scheduler)

During the data load it uses a post import rule with the name “157#SYNTHIT_PS”. This rule will have all the post import enrichment and/or calculations for this trade data. Within this rule, it further imports data to CARDS, DECLARATIONS table which constitutes the invoice and declarations. The logic in the post import rule is as per the decision tree within ‘Synthetics PSWAP’ tab mentioned in IT Decision tree visio. The trades get saved in to MRT_HFCLAIMSIT_TRADES.

Stage 6000 : Data import job to Synthetic SSwaps

This stage reads and validates the import file from SS datafeed and create an intermediate file which is then used for further processing. This stage calls a custom method called Preprocess_SSWAPS where it gets the source file from File.[157#SYNTHIT_SS_SRCFILE], eg. M:\REGRESSIONTEST\BARCAP\FTT\SYNTHIT\20140331\ IFTT_SSS_DERIVATIVES_20140331_20140401.csv, validates its name and opens the file. After reading the header content, it creates new header (for eg : "Legal Fund SDS,Sub Account SDS Id,Account Number etc). After validating the same it processes whole data, deletes blank rows. It then deletes all txt files that starts with SYNTH_SSWAPS_*.TXT from %TEMP% folder. Creates a new file %TEMP% SYNTH_SSWAPS_"&COBDATE,".TXT", (eg : D:\Users\388802\AppData\Local\Temp\1\CMBARCLAYS_HF_SERVICE_SYNTHIT\I1\SYNTH_SSWAPS_2014033120210421-.TXT) and copies the processed content to this file (Note : This is the file configured in system parameter Att.[157#SYNTHIT_SS_IMPFILE] which is given as the preprocess source file in the scheduler)

During the data load it uses a post import rule with the name “157#SYNTHIT_SS”. This rule will have all the post import enrichment and/or calculations for this trade data. Within this rule, it further imports data to CARDS, DECLARATIONS table which constitutes the invoice and declarations. The logic in the post import rule is as per the decision tree within ‘Synthetics PSWAP’ tab mentioned in IT Decision tree visio. The trades get saved in to MRT_HFCLAIMSIT_TRADES.

Stage 55555 : Restart scheduler

System parameters related to the service:

[Sender Email] – Sender visible in the incoming emails
[SRVSERRNFYEMAIL] – email address where error notifications will be send
[Email Server Params] – server parameters of the outbox used by services
[EMAIL_PWD] – encrypted password for mailbox saved in Att.[Email Server Params]
[IMPJOBSPLIT_ SYNTHIT]– number of sub-processes started by the service during data processing
[157#SYNTHIT_SRCFILE] – source file which is fed to the system
[157#SYNTHIT_IMPFILE] – file which is given as the pre-process source file in the scheduler
[157#SYNTHIT_PS_SRCFILE] – source file which is fed to the system
[157#SYNTHIT_PS_IMPFILE] – file which is given as the pre-process source file in the scheduler
[157#SYNTHIT_SS_SRCFILE] – source file which is fed to the system
[157#SYNTHIT_SS_IMPFILE] – file which is given as the pre-process source file in the scheduler

BACKPOP

This Service is responsible for back population processes. The back populations are triggered when users update static. Instead of updating the trades one by one, we use static data to hold the values and link/back populate the trades if any records are updated on static data. The process will get all the affected items based on the table linkage. It will then populate the affected items with the new static. If there are any recalculations required because of the back population, these rules also invoked as post back population import rules, part of the back population process. This is a cycling service runs throughout the day.

Daily imp	Stage	Stage desc	Depends on stage	Min time	Give up time
BACKPOP	100	Housekeeping		0100	2300
BACKPOP	1000	Timelapse start		0100	2300
BACKPOP	2000	Back population	1000	0100	2300
BACKPOP	55555	Restart scheduler	2000	0100	2300

Daily imp : Service identifier.
Stage : Service activity stage number. Starts from smaller to larger.
Stage desc : Brief description of the activity.
Depends on stage : If a number present the activity will run only after the dependant stage is successfully executed.
Min time : Minimum time in GMT when the activity will be running daily.
Give up time : Last time of the day the activity can be executed. If the activity is started and not finished it will run until it is finished.

Stage 100 : Housekeeping

Deletes files created temporarily during the import or older LOGS. The stage number must be below 1000. For the full list refer to the servicecustom_BACKPOP.txt service file

Stage 1000 : Timelapse start

This is a standard job assigned to all services. This job is used as the starting point of the activities. One batch runs until it reaches stage 55555. This is the end of activities. The other activities are assigned stage numbers based on the priority.

Stage 2000 : back population
Whenever user or service updates static data in one of the source tables entry in the MRT_HFCLAIMSUPDPND is created. Every record specific for back population starts from “BP” followed by the code specific for every type and key of the item. Service is constantly cycling throughout the day monitoring MRT_HFCLAIMSUPDPND table for new back population requests.
The back-population rules executed by this service activity are as shown below in the table.

The detailed relationship between these rules, their underlying tables and the relationship / link for the back population can be found in SETUPàTable linkage option. The relationship or rule name should follow a naming convention like below

<From tableID#><To suffix>[-BACKPOP]

Rule name	Destination table	Filter	Source table	Filter
88#PAYMENT-BACKPOPBottom of Form	CARDS	[+]Open items	PAYMENT	[+]Open items
139#CONTACTS-BACKPOP	DECLARATIONS		CONTACTS	[+]Open items,[+]Claim dept Declaration
143#BOOKS-BACKPOP	TRADES		BOOKS	[+]Open items,[+]Tax authority FR
143#CLICAT-BACKPOP	TRADES	[+]Data feed FS	CLICAT	[+]Open items,[+]Tax authority FR,[+]Feed EQ
88#CONTACT-BACKPOP	CARDS	[+]Open items	CONTACTS	[+]Open items
143#ADPBARCACC-BACKPOP	TRADES	[+]Open items,[+]Data feed AP	ADPBARCACC	[+]Open items,[+]Tax authority FR
143#BLOTTERDESC-BACKPOP	TRADES	[+]Open items,[+]Data feed AP	BLOTTERDESC	[+]Open items
144#CLICAT-BACKPOP	TRADESREC	[+]Open items	CLICAT	[+]Open items
157#CLICAT_EQ-BACKPOP	IT_TRADES	[+]Data feed FS,G1,GO,AL	CLICAT	[+]Open items,[+]Tax authority IT,[+]Feed EQ
143#TAXAUTHRATES-BACKPOP	TRADES	[+]Inv key NA	TAXAUTHRATES	[+]Open items
157#TAXAUTHRATES-BACKPOP	IT_TRADES	[+]Inv key NA	TAXAUTHRATES	[+]Open items
157#MICTORATE-BACKPOP	IT_TRADES	[+]Data feed DW,FS	MICTORATE	[+]Open items
143#SETTODEPOT-BACKPOP	TRADES	[+]Open items,[+]Data feed DW	SETTODEPOT	[+]Open items
143#CTYABBREV-BACKPOP	TRADES	[+]Open items,[+]Data feed FS	CTYABBREV	[+]Open items
157#CTYABBREV-BACKPOP	IT_TRADES	[+]Open items,[+]Data feed FS,SN	CTYABBREV	[+]Open items
157#SETTODEPOT-BACKPOP	IT_TRADES	[+]Open items,[+]Data feed DW	SETTODEPOT	[+]Open items
157#BOOKS-BACKPOP	IT_TRADES		BOOKS	[+]Open items,[+]Tax authority IT
157#ADPBARCACC-BACKPOP	IT_TRADES	[+]Open items,[+]Data feed AP	ADPBARCACC	[+]Open items,[+]Tax authority IT
157#BLOTTERDESC-BACKPOP	IT_TRADES	[+]Open items,[+]Data feed AP	BLOTTERDESC	[+]Open items
157#BROKERSDS-BACKPOP	IT_TRADES	[+]Open items,[+]Data feed DW	BROKERSDS	[+]Open items
157#CLICAT_DR-BACKPOP	IT_TRADES	[+]Open items,[+]Data feed CF,PS,SS,FT,SN,GM	CLICAT	[+]Open items,[+]Tax authority IT,[+]Feed DR
157#LEDGER-BACKPOP	IT_TRADES	[+]Open items,[+]Data feed FT,GM	LEDGER	[+]Open items
143#CMPY2ENTITY-BACKPOP	TRADES	[+]Data feed FS	CMPY2ENTITY	[+]Open items
157#CMPY2ENTITY-BACKPOP	IT_TRADES	[+]Data feed FS,SN	CMPY2ENTITY	[+]Open items
157#HEDGE12BPS-BACKPOP	IT_TRADES	[+]Data feed CF,PS,SS	HEDGE12BPS	[+]Open items
157#ACC2SDS-BACKPOP	IT_TRADES	[+]Open items,[+]Data feed G1	ACC2SDS	[+]Open items
143#ACC2SDS-BACKPOP	TRADES	[+]Open items,[+]Data feed FS	ACC2SDS	[+]Open items
2#BOOKS-BACKPOP	ES_TRADES		BOOKS	[+]Open items,[+]Tax authority ES
2#CLICAT-BACKPOP	ES_TRADES	[+]Data feed FS	CLICAT	[+]Open items,[+]Tax authority ES,[+]Feed EQ
2#ADPBARCACC-BACKPOP	ES_TRADES	[+]Open items,[+]Data feed AP	ADPBARCACC	[+]Open items,[+]Tax authority ES
2#BLOTTERDESC-BACKPOP	ES_TRADES	[+]Open items,[+]Data feed AP	BLOTTERDESC	[+]Open items
2#TAXAUTHRATES-BACKPOP	ES_TRADES	[+]Inv key NA	TAXAUTHRATES	[+]Open items
2#SETTODEPOT-BACKPOP	ES_TRADES	[+]Open items,[+]Data feed DW	SETTODEPOT	[+]Open items
2#CTYABBREV-BACKPOP	ES_TRADES	[+]Open items,[+]Data feed FS	CTYABBREV	[+]Open items
2#CMPY2ENTITY-BACKPOP	ES_TRADES	[+]Data feed FS	CMPY2ENTITY	[+]Open items
2#ACC2SDS-BACKPOP	ES_TRADES	[+]Open items,[+]Data feed FS,G1	ACC2SDS	[+]Open items Bottom of Form

Stage 55555 : Restart scheduler

System parameters related to the service:

Att.[IMPJOBSPLIT_BACKPOP] – number of sub-processes started by the service during data processing
Att.[SRVSERRNFYEMAIL] – email address where error notifications will be send
Att.[Email Server Params] – server parameters of the outbox used by services

INVCALC

Service is constantly cycling throughout the day monitoring MRT_SNCLAIMSUPDPND table for new tasks. List of jobs performed by the service:

Daily imp	Stage	Stage desc	Depends on stage	Min time local	Give up time
INVCALC	100	Housekeeping		0040	2300
INVCALC	1,000	Timelapse Start		0040	2300
INVCALC	3,000	Import Invoices	1000	0040	2300
INVCALC	4,000	Import Declaraions	1000	0040	2300
INVCALC	5,000	Cards Recalc	1000	0040	2300
INVCALC	6,000	Declaration Recalc	1000	0040	2300
INVCALC	6,200	Update declaration amount on TRADES/IT_TRADES/ES_TRADES	1000	0040	2300
INVCALC	6,490	Desk Invoice Creation Trigger	1000	0040	2300
INVCALC	6,500	Data import job to DESK_ALLOC	1000	0040	2300
INVCALC	6,600	Data import job to Update Italy Trade for which period released	1000	0040	2300
INVCALC	6,700	Clear UPDPND after processing the Italy Re-Evaluation	6600	0040	2300
INVCALC	6,800	Data import job to Update French Trade for which period released	1000	0800	2300
INVCALC	6,900	Clear UPDPND after processing the French Re-Evaluation	6800	0040	2300
INVCALC	7,000	Data import job to Update Spain Trade for which period released	1000	0800	2300
INVCALC	7,100	Clear UPDPND after processing the Spain Re-Evaluation	7000	0040	2300
INVCALC	55,555	Restart schedule	6000	0040	2300

Daily imp : Service identifier.
Stage : Service activity stage number. Starts from smaller to larger.
Stage desc : Brief description of the activity.
Depends on stage : If a number present the activity will run only after the dependant stage is successfully executed.
Min time : Minimum time in GMT when the activity will be running daily.
Give up time : Last time of the day the activity can be executed. If the activity is started and not finished it will run until it is finished.

Stage 100 : Housekeeping

Stage 3000 : Import Invoices

This activity is an import activity. This is used to import invoices into the MRT_HFCLAIMSCARDS table into a standard format. The invoice data is loaded whenever trades are imported into the system. During the data load, it checks for the rule name “ImportRule_CARDS” which is mapped to ‘88#CARDSIMPORT’ within this stage in Daily Import Scheme. The rule 88#CARDSIMPORT will have all the post import enrichment and/or calculations for this invoice data. The data is then saved in to MRT_ HFCLAIMSCARDS table.

Stage 4000 : Import Declarations

This activity is an import activity. This is used to import declarations into the MRT_HFCLAIMS DECLARATIONS table into a standard format. The delcaration data is loaded whenever trades are imported into the system. During the data load, it checks for the rule name “ImportRule_DECLARATIONS” which is mapped to ‘139#DECLARATIONSIMPORT’ within this stage in Daily Import Scheme. The rule 139#DECLARATIONSIMPORT will have all the post import enrichment and/or calculations for this invoice data. The data is then saved in to MRT_ HFCLAIMSDECLARATIONS table.

Stage 5000 : Cards Recalc

This stage is used to recalculate invoices whenever the invoice attributes are modified. If there is a trigger available, it will start with the prefix “CF” on the UPDPND table. These triggers are for recalculating invoice agreements and / or creating if these invoice agreements are not present.

Prefix of the cards agreement trigger : *CF (This prefix is used to identify the triggers to be processed)
Linking field name : INVKEY
Import table suffix : CARDS
Import rule : [CRDRECALC] (The rule which needs to be executed after item is recalculated)

Once the recalc is done, the entry from UPDPND table is cleared.

Stage 6000 : Declaration Recalc

This stage is used to reevaluate the declaration whenever the trade attributes are modified. It first checks whether there was any error creating the records in the previous run and if ‘recovery’ is ‘true’ it updates the declaration amounts by running 143#TRADES_UPDATE_DECLAMNT, 157#IT_TRADES_UPDATE_DECLAMNT, and 2#TRADES_UPDATE_DECLAMNT jobs. If there is a trigger available, it will start with the prefix “DF” on the UPDPND table. These triggers are for recalculating invoice agreements and / or creating if these invoice agreements are not present.

Prefix of the cards agreement trigger : *DF (This prefix is used to identify the triggers to be processed)
Linking field name : DECL_KEY
Import table suffix : DECLARATIONS
Import rule : [DECLRECALC] (The rule which needs to be executed after item is recalculated)

Once the recalc is done, the entry from UPDPND table is cleared.

Stage 6200 : Update declaration amount on TRADES/IT_TRADES/ES_TRADES

This stage processes EXP records created during recalc to update Declaration amount. It calls the jobs 143#TRADES_UPDATE_DECLAMNT, 157#IT_TRADES_UPDATE_DECLAMNT, and 2#TRADES_UPDATE_DECLAMNT to update the amount which corresponds to French, Italian and Spanish declarations.

Stage 6490 : Desk Invoice Creation Trigger

This stage triggers creation of UPDPND records for creation of desk invoices. Desk invoices are created for DW datafeed. For Desk invoice creation, it first checks for max period entry(eg : 201307) in MRT_HFCLAIMSDECLARATIONS table for corresponding tax authority. Then it assigns that period as period 1 and assigns the previous month as period 2 (eg: 201306 in this case). It then retrieves the declarations for which desk invoices needs to be created by doing a lookup into the declarations table where datafeed is DW and MRTPRD falls between period 1 and period 2. It then creates an entry into the MRT_HFCLAIMSUPDPND table with MRT_CARDKEY appended as ‘DESKINV~’ for each of the records eligible for desk invoice creation.

Stage 6500 : Data import job to DESK_ALLOC

This stage imports Desk invoices being created in MRT_HFCLAIMSUPDPND table from the previous stage into table MRT_HFCLAIMSDESK_ALLOC. It calls the scheduler job ‘204#DESK_ALLOCIMP’ to import the data. There is a preprocess file called Preprocess_DeskAllocInv.txt which prepares the desk invoices to be imported by reading them from UPDPND table. It also creates the net report which needs to be saved. During this stage, Desk invoices are marked for recalculation
so that amounts will be reflected. Also the missing invoices(which are not found in DESK_ALLOC table ) are closed by marking as ‘Invalid’. The pre-process script will generate a temporary file which is then imported into MRT_HFCLAIMSDESK_ALLOC table.

Stage 6600 : Data import job to Update Italy Trade for which period released

This stage creates the trades that needs to be updated in MRT_HFCLAIMSIT_TRADES table during declaration lock/unlock. This stage calls the scheduler job 157#IT_TRADES_UPDATE. The pre-process script will create the trades which needs to be updated along with Timestamp of the UPDPND to be stamped on hist table. Once these trades are created, these a re written into a temporary file which is updated in MRT_HFCLAIMSUPDPND and is then imported into MRT_HFCLAIMSIT_TRADES table.

Stage 6700 : Clear UPDPND after processing the Italy Re-Evaluation

This stage clears the IT trade related UPDPND record from the UPDPND table as the import has finished successfully.

Stage 6800 : Data import job to Update French Trade for which period released

This stage creates the trades that needs to be updated in MRT_HFCLAIMSTRADES table during declaration lock/unlock. This stage calls the scheduler job 143#TRADES_UPDATE. The pre-process script will create the trades which needs to be updated along with Timestamp of the UPDPND to be stamped on hist table. Once these trades are created, these are written into a temporary file which is updated in MRT_HFCLAIMSUPDPND and is then imported into MRT_HFCLAIMSTRADES table.

Stage 6900 : Clear UPDPND after processing the French Re-Evaluation

This stage clears the FR trade related UPDPND record from the UPDPND table as the import has finished successfully.

Stage 7000 : Data import job to Update Spain Trade for which period released

This stage creates the trades that needs to be updated in MRT_HFCLAIMSES_TRADES table during declaration lock/unlock. This stage calls the scheduler job 2#ES_TRADES_UPDATE. The pre-process script will create the trades which needs to be updated along with Timestamp of the UPDPND to be stamped on hist table. Once these trades are created, these a re written into a temporary file which is updated in MRT_HFCLAIMSUPDPND and is then imported into MRT_HFCLAIMSES_TRADES table.

Stage 7100 : Clear UPDPND after processing the Spain Re-Evaluation

This stage clears the ES trade related UPDPND record from the UPDPND table as the import has finished successfully.

Stage 55555 : Restart scheduler

System parameters related to the service:

Att.[SRVSERRNFYEMAIL] – email address where error notifications will be send.
Att.[IMPJOBSPLIT_INVCALC] – number of sub-processes started by the service during data processing
Att.[Email Server Params] – server parameters of the outbox used by services

Related to

Barclays+FTT+application+documentation.doc
200 KB Download

Barclays-FTT-Barclays FTT application documentation

Services used by Merit FTT system

Comments