NT-FTT-MER-23295 NT FTT Graceful recovery due to Solace Queues due to network instability.

Below Scenarios are addressed in this fix. 

• Trade Import and Re-Processing getting stuck, this could cause Trades to be stuck with a Processing Status of ‘New’ after import.
  • Bulk Actions on Trades failing, causing the selected Trades to be marked with Job that will never complete.
• Declaration Approval Process and Declaration file Generation.

Trade Import with Status New [System recovers Gracefully]

Trades are imported into NT FTT system and Prior to the Processing, the MQ is going down making the trades stuck with Processing status as New. Noticed that the Job Status of the Processing Job Id is Shown as Queued.

Earlier:

Use Back End DB scripts to clear the Queued Batch Id re-Process the Trades

Now:

Wait for the MQ service to be back to running status.

Once the MQ is back to running status wait for a while, the stuck trades will be processed and the Batch Job id which was queued earlier due to MQ issue is changed to processed status.

Bulk actions on Trades [System recovers Gracefully]

Trades are selected and marked for Taxable and Reportable. The maker process is completed and before the approval process the MQ is going down making the bulk action request stuck in the queue.

Earlier:

Use Back End DB scripts to clear the Queued Batch Id Re-Process the Trades

Now:

Wait for the MQ service to be back to running status.       

Once the MQ is back to running status wait for a while and the Approval and reprocessing of

the trades will be completed Gracefully.

 Declaration approval process and Generation [Need Manual Intervention]

Select a Trades and Approve for Declaration. MQ is going down before the User “Generate Declaration”. The User will receive an error message “Oops Something went wrong. Please contact administrator” while trying to “Generate Declaration” and the Generate/Preview and approval buttons will be disabled.

Wait for the MQ service to be back to running status.

This process needs Manual intervention. Once the MQ is back to running status, go to the trades, click on “Un- approve Declaration “and Again “Approve for Declaration” to retrigger the process manually. Now the user will be able to Generate the Declaration.

Declaration - Approve for Sending [System recovers Gracefully]

User Clicks on Generate Declaration and before user click on Approve for sending, The MQ goes down. Verified that the “Approve for Sending” declaration is working.