InterWeave Help

Help

How to catch up with Missing Data using Bulk Load Flow

How to catch up with Missing Data using Bulk Load Flow

To restart flow that is behind for more than 1-2 days it requires to restart it from current date and use bulk load utility flow to catch up with previous data. Restarting scheduled flows from the current date/time is to avoid integration server overload with back log of data that CANNOT be transferred by scheduled flow.

You need to run particular DR (Date Range) or DRS (Date Range + batch Size) bulk load utility flow (with DR or DRS at the end of its name) to catch up with missing data. Bulk load flows are designed to move big amount of data without integration server overload. I have attached the instruction on how to run bulk load flow.

Catch-up Procedure Steps:

  1. Stop scheduled flows and change their Query Starts date to current date if it is older than 1-2 days
  2. Use DR/DRS bulk load flow to catch up with previous data
  3. Run one bulk load flow at a time
  4. Restart scheduled flows after bulk loading is done

Leave a Reply

Your email address will not be published.