LAE

Note: This was originally posted by an inactive account. Content was preserved by moving under an admin account.

Originally posted by: dhrobertson

Hi there,

I am extract all data from a number of table in SAP. needless to say it is a nightmare processing-wise and it is not workable to pull the complete tables each day.

is there a easy way to be able to get delta changes from the tables the following day?
I notice there is some sort of record counter called __Recordnumber which I assume is created by lava. is there some way I can use that? or do I need to have a date/timestamp in the raw data whereby I use to determine which are deltas.

how do you guys out there deal with daily delta loads from massive SAP or other DB tables?

thanks

Doug

Note: This was originally posted by an inactive account. Content was preserved by moving under an admin account.

Originally posted by: stonysmith

These questions would need to be answered by your SAP provider. You need to see if you can find a manual on the options for the query language that SAP uses.

The _Recordnumber field is based upon the 'current' query you just executed, and the sequence of the records could change tomorrow.

Best case, you would have to determine if SAP has a timestamp for the records, and add that to your query.

Also, remember that you don't only want NEW records, you also want records that were MODIFIED during the previous time period.