Data360 Analyze

How do I create a running number of a data flow (similar to auto increment of database)?

Every time the data flow run, the number should be increased by a constant (i.e. 1), and will be emitted as one of the output columns.

Thanks.

use this:

emit execCount as myRowNumber

or this:

if firstExec then myRowNumber=0
  myRowNumber = myRowNumber +1

emit myRowNumber

Thank you. What if I want the number to be persistent per run not per row.

For example, for initial run

run_id, name, amount

1, susan, 1000

1, peter, 200

1, Samie, 300

Next time when the data flow is executed

2, susan, 1212

2, peter, 234

2, Samie, 334

There are probably some more elegant ways to achieve this but... the attached .lna file contains a node that stores a persistent execution count in the specified file. If the file does not exist it is created and the execution count starts at 1.

Obviously, you must use a unique file for each data flow that would use a persistent execution counter.

Regards,

Adrian

Attached files

Persistent_Exec_Count.lna

Another possible way to do this is to use the date (and time) as a unique identifier