Data360 Analyze

Hello,

Is it possible to identify how long it takes a flow to run to completion?  I see the timing on the Nodes but not on the entire flow/graph.  I could use the 2nd hand on my watch but figured this data may be written somewhere in more detail.  I am running on a server install.

Thanks

Mike

Information on the start and finish times of a data flow will be included in the system's  <site-7731>/logs/lae-audit.log  file and, depending on the time period when the data flow is running the information may also be located in any 'rotated' audit logs (which will be named  lae-audit.log.yyyy-mm-dd).

The attributes of the "dataflowProcessed" auditCode include information on how long the data flow was running for. You can  search the lae-audit.log file to find the event that corresponds to your data flow's name using   "graph":"<name-of-data-flow". Find the event that contains the "dataflowProcessed" element and check the "duration" attribute. For instance the following event identifies the duration (hh:mm:ss:ms) of the "Import Users to Govern" data flow.

{"timestamp":"2023-11-21T01:26:26.519-06:00","auditCode":"dataflowProcessed","userId":"72f4babb-b8f7-4951-9967-73ee54c2c17b","username":"bob","tenantName":"defaultTenant","success":true,"arguments":{"duration":"00:26:12:999","graphLocator":"object:!tenant:defaultTenant~directory:__Root__~directory:lavastorm~directory:shared~directory:67f078d6-71b8-4b94-b96a-94dbbafaf80d~graph:a896b5a5-dfb6-4573-a3a1-c043d88e3040~element:306d3f51-490e-4370-b80e-c0e93e28eae1","graph":"Import Users to Govern","status":"SUCCEEDED"}}

You can use the jq log analysis tool to assist with analysing the logs. The following KB articles include some examples that will identify data flows which run for longer than a specified duration.

How to use jq on linux Environment

https://customer.precisely.com/s/article/How-to-use-jq-on-linux-Environment-360058604674?language=en_US

Data360 Analyze: How to use jq on Windows

https://customer.precisely.com/s/article/Data360-Analyze-How-to-use-jq-on-Windows-360059947393?language=en_US