Data360 Analyze

 View Only
  • 1.  Analyze the processing time

    Posted 02-20-2020 08:17

    Hi, support.

    I would like to know if it is possible to analyze the workflow processing time through the solution log.

     

    Regards,



  • 2.  RE: Analyze the processing time

    Employee
    Posted 02-20-2020 15:24

    You can analyze the contents of the audit log. A copy of the log can be read using the JSON Data node. 

    The audit log can be found in the logs directory within the site directory for the system. The site directory location for a Desktop instance can be found here:

    %localappdata%\Data3SixtyAnalyze\site\logs

    e.g. C:\Users\<username>\AppData\Local\Data3SixtyAnalyze\site\logs

    The audit log records events for when a node starts to run and completes running, e.g.

    You can analyze the contents of the audit log. A copy of the log can be read using the JSON Data node. 

    The audit log can be found in the logs directory within the site directory for the system. The site directory location for a Desktop instance can be found here:

    %localappdata%\Data3SixtyAnalyze\site\logs

    e.g. C:\Users\<username>\AppData\Local\Data3SixtyAnalyze\site\logs

    The audit log records events for when a node starts to run and completes running, e.g.

    The "nodeProcessing" event indicates a node started running. The "nodeProcessed" event indicates when a node stopped running. You will need to correlate the start and stop events for each node. The nodeLocator's  object:element  attribute identifies the node's id. If a node completed successfully it's runState will be "PASSED". Other attributes of the log events provide details of the particular data flow and node  in the data flow. 



  • 3.  RE: Analyze the processing time

    Employee
    Posted 02-21-2020 01:53

    The tool attached in this article might help with retrieving data from the audit log: https://support.infogix.com/hc/en-us/articles/360026131853-How-to-analyze-your-log-files-in-Data360-Analyze



  • 4.  RE: Analyze the processing time

    Posted 02-21-2020 10:11

    Hi, Christina Costello.

    I tried to read the log file through the JSON Data node, but the following error appeared.



  • 5.  RE: Analyze the processing time

    Employee
    Posted 02-24-2020 09:38

    Hi Gabriella, I got the same error you did initially but after setting some of the optional properties it works. CoerceData needs to be set to "On Conflict" and "SubstituteInvalidCharacters" needs to be set to True. 

    Please find attached a data flow that uses the JSON data node to parse the audit log. There are two JSON data nodes - the first one has a lot of output pins that you may find useful, depending on your audit log. The second one is just the basic node with no additional output pins. 

     

    Attached files

    Parse Audit Log - 24 Feb 2020 (1).lna