Data360 Analyze

 View Only
  • 1.  How to AUtomatically purge large temporary files created by workflow

    Employee
    Posted 12-14-2020 15:52

    My workflow hits the ALM API and gets the data in form of temp files. These files are stored at a temp location(see below) and are very huge. This causes space issue. Is there a way to automatically purge these files ?

    What I am trying to achieve is- Go to the temp directory location-->sort by Date and the ones older than today should be deleted. Please suggest if there'a way to do so. Thanks!

    File path: C:\ProgramData\Data360Analyze\site\data\executions



  • 2.  RE: How to AUtomatically purge large temporary files created by workflow

    Employee
    Posted 12-15-2020 06:22

    Data360 Analyze has built-in tools to help manage the purging of temporary data generated by the application. In the case of temp data generated by the ad hoc execution of data flows the following setting should be configured as required:

     

    When scheduling is used, the corresponding settings for the purging of scheduled run data are here:



  • 3.  RE: How to AUtomatically purge large temporary files created by workflow

    Employee
    Posted 12-15-2020 11:07

    You can manually delete other temp data that may be generated by your data flows using a Directory List node  that is configured to recurse and to select the files matching the required pattern: (all files in this case)

     

    A Transform node can then be configured to identify files where the modified data is older than a threshold date:

    Finally, another Transform node can be used to delete the selected files:

     

    Where the Scheduling feature is enabled in your application license the data flow can be scheduled to run daily to automate the purging the files. Note that the data flow does not delete any directories.

    Caution should be exercised to ensure that the data flow is configured to only delete the required files.

    An example data flow is attached below. Data360 Analyze release 3.6.0 or higher is required to import the attached example data flow.

     

    Attached files

    Purge_Aged_Files--share - 15 Dec 2020.lna