You can use some Python code in a Transform node to check whether the file exists and only output a record if it does exist.
In this case the path to the required file is contained in the input field "FilePath"
Then configure a MetaCheck node to verify whether there is at least one record at the output of the Transform node and enable the output Clock pin if the check is successful:
If the logic that needs to be run is to be included in the same data flow then create a Run Dependency (Clock) to enable the downstream nodes if the check is successful.
If you want to run a separate data flow if the file exists then configure the Execute Data Flow node to run the required data flow and create a Run Dependency from the MetaCheck node to the Execute Data Flow node.
The data flow that is checking on the presence of the file would be run under a schedule.
------------------------------
Adrian Williams
Precisely Software Inc.
------------------------------
Original Message:
Sent: 09-29-2023 08:05
From: Anderson Anderson
Subject: Processing Data Flow when new file is posted in the directory
Hi Guys, I hope everyone is very well.
We are facing a problem to start a data flow when new file is posted inside a directory, we should process the file and move to an backup area of files processed.
Someone could help me to implement the best practice for solve this situation?
Best Regards,
------------------------------
Anderson Anderson
DRZ Corporation
------------------------------