Note: This was originally posted by an inactive account. Content was preserved by moving under an admin account.
Originally posted by: dkhuon@gogoair.comUnfortunately the input files are at the other side of the infrastructure wall (firewall), and can only be accessed through FTP.
Normally (in my previous works, using different tools), we would use FTP list to detect and compare file existence and date, etc.. to determine whether there is anything new to be processed. I am using the "prototype" Ftp Get which aborts if no input file :-(
Granted I can wait for the new version of Ftp (in Lavastorm 4.6.1), which "might" have a better flexibility in this regards, but I am wondering if someone has generically dealt with situations whereas we know in advance that a node could "fail" (under "un-preventable" circumstances), and would want to take a preventive action in order to control the graph for a more graceful landing (behavior), such as informing users that we don't input (therefore output) for this period.
If such a feature does not currently exist within Lavastorm, I would like to ADVOCATE for it, knowing that in the future I, for one, would need to use it to tame my graph from aborting ungracefully. I noticed some technique of creating dummy static files to deal with missing data, but it can only help when it is applicable. I guess what I am wishing for is an implementation, at node level, of a try-catch mechanism: maybe a try node that can be paired with a catch node and an end-block node, and using the a kind of clocking signal to control the flow within. Or something to that effect.
Thanks anyway, your input and of others are very welcome.