Data360 Analyze

 View Only
  • 1.  Load data files dynamically

    Posted 07-05-2021 01:52

    Hi Infogix

    Is there a way to load a set of data files into D3S based off of a configuration file that contains each files file directory, file name?  Perhaps using a Do while loop?

    thanks

    Scott



  • 2.  RE: Load data files dynamically

    Employee
    Posted 07-06-2021 04:43

    The CSV/Delimited node and Excel File node allow you to import data from multiple files.

    In the case of the CSV/Delimited node the 'Data (From Filename Field' source option is used to derive the name of the file from an input field. Typically this would be generated by the output of a Directory List node but you could obtain it from a configuration file provided the resultant field contained the absolute path to the file.

    The 'ConcatenationMode' property in the Optional tab allows you to specify how to combine the data from multiple files if the field metadata differs (or generate an error, which is the default).

    In the case of the Excel File node the name of the input field containing the filename is populated in the 'FilenameExpr' field. The 'ConcatenationMode' property is also available on the node.