Data360 Analyze

 View Only

  • 1.  Logic | Schema.ini | CSV

    Posted 06-18-2021 00:39

    Hello,

    I have a requirement where I will get two files periodically.

    1. First file : Schema details (Schema.ini)

    2. Second file : Data file in CSV format

    Based on the "schemas.ini" definition received from the external source, we need to map the field definition and import the data in Analyze for processing. 

    Documentation for reference - Schema.ini File (Text File Driver) - Open Database Connectivity (ODBC) | Microsoft Docs

    Do we have a node supporting this 'Text file driver' functionality in Analyze ?

    Thanks and Regards,

    Nitin

     

     

     

    Attached files

    schemas.ini

     



  • 2.  RE: Logic | Schema.ini | CSV

    Employee
    Posted 06-18-2021 08:11

    As a starting point, you could...

    1. Read the CSV file, and specify the column names using the "FieldNames" property on the node to give you something like F_1, F_2, F_3
    2. use ChangeMetadata to rename the fields using the info in the schema
    This should work as long as the number of columns doesn't change.
    Note: the ChangeMetadata can also possibly do a bit of data-type manipulation