Data360 Analyze

 View Only
  • 1.  Import CSV file - unrecognized characters on the end

    Employee
    Posted 01-11-2021 10:49

    Using Data360 Desktop v 3.6.5.6605

    I have a csv file with a header and 3 lines and I am trying to import it in D360. The import errors on the characters at the end. Is there a way to just read the data in and not error?

     

    Attached files

    test.csv

     



  • 2.  RE: Import CSV file - unrecognized characters on the end

    Employee
    Posted 01-11-2021 11:07

    I want to attach the original file. When I copied and pasted the 3 rows it did something to the data so the node did read it in. Please see the techex_accounts.csv file please.

     

    Attached files

    techex_accounts.csv

     



  • 3.  RE: Import CSV file - unrecognized characters on the end

    Employee
    Posted 01-11-2021 13:01

    Note: This was originally posted by an inactive account. Content was preserved by moving under an admin account.

    There's an hidden parameter that can be added to the CSV/Delimited node in order to get your file work. It will be added into a future release but for now you can add it manually. Attached is a data flow reading both your files, for the second file I needed to add the UnescaptedQuote parameter. Here's the steps:

    1. Navigate to Define on the CSV/Delimited node.
    2. Create a parameter named UnescapedQuoteCharacter. Once its created go to Edit Details for the parameter (hamburger menu on the right of the name).
    3. Ensure the Run Time Property Name is ls.brain.node.csv.unescapedQuoteHandling.
    4. The Type should be set to Choice with the following choices: Error, Skip Value, Stop at Closing Quote and Stop at Delimiter.
    5. For this file, I set it to "Stop at Delimiter". You have 2 records that have more than 6 fields in them. You would need to tag on a second node to handle any fall out.

    Hope this helps!

     



  • 4.  RE: Import CSV file - unrecognized characters on the end

    Employee
    Posted 01-11-2021 15:56

    Note: This was originally posted by an inactive account. Content was preserved by moving under an admin account.

    Adding a new data flow with several options to read the file, as it looks like using "Stop at Delimiter" is causing 2 rows to get merged together making it easy to lose a row of data in this case.

     

    Attached files

    Unescaped Quote CSV.lna