Data360 Analyze

 View Only
  • 1.  Property to increase column size?

    Posted 11-14-2019 03:45

    Hi,

    Need help on the below... where should I apply the settings at?

     

    "Unexpected exception while calculating output metadata: Length of parsed input (102401) exceeds the maximum number of characters defined in your parser settings (102400). Hint: Number of characters processed may have exceeded limit of 102400 characters per column. Use settings.setMaxCharsPerColumn(int) to define the maximum number of characters a column can have Ensure your configuration is correct, with delimiters, quotes and escape sequences that match the input format you are trying to parse Parser Configuration: CsvParserSettings: Auto configuration enabled=true Auto-closing enabled=true Autodetect column delimiter=false Autodetect quotes=false Column reordering enabled=true Delimiters for detection=null Empty value=null Escape unquoted values=true Header extraction enabled=null Headers=null Ignore leading whitespaces=true Ignore leading whitespaces in quotes=false Ignore trailing whitespaces=true Ignore trailing whitespaces in quotes=false Input buffer size=1048576 Input reading on separate thread=true Keep escape sequences=false Keep quotes=false Length of content displayed on error=-1 Line separator detection enabled=true Maximum number of characters per column=102400 Maximum number of columns=5000 "...



  • 2.  RE: Property to increase column size?

    Employee
    Posted 11-15-2019 04:07

    We have seen this error a couple of times when using the CSV/Delimited Input node. The issue was due to the node not auto-detecting the file character set when it is encoded as Little Endian UTF-16. 

    If if you choose from the "FileCharacterSet" dropdown: UTF-16LE  then it should work.