Data360 Analyze

 View Only
  • 1.  Reading JSON file - data type mismatch

    Employee
    Posted 01-10-2019 10:08

    Hi - I am receiving the following error when reading a JSON response from a HTTP request

     

    Error occurred while processing parsed data and sending to the nodes outputs: Error writing record (0) on output (Data) Due to field error : Error occurred writing the string field "custom_steps_separated.content" on record 28. Field had the value (• Add two new group names with the below parameters o UnsolicitedJSMQueuePoller  pollinterval = 10  unsolicited= true  MaxRecordsPerBatch=1  NetworkRequestKeyPrefix =1 o UnsolicitedNetworkEventHandlerThreadPool  maxSize=20 ). This type of error is normally caused by a type trying to populate it's field with a value that is not within the character set of the type. For example, an ASCII type trying to populate a String field by simply appending the bytes read from the file, where some of the bytes may not be correctly encoded.

     

    Now I believe its to do with the underlying data in the database. But is there a way to get around this error as this field isnt relevant down stream. I have tried setting differing values on the JSON node but i dont seem to be able to fix it.

     

    There is no way to filter my query in the HTTP request I am making to the back end system to remove this custom field.

    Thanks

    Martin



  • 2.  RE: Reading JSON file - data type mismatch

    Employee
    Posted 01-14-2019 03:50

    Hi Martin,

    can you please provide a bit more detail on how the data is being processed by the node.

    Is the json coming in via an input pin?

        If via an input pin, is this a unicode or string field?

        If via a file, what is the Charset set to on the node?

    And how is the node configured to output character data (CharacterDataOutputFieldType)?

    Thanks,

    Adrian



  • 3.  RE: Reading JSON file - data type mismatch

    Employee
    Posted 01-14-2019 04:30

    Hi Adrian - I played around with the CharacterDataOutputFieldType and changed it to Unicode and it read the input pin in OK!

     

    Many Thanks for the pointer:)

     

    cheers

    Martin



  • 4.  RE: Reading JSON file - data type mismatch

    Employee
    Posted 01-14-2019 08:46

    Sorry I have another issue now...the HTTP request works great and pulls back the data required. However I am using an input field which is the URL to be targetted but the response doesnt pass back the original value I am querying or have.

     

    So is there a way of passing back the original HTTP request i.e. the Url (from field) value? So that I have 2 fields in the response:

    Url | Data

    Thanks

    Martin



  • 5.  RE: Reading JSON file - data type mismatch

    Employee
    Posted 01-14-2019 09:13

    Many nodes, JSON, XML, HTTP  have the "Pass Thru Fields" parameter that provides this very feature.