LAE

Note: This was originally posted by an inactive account. Content was preserved by moving under an admin account.

Originally posted by: SambaDancer

Dear all,

I have been given a delimited file with FieldDelimiter �;|� (without the doublequotes).
In a few records, a field ends in a semicolon �;�, therefore resulting in the string �;;|� in the raw data: �text;|text;;|text;|text�

The node core::Delimited File doesn�t handle this situation correctly, however: In these cases, the FieldDelimiter is not recognized anymore and thus ignored (no error), resulting in erroneous data:
Field1 Field2 Field3
text text;;|text text

As a workaround, I�ve acquired the data as 1 block, added a filter node which replaces the �;;|� with �;|�, written that result as a delimited file and acquired that file again.
But this takes a LOT of time (it�s a big file).

Is this a (known) bug? Is there a smarter workaround?

Thanks so much in advance!

Best regards,

Bart Roeleveld,
Senior Data Analysis Specialist, Coney B.V.

Note: This was originally posted by an inactive account. Content was preserved by moving under an admin account.

Originally posted by: ejones

Too bad you are not using the pipe delimiter by itself since that is much more common. I've done pre-search/replace operations on files before reading them in with a delimited file node in the past for other reasons. Have you tried sending this to Technical Support because they might know a workaround.

Note: This was originally posted by an inactive account. Content was preserved by moving under an admin account.

Originally posted by: SambaDancer

Thanks! I have also asked support, but forum is sometimes quicker :-)
I can't, unfortunately, influence the separator in the source data, it's as is' :-(
best regards, Bart.