LAE

Welcome to the LAE community!  Please feel free to start a discussion in the discussion tab or join in a conversation.

Discussions

Members

Resources

Events

 View Only
  • 1.  Sort node is corrupting data?

    Employee
    Posted 03-22-2018 15:36

    Note: This was originally posted by an inactive account. Content was preserved by moving under an admin account.

    Originally posted by: djnrempel

    I'm working with some data, about 250,000 rows.

    I am using a sort node to sort on two of the fields, PersonID and a date field.

    After the data has gone through the sort node, the following has happened to it:

    A different field, CombinedID, that consists of a name and a date, has had the name stripped out so only the date text remains.

    Another date field has been set to NULL

    The PersonID field has been set to NULL

    I thought maybe the system was just getting glitchy so I rebooted the whole system, but still getting the same result.


  • 2.  RE: Sort node is corrupting data?

    Employee
    Posted 03-23-2018 06:07

    Note: This was originally posted by an inactive account. Content was preserved by moving under an admin account.

    Originally posted by: gmullin

    You just want to sort the 2 columns? Check on your Optional tab if you have unique or stable sort set to true? That doesn't sound right what's happening, it should just sort the 2 columns and not do anything else with the data.

    Edit: Also when you open the data your data viewer by default is showing you the first 1000 records, could it be that you're not expecting some of those NULL records? Can you try adding on a filter to remove some of the NULL items and see if the data is as you expect?


  • 3.  RE: Sort node is corrupting data?

    Employee
    Posted 03-23-2018 06:42

    Note: This was originally posted by an inactive account. Content was preserved by moving under an admin account.

    Originally posted by: djnrempel

    Okay egg on my face, that is exactly what's happened. I must have been tired yesterday...

    There shouldn't be any null PersonIDs, but that is a more manageable issue, I can troubleshoot that.

    Thanks!