LAE

Welcome to the LAE community!  Please feel free to start a discussion in the discussion tab or join in a conversation.

Discussions

Members

Resources

Events

 View Only
  • 1.  Special Duplicate/Grouping Process

    Employee
    Posted 02-26-2016 19:06

    Note: This was originally posted by an inactive account. Content was preserved by moving under an admin account.

    Originally posted by: ahines

    I have a group of data that has unique identifiers based on a process. Each of the processes that go together receive the same reconcile number, indicating the steps in the process that go together. Normally they are a 1:1- two lines, 1 reconcile number on each line that matches. I have a very large data set now that has some instances where there is a more than 1:1. I need to be able to find all the lines of data that have the same reconcile number that is more than 2 lines, and separate them from everything else. I tried to use an Agg Ex node to group by the reconcile number and add a column of data equal to the number of lines in the group. That way I would see 2's and 3's in the column and be able to split based on that, but I could only get as close as counting lines in the group (1, 2, 3). See example below.

    12345
    12345
    12346
    12346
    12346
    12347
    12347
    12348
    12348
    12349
    12349
    12349

    I'd like to split this so all the lines with 12346 and 12349 (because there are three of them) are separated.

    thanks!


  • 2.  RE: Special Duplicate/Grouping Process

    Employee
    Posted 02-26-2016 21:20

    Note: This was originally posted by an inactive account. Content was preserved by moving under an admin account.

    Originally posted by: ryeh

    Hi, Andrew, you're keeping busy! You can use the Histogram node to get a count of the reconcile numbers. Then split to get the numbers that occur more than twice. Then finally join it back with the original data to get those records.
    Attachments:
    getCountsGreaterThan2.brg


  • 3.  RE: Special Duplicate/Grouping Process

    Employee
    Posted 02-26-2016 21:33

    Note: This was originally posted by an inactive account. Content was preserved by moving under an admin account.

    Originally posted by: ahines

    Ha! yea- I am creating a new deposit report to work for the corporate data (Think phase II of what we worked on before) Plus side is that I got the prototype data sent to me in a form that is very much looking like the end product of phase I, but there were some limitations (I am separating bank versus sales dates from a single column), but am unable to join them back together. I am working through those now, i hope, by managing the reconcile match IDs that aren't sync'ing.

    I tried out the fix you added, but it is giving an sort error. Right input not sorted at row 2?


  • 4.  RE: Special Duplicate/Grouping Process

    Employee
    Posted 02-26-2016 21:38

    Note: This was originally posted by an inactive account. Content was preserved by moving under an admin account.

    Originally posted by: ahines

    Scratch that, Roger- I figured it out. Needed to set the Join parameters to "True". Right as rain now. Thanks for the help!