LAE

Welcome to the LAE community!  Please feel free to start a discussion in the discussion tab or join in a conversation.

Discussions

Members

Resources

Events

 View Only
  • 1.  fuzzy matching to detect duplicates

    Employee
    Posted 06-12-2015 08:25

    Note: This was originally posted by an inactive account. Content was preserved by moving under an admin account.

    Originally posted by: dhrobertson

    Hi guys,

    I know there is the ability to join data based on a fuzzy match on 2 different fields. I have a situation where I have a single vendors table which includes vendors that sometimes are the same, but sometimes have slightly different spellings. what the client is after is the ability to consolidate these vendors that are deemed to be the same vendor into 1 vendor description for all. what I would like to be able to do is some sort of duplicate detection but using exact matches as well as fuzzy matches on the name, if that makes sense.
    I know there is not a node, as far as I'm aware, that can do this, but would anyone out there have a way of doing this using the current lava nodes at our disposal?

    any help is greatly appreciated.

    thanks

    Douglas


  • 2.  RE: fuzzy matching to detect duplicates

    Employee
    Posted 06-12-2015 15:07

    Note: This was originally posted by an inactive account. Content was preserved by moving under an admin account.

    Originally posted by: ryeh

    Check out this example I recently worked on. The fuzzy matches can be tweaked as necessary. I don't know if all the logic has been optimized. It seems to work for the most part.
    Attachments:
    ID_Matching.brg


  • 3.  RE: fuzzy matching to detect duplicates

    Employee
    Posted 06-15-2015 00:19

    Note: This was originally posted by an inactive account. Content was preserved by moving under an admin account.

    Originally posted by: dhrobertson

    thanks a lot, will take a look.