LAE

Welcome to the LAE community!  Please feel free to start a discussion in the discussion tab or join in a conversation.

Discussions

Members

Resources

Events

 View Only

  • 1.  Fuzzy Join Error

    Employee
    Posted 11-28-2014 03:12

    Note: This was originally posted by an inactive account. Content was preserved by moving under an admin account.

    Originally posted by: zaldington

    Hi

    I am trying to perform a fuzzy join on ~112k records with 4 fields (Row ID, Full Name, City, Country). I am joining the data set to itself, because the purpose of the exercise is deduplication.
    The fields I have in the exact match tab are City and Country, and the field I have in the fuzzy match tab is Full Name. I've chosen the Levenshtein distance algorithm with Fuzzy Threshold 3.

    Yesterday it ran for 4 hours before it ran into an error. The error message was:
    -- Errors for Fuzzy_Join_Engine
    ERROR: [processLeftExactExpr] [Exception]

    Can anyone advise on what is going wrong?

    I'm now attempting an alternative method: split the data by country before performing fuzzy matches on each country data set.

    Thanks
    Zoe


  • 2.  RE: Fuzzy Join Error

    Employee
    Posted 11-29-2014 09:21

    Note: This was originally posted by an inactive account. Content was preserved by moving under an admin account.

    Originally posted by: andycooper

    Hi Zoe,

    Are you able to provide a sample data set and the graph you have created (or a subset of the graph that contains the nodes?).

    Thanks

    Andy