Spectrum Technology Platform

 View Only

Matching Within a Single Data Source Using Distributed Processing

  • 1.  Matching Within a Single Data Source Using Distributed Processing

    Employee
    Posted 01-25-2020 15:18
      |   view attached

    In Single Customer View (SCV) implementations we often match customers within the input data file for the initial load and each daily delta update and assign a unique party Id to records representing the same customer and create a best of breed master customer record. Matching multiple millions, of records within the input data file can take time and there are many things we do to optimize performance. In the attached SCV Advanced Topic 'How To' Short Training Video, we demonstrate how we can configure Distributed Processing for vertical scalability for stages where Local Run-time Instances are not available, such as, the Intraflow match stage, which we use to match record within a single source.



    ------------------------------
    Jeremy Peters: GISP, CIMP - Master Data Management & Data Quality
    Solutions Architect / Principal Consultant/ Distinguished Engineer
    Pitney Bowes Customer Information Management and Location Intelligence
    350 Jordan Rd | Troy, NY 12180 USA
    jeremy.peters@pb.com
    https://www.linkedin.com/in/jeremypeters1/
    ------------------------------