Data360 Analyze

 View Only

DB Clean loader cleaning the table too soon!

  • 1.  DB Clean loader cleaning the table too soon!

    Posted 20 days ago

    Ran into an odd issue. I have a simple flow that is 4 nodes

    it has 2 db queries, to a cat, to a db clean loader

    one of the 2 queries is pulling all the data from the table the clean loader is loading

    Running this manually works fine... but scheduled it fails.

    It took a while to realize that the db Clean loader is emptying the table as soon as the flow starts... its not waiting for its turn in line

    That db clean loader should be waiting till progress gets to it.. before it empties and loads it.

    But, since its dumping it as soon as the flow starts, the db query node cannot find the object. I havent seen it do it manually running it yet, only scheduled.

    the solution is obviously to use the clock/run dependencies.. but it seems to me like that is not normal behavior so I wanted to see if @Adrian Williams might know if this is normal behavior?



    ------------------------------
    Geoff Goldsmith
    Windstream Communications
    Little Rock AR
    ------------------------------