Data360 Analyze

 View Only

  • 1.  How to do custom http paging.

    Posted 12-09-2024 13:14

    Hello All, 
    Phoning a friend. 

    I am trying to download data from the bitbucket REST with the http node. I see that the response tells me that I have not downloaded the last page, and I can see from from the documentation that I need to write a custom paging script.

    So I form my URLs and fire them off, and the data comes back in pages of 25 by default. 

    I get that I need to take the decoded metadata (see node help) and do something - presumably (while not islastpage).
    e.g. BitBucket 1.0 REST API Retrieve all Pull-Requests for repository

    I can see the next pages, when I use the parameter: "start" (see last picture below).
    e.g  https://xxx//rest/api/1.0/projects/DAT/repos/kafka-client-config/files/topics?at=cpkfk01p&start=25


    I just can't put it all together. I'm sure its easy but I just don't grok the example.
    Does anyone have a working custom pagination script like this?

    Thanks
    Peter

    (First column with highlights is end of "Response")



    ------------------------------
    Peter Sykes
    Data Governance & Architecture
    Vontobel Holding AG
    Zurich
    ------------------------------


  • 2.  RE: How to do custom http paging.

    Posted 12-09-2024 16:56

    OK, this works. 



    ------------------------------
    Peter Sykes
    Data Governance & Architecture
    Vontobel Holding AG
    Zurich
    ------------------------------

    Original Message