Quantcast
Channel: Recent Questions - Stack Overflow
Viewing all articles
Browse latest Browse all 12111

Scrape data from a public API politely using postman?

$
0
0

I'm trying to scrape data from a public API and I'm not sure if I'm thinking about this the right way.

The API is RESTful and I'm looking to:

Grab the first 100 resultsSave the JSON result to a unique filenameWait the required amount of time (15 seconds) to not violate usage guidelinesSet the offset += 100Grab the next 100Either save the JSON results as a new unique filename or even append results to the previous oneContinue until response != 200 or I get 0 results back

Is Postman even the right tool to use for this? I'm not very familiar with scripting in Postman.

{{URL}}/v1/titles?api_key=123456&limit=100&offset=0


Viewing all articles
Browse latest Browse all 12111

Trending Articles



<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>