Throttle and queue up API requests due to per second cap

Question

I'm use mikeal/request to make API calls. One of the API's I use most frequently (the Shopify API). Recently put out a new call limit, I'm seeing errors like:

Exceeded 6.0 calls per second for api client. Slow your requests or contact support for higher limits. 

I've already gotten an upgrade, but regardless of how much bandwidth I get I have to account for this. A large majority of the requests to the Shopify API are within async.map() functions, which loop asynchronous requests, and gather the bodies.

I'm looking for any help, perhaps a library that already exists, that would wrap around the request module and actually block, sleep, throttle, allocate, manage, the many simultaneous requests that are firing off asynchronously and limit them to say 6 requests at a time. I have no problem with working on such a project if it doesn't exist. I just don't know how to handle this kind of situation, and I'm hoping for some kind of standard.

I made a ticket with mikeal/request.

Answer 1

For an alternative solution, I used the node-rate-limiter to wrap the request function like this:

var request = require('request'); var RateLimiter = require('limiter').RateLimiter;  var limiter = new RateLimiter(1, 100); // at most 1 request every 100 ms var throttledRequest = function() {     var requestArgs = arguments;     limiter.removeTokens(1, function() {         request.apply(this, requestArgs);     }); };