Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Iterating through multiple pages of an API response in a JS promise function

I have the following promise function which uses fetch to get data from an API:

const getContacts = token =>
  new Promise((resolve, reject) => {
    fetch(url, {
      method: 'GET',
      headers: {
        'Content-Type': 'application/json',
      },
    })
    .then(response => response.json())
    .then((data) => {
      resolve(data);
    })
    .catch(err => reject(err));
  });

This function is then called in a different file:

getContacts(token)
.then((data) => {
  const contacts = data.data;
  console.log(contacts);
})
.catch(err => console.error(err));

When there is a larger amount of data returned from the API, it is paginated. The response includes a link that needs to be fetched in order to get the next page. I want my code to first iterate through all pages and collect all data, then resolve the promise. When execution reaches the const contacts = data.data line, it should have data from every page (currently it returns only the first page).

What would be the best way to achieve this?

EDIT:

I tried recursion inside the getContacts function. This way I can iterate through all pages and get all data in one object, but I don't know what's the right way to resolve this back to the code, which initially called the function. The code below doesn't resolve correctly.

const getContacts = (token, allData, startFrom) =>
  new Promise((resolve, reject) => {
    if (startFrom) {
      url = `${url}?${startFrom}`; // the api returns a set of results starting at startFrom (this is an id)
    }
    fetch(url, {
      method: 'GET',
      headers: {
        'Content-Type': 'application/json',
      },
    })
    .then(response => response.json())
    .then((data) => {
      let nextPageExists = false;
      Object.assign(allData, data.data);

      data.links.forEach((link) => {
        if (link.rel === 'next') {
          nextPageExists = true;
          getContacts(token, allData, link.uri);
        }
      });
      if (!nextPageExists) {
        resolve({ data: allData });
      }
    })
    .catch(err => reject(err));
  });
like image 399
rok Avatar asked Mar 07 '23 03:03

rok


1 Answers

First of all, do not use the new Promise constructor when fetch already returns a promise.

Then, just use a recursive approach and chain your promises with then:

function getContacts(token, allData, startFrom) {
  return fetch(startFrom ? url + '?' + startFrom : url, {
    method: 'GET',
    headers: {
      'Content-Type': 'application/json',
    },
  }).then(response => response.json()).then(data => {
    Object.assign(allData, data.data);
    const nextPage = data.links.find(link => link.rel === 'next');
    if (!nextPage)
      return allData;
    else 
      return getContacts(token, allData, nextPage.uri);
  });
}
like image 62
Bergi Avatar answered May 05 '23 23:05

Bergi