Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

How do I let search crawlers properly index pages with infinite scroll?

I have a website on which I implement infinite scroll: when a user reaches the end of a page, an AJAX call is made and new content is attached to the bottom of the page. This, however, means that all content after the first "page break" is unattainable by search crawlers. For example, I have a page that lists all items with the "infographic" tag. There are actually several dozens of such items, but crawlers are able to see only the first 10, because other items are loaded based on the position of the content relative to browser window. Since crawlers don't have browser windows, new items are not loaded at all.

What is the proper way, then, to let search crawlers access the full content of web pages with infinite scroll, while also allowing users to enjoy the infinite scroll and the lack of pagination?

like image 415
sbichenko Avatar asked May 28 '12 11:05

sbichenko


1 Answers

Along the lines of graceful degradation, you shouldn't rely on JavaScript for something as important as pagination. I would probably implement a normal pagination system first (that search engines can index), and then use JS to hide the pagination links and implement the infinite scroll solution.

like image 183
Victor Stanciu Avatar answered Sep 25 '22 22:09

Victor Stanciu