Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Facebook scraper uses incorrect DNS data > my site is not gettng scraped

I recently moved one of my sites (gezondbenjij.nl) to a new hosting account. This resulted in a new IP address.

Unfortunately, since the move, the Facebook scraper cannot find my site on the new IP address. It still uses the old IP. All DNS settings are correct, and every browser/client/tool finds the correct site at 178.22.57.204 (gezondbenjij.nl). Except for Facebook.. The facebook scraper lands in my old hosting account. So I guess their hostfile or DNS cache still holds the old data. Even after a couple of weeks.

I have set a domain alias at gezondbenjij.com --> gezondbenjij.nl, and redirected the old hosting account to this .com domain. In this way, facebook is redirected to the correct site via a bypass, but still is not able to scrape the site. So the URLs I try to share on facebook will not generate snippets at this moment.

Is there any way to force (or kindly ask) Facebook to update their DNS cache? I used the fb URL linter, but it will not solve the issue. It will only reset facebook's html cache, not the DNS cache..

like image 602
Tim Avatar asked Apr 18 '14 15:04

Tim


1 Answers

Check your IPv4 and IPv6 IP addresses in your DNS configuration. I had similar issue and the problem was that I've updated only IPv4 DNS record, while keeping old IPv6 (Facebook uses IPv6 in it's Tools). My hosting provider corrected it and problem was solved.

like image 95
Tomasz Rozmus Avatar answered Sep 27 '22 22:09

Tomasz Rozmus