Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Google indexed my test folders on my website :( How do I restrict the web crawlers!

Help Help! Google indexed a test folder on my website which no one save I was supposed to know about :(! How do I restrict google from indexing links and certain folders.

like image 354
Ali Avatar asked Dec 18 '25 03:12

Ali


1 Answers

Use a robot exclusion file, or better yet password protect your test areas! Using a robots.txt file to "protect" areas you don't want others to see is a little like hanging a sign on your back door saying "I've left this open but please don't come in" :)

If you sign up for Google webmaster tools, you can request removal of a search result if you ensure it's no longer accessible by their crawler.

like image 176
Paul Dixon Avatar answered Dec 20 '25 18:12

Paul Dixon



Donate For Us

If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!