Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Restrict robot access for (specific) query string (parameter) values?

Tags:

seo

robots.txt

Using robot.txt is it possible to restrict robot access for (specific) query string (parameter) values?

ie

http://www.url.com/default.aspx  #allow
http://www.url.com/default.aspx?id=6  #allow
http://www.url.com/default.aspx?id=7  #disallow
like image 638
Ian G Avatar asked Aug 23 '26 13:08

Ian G


1 Answers

User-agent: *
Disallow: /default.aspx?id=7  # disallow
Disallow: /default.aspx?id=9  # disallow
Disallow: /default.aspx?id=33 # disallow

etc...

You only need to specify the url's that are disallowed. Everything else is allowed by default.

like image 106
Espo Avatar answered Aug 27 '26 00:08

Espo



Donate For Us

If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!