Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Defaults for robots meta tag

If I don't specify a robots meta tag in the head of the document, the defaults are:

<meta name="robots" content="index,follow">

My question is, if I only specify "noindex", is the default still "follow"? So if I specify this below, is the default still follow?

<meta name="robots" content="noindex">

Thanks!

like image 203
Matthew Williams Avatar asked Jun 11 '14 14:06

Matthew Williams


People also ask

What is the robots meta tag?

Robots meta directives (sometimes called "meta tags") are pieces of code that provide crawlers instructions for how to crawl or index web page content.

What is the most commonly used directive for the robots meta tag?

The noindex and nofollow values are the two most-used values used in the meta robots tag. However, the other values listed above also have SEO value: NoImageIndex: This instructs search engines to not crawl the images on a page.

Which is better meta robot tags or robots txt?

Robots. txt files are best for disallowing a whole section of a site, such as a category whereas a meta tag is more efficient at disallowing single files and pages. You could choose to use both a meta robots tag and a robots.


2 Answers

Yes, by only specifying the noindex, it will still be follow. More information can be found [here]{https://developers.google.com/webmasters/control-crawl-index/docs/robots_meta_tag}

like image 163
Wesley Smits Avatar answered Sep 21 '22 23:09

Wesley Smits


While "noindex" would be the same as "noindex,follow", it is important to note, that a long-term noindex will lead to "noindex,nofollow"; regardless of the specified follow-value. Although this is only valid for Google, i guess this is not what you intend.

some source: https://blog.seoprofiler.com/google-noindexfollow-noindexnofollow-long-run/ (or just google for "long term noindex"

like image 45
scones Avatar answered Sep 17 '22 23:09

scones