Google’s John Mueller answered a question on Reddit about a commonly used robots meta tag and what would happen if it was missing. Mueller’s answer, while it makes sense and is documented, may still come as a surprise to many publishers and SEOs.
Robots Meta Tag
The HTML meta element communicates metadata. Metadata is machine readable information that a crawler like Googlebot can read.
There are many kinds of meta elements like the meta description element but the Robots Meta Element is…
Source link