Blocking Special Files in Robots.txt

Google’s John Mueller answers a question about using robots.txt to block special files, including .css and .htacess.

This topic was discussed in some detail in the latest edition of the Ask Google Webmasters video series on YouTube.

Here is the question that was submitted:

“Regarding robots.txt, should I ‘disallow: /*.css$’, ‘disallow: /php.ini’, or even ‘disallow: /.htaccess’?”

In response, Mueller says Google can’t stop site owners from disallowing those files. Although…


Source link

About search

Check Also

You can't escape it now — Gemini is officially part of Gmail, Google Drive, Docs, Sheets, and Slides – TechRadar

You can't escape it now — Gemini is officially part of Gmail, Google Drive, Docs, Sheets, and Slides – TechRadar

[unable to retrieve full-text content]You can’t escape it now — Gemini is officially part of …

Leave a Reply

Your email address will not be published. Required fields are marked *