Tag Archives: Crawling

Deleting a Sitemap Won’t Stop Us Crawling Your Site

Google’s John Mueller advises site owners that deleting a sitemap won’t prevent URLs from being crawled in the future. This topic is discussed in the latest episode of the Ask Googlebot video series on YouTube. Mueller addresses a question asking if it’s possible to turn off or delete a sitemap from Google Search Console. Deleting a sitemap is possible, and it’s not hard to do either, but if the intention is to stop Googlebot from crawling the URLs then site owners will have to employ a… Source link

Read More »

Google Sends Notifications of HTTP/2 Googlebot Crawling

Google announced that it is sending out notices to let publishers know that Google has begun crawling their websites with the advanced HTTP/2 protocol. The notice is only being sent out to those whose sites have been upgraded. Why HTTP/2 HTTP/2 (also referred to as h2) is a network protocol that servers, browsers and bots can use to transfer data from a server. HTTP/2 is more efficient than the older HTTP/1.1 protocol and is able to transfer data at faster rates the older protocol. The benefit… Source link

Read More »