Glenn Gabe noted that he is seeing some weird Google Googlebot activity recently, saying he is seeing "crawling spike across a number of sites" that started on January 12th through January 13th. I then checked some of the properties and noticed that on some, not most, I see the same.
So to be clear, this is not across all sites, in fact, it seems to be on less than 10% of the properties I personally have access to. But it is unusual behavior from Google. You may see this happen on a site here and there, espesially if there are large technical changes to the site. But normally you would not see it when there are not big changes like this.
Here is one of the screenshots Glenn shared on Twitter:
Glenn Gabe added "For most of the spikes, they fall under "Refresh" vs. "Discovery", which makes sense... but still worth noting. Both Smartphone & Desktop spike for some."
Others are seeing it also:
And just to clarify, I'm not saying this is a *bad* thing. Just interesting to see massive spikes in crawling on a number of sites all starting on the same day. :) Would be interesting to hear if Google implemented any changes there from a crawling perspective.
— Glenn Gabe (@glenngabe) January 18, 2022
saw this for a minority of properties I have access to, but yes, super weird pic.twitter.com/9SQqGtWTJ6
— Barry Schwartz (@rustybrick) January 18, 2022
I noticed that too. Interestingly (and somewhat underlated) for one site I noticed 25% of Googlebot type was 'Page resource load'. I've never seen it higher that 8%, usually around 3% - 4%. Any idea why that may be so high Glenn? pic.twitter.com/BBOKeb8Odq
— Chris Ainsworth (@chrisains) January 18, 2022
You can check your crawl stats report over here and let us know if you saw this spike as well?
Just a heads up, Google said that large crawl rate increases is not related to algorithm updates, although, sometimes it might be - maybe.
Forum discussion at Twitter.
Update: January 21st, seems like the spike is over?
Following up on "The Great Crawl Spike of Jan 2022", I'm seeing crawl requests drop heavily, back down to normal levels across sites that were affected. So, if this happened for your site, check your stats today. I hope we hear from Google about what this was about. Stay tuned. pic.twitter.com/SzCJ2YR3zO
— Glenn Gabe (@glenngabe) January 21, 2022
Update: January 24th, we are spiking again?
Heads-up, "The Great Crawl Spike of Jan 2022" is NOT done. After dropping back down to normal for a brief time, I'm seeing it spike once again. Not sure what is going on, but either Googlebot is on overload or there's a reporting glitch... Stay tuned. pic.twitter.com/whOgsrqMmQ
— Glenn Gabe (@glenngabe) January 24, 2022
