BingBot Hiding User Agent?

Dec 20, 2011 - 8:39 am 1 by
Filed Under Bing SEO

BingBotA WebmasterWorld thread has one webmaster complaining that Microsoft is hiding the user agent for the spider, BingBot.

The webmaster said:

I'm not really sure if this is regular practice with MSN (Bing) or not. Since a few weeks back, they've been spidering my website without a proper User Agent (meaning their UA does NOT say anything about bingbot. It's just a regular browser UA). This happens from three different IP ranges. Yes, I've checked thoroughly and the IP rangers are registered under MSN.

I doubt this is manual review, since it doesn't look at all as normal human behavior.

Did they officially stop declaring their bots in User Agent strings?

So either Microsoft has a weird bug, someone is spoofing the crawler in a weird way or Microsoft is doing this on purpose?

I should note, I did not check my log files to verify this on my sites. So I am going with "zerillos" post and with no back up evidence.

However, Microsoft is known for their crawling issues. Most recently, crawling too hard, updating IPs and many more. BingBot is pretty new, coming to us just over a year ago.

Forum discussion at WebmasterWorld.

 

Popular Categories

The Pulse of the search community

Search Video Recaps

 
- YouTube
Video Details More Videos Subscribe to Videos

Most Recent Articles

Search Forum Recap

Daily Search Forum Recap: April 25, 2025

Apr 25, 2025 - 10:00 am
Search Video Recaps

Search News Buzz Video Recap: Google Earnings Report, Ranking Volatility, AI Overviews Harm Clicks, Search Ads Grow & More

Apr 25, 2025 - 8:01 am
Google Search Engine Optimization

Google: Image Streaming Is Not SEO Friendly

Apr 25, 2025 - 7:51 am
Google

Google Mobile Tests Search Snippet With Blue URL & URL / Site Name Switch

Apr 25, 2025 - 7:41 am
Bing Ads

Microsoft Advertising Suspends Client Connection Requests Temporarily

Apr 25, 2025 - 7:31 am
Google

Google Search Behind The Music Generative AI Section

Apr 25, 2025 - 7:21 am
Previous Story: IE Error With Google AdWords Billing Tab