Google's Matt Cutts: Bing It On Challenge Was Obviously Flawed

Oct 2, 2013 - 8:53 am 59 by
Filed Under Bing Search

Bing It On ChallengeA little over a year ago, Microsoft launched this campaign named the Bing It On Challenge, which was basically a blind-search taste test pinning Bing against Google, while removing the branding.

Ian from Freakonomics reports that the challenge was not just a "little fishy" but he feels Google may have an "deceptive advertising claim against Microsoft." He details why in his post at Freakonomics.

Matt Cutts, Google's head of search spam, shared this on Google+ and added some more color to his own thoughts on this challenge.

I have to admit that I never bothered to debunk the Bing It On challenge, because the flaws (small sample size; bias in query selection; stripping out features of Google like geolocation, personalization, and Knowledge Graph; wording of the site; selective rematches) were pretty obvious.

It is funny, because when I posted a poll on Who Won In Bing It On Challenge? 60%+ said Google won.

Anyway, well worth a read when you have time.

Forum discussion at Google+.

Update: Here is a statement from Microsoft PR, and also make sure to check out this comment from Microsoft's Matt Wallaert.

The professor’s analysis is flawed and based on an incomplete understanding of both the claims and the Challenge. The Bing It On claim is 100% accurate and we’re glad to see we’ve nudged Google into improving their results. Bing it On is intended to be a lightweight way to challenge peoples’ assumptions about which search engine actually provides the best results. Given our share gains, it’s clear that people are recognizing our quality and unique approach to what has been a relatively static space dominated by a single service. - Attributable to Matt Wallaert, Behavioral Scientist, Bing

 

Popular Categories

The Pulse of the search community

Search Video Recaps

 
Video Details More Videos Subscribe to Videos

Most Recent Articles

Search Forum Recap

Daily Search Forum Recap: March 31, 2025

Mar 31, 2025 - 10:00 am
Google Updates

Google March 2025 Core Update Impact Multiple Poll Results

Mar 31, 2025 - 7:51 am
Google News

Google To Pay $100 Million To Settle Old Ad Lawsuit On Clicks Outside Geo Target

Mar 31, 2025 - 7:41 am
Google Ads

Google To Allow Double Serving Ads In Different Ad Locations On Same Page

Mar 31, 2025 - 7:31 am
Google Search Engine Optimization

Google News Fully Transitioned To Automatically Generated Publication Pages

Mar 31, 2025 - 7:21 am
Google Maps

Google Business Profiles Bug Resurfacing Old Fake Removed Reviews

Mar 31, 2025 - 7:11 am
Previous Story: Here Come The White Google Navigation Bar Complaints...