URLs in Yahoo & MSN Are Not Complete...

Feb 24, 2004 - 9:39 pm 0 by
Filed Under Yahoo News

While working on a little project that made a site completely database driven, I realized that Yahoo and MSN incorrectly strip off trailing slashes in URLs (because I started seeing 404 page not found errors in my web logs).

For example, the URL http://www.domain.com/directory/ is linked to as http://www.domain.com/directory from both MSN and Yahoo.

This is bad for two reasons... first of all, it's just plain wrong, the two URLs could in theory be separate documents. Second, it's a waste of bandwidth. Most web servers are configured to add a slash to the end of a URL if there is no file that matches the name, and there *is* a directory with that name via a HTTP redirect. So now, the end user's browser needs to make two requests to the server to get one document.

The reason I figured it out is I *had* directories at one point, but moved to dynamic, database driven content. So the web server wasn't redirecting them with the wrong URL because there was not a directory with that name any longer.

Bad MSN, bad Yahoo... Naughty, boys.

 

Popular Categories

The Pulse of the search community

Search Video Recaps

 
- YouTube
Video Details More Videos Subscribe to Videos

Most Recent Articles

Search Forum Recap

Daily Search Forum Recap: December 17, 2024

Dec 17, 2024 - 10:00 am
Google Search Engine Optimization

Google Site Reputation Abuse: Treating Some Sites Within A Site

Dec 17, 2024 - 7:51 am
Google Search Engine Optimization

Google: Disavowing Toxic Links Is A Billable Waste Of Time

Dec 17, 2024 - 7:41 am
Google Search Engine Optimization

Google Adds Faceted Navigation To Help Documentation

Dec 17, 2024 - 7:31 am
Google Ads

New Google Merchant Center Promotion For First Order Discount

Dec 17, 2024 - 7:21 am
Other Search Engines

OpenAI Opens ChatGPT Search To All Logged In Users

Dec 17, 2024 - 7:11 am
Previous Story: Coming Soon at the Search Engine Roundtable