Google Talks About The Robots.txt Directive For One Whole Hour

Aug 26, 2015 - 8:04 am 5 by

GoogleBot

You'd think the robots.txt directive it pretty cut and dry. It hasn't changed much in the past several years, and it is one of the oldest directives in SEO history.

But Google's John Mueller devoted a whole one-hour long sessions on Google+ hangouts for just that topic and shockingly it lasted the whole hour.

Google spent one hour talking about the different ways to use robots.txt. Most of it comes from this help document but it is always nice to be given a live presentation on it.

John's presentation lasted about 25 minutes alone! Then the question and answer session took another 35 minutes or so. So even the most basics of basics, can be dug into in detail.

Listening to some of the questions asked, it does seem that even senior SEOs don't fully understand the differences between robots.txt and meta tags.

You can watch the whole thing here:

Forum discussion at Google+.

 

Popular Categories

The Pulse of the search community

Search Video Recaps

 
- YouTube
Video Details More Videos Subscribe to Videos

Most Recent Articles

Search Forum Recap

Daily Search Forum Recap: February 25, 2025

Feb 25, 2025 - 10:00 am
Bing Search

Microsoft Bing Testing Copilot Search

Feb 25, 2025 - 7:51 am
Google Search Engine Optimization

Google Crawler Update Causing Spikes In Crawling For Some

Feb 25, 2025 - 7:41 am
Google News

Google Sued Over AI Overviews For Hurting Traffic & Revenue

Feb 25, 2025 - 7:31 am
Google

Google Tests AI-Generated Answer Results Open By Default

Feb 25, 2025 - 7:21 am
Google Search Engine Optimization

Google Search Console API Is Delayed

Feb 25, 2025 - 7:11 am
Previous Story: Google Wind Spinners For Nooglers