Daily Search Forum Recap: July 2, 2019

Jul 2, 2019 - 4:00 pm 0 by

Here is a recap of what happened in the search forums today, through the eyes of the Search Engine Roundtable and other search forums on the web.

Search Engine Roundtable Stories:

  • Google To Drop Any Support For crawl-delay, nofollow, and noindex in robots.txt
    Google posted this morning that they are going to stop unofficially supporting the noindex, nofollow and crawl-delay directives within robots.txt files. Google has been saying this for years actually and hinted this was coming really soon and now it is here.
  • Google Image Search Tests Sticky Image Preview Box
    Google is testing, I believe, another image search design, this time with making the image preview box a sticky box on the right side panel. Google has been testing many variations of these image preview boxes in search for some time but this one is bolder because it sticks.
  • List Of All The GoogleBot Robots.txt Specifications Changes
    With Google aiming to make the robots.txt exclusion protocol a standard, they proposed some changes and submitted them the other day. Now, Google updated their own developer docs around the robots.txt specification to match. Here is a list of what has changed.
  • Google Shares Its Robots.txt Parser Code With Open Source World
    Google announced yesterday as part of its efforts to standardizing the robots exclusion protocol that it is open sourcing its robots.txt parser. That means how GoogleBot reads and listens to robots.txt files will be available for any crawler or coder to look at or use.
  • Search Google For Fireworks & Get A Fireworks Show
    Go to Google.com and search for [fireworks] on desktop or mobile and you will see Google light up the search results page with a fireworks display.
  • Robots.txt Birthday Cake With Martijn Koster At Google
    Here is a photo of the inventor of the robots.txt specification at Google (I think) with a robots.txt 25 years old birthday cake. Next to the cake is the revised proposed specification for the robots

Other Great Search Forum Threads:

Search Engine Land Stories:

Other Great Search Stories:

Analytics

Industry & Business

Links & Promotion Building

Local & Maps

Mobile & Voice

SEO

PPC

Search Features

Other Search

 

Popular Categories

The Pulse of the search community

Search Video Recaps

 
- YouTube
Video Details More Videos Subscribe to Videos

Most Recent Articles

Search Forum Recap

Daily Search Forum Recap: April 18, 2025

Apr 18, 2025 - 10:00 am
Search Video Recaps

Search News Buzz Video Recap: Google Ruled A Monopoly Again, Heated Volatility, Google ccTLD Change, Ads Safety Report & AI Overviews

Apr 18, 2025 - 8:01 am
Google

Google Made Search Much Faster - But How Much Faster?

Apr 18, 2025 - 7:51 am
Google Ads

New Google Merchant Center Popular Products Report

Apr 18, 2025 - 7:41 am
Google Search Engine Optimization

Google: No Positive SEO Effect From .esports Domain

Apr 18, 2025 - 7:31 am
Google Ads

Google Ads PMax Age Exclusions Rolling Out

Apr 18, 2025 - 7:21 am
Previous Story: Google To Drop Any Support For crawl-delay, nofollow, and noindex in robots.txt