Google Updates Search Help Docs For Robots.txt & Structured Data

Jun 21, 2021 - 7:11 am 0 by

Google Documentation

Google has released several updates to both the robots.txt documentation and the structured data documentation last Friday. Here is a list of those changes from Google's site.

  • Simplified the introduction page to make it clearer what is robots.txt and what is its intended use.
  • Expanded the instructions about creating and updating robots.txt files.
  • Removed redundant sections from our documentation about how Google handles robots.txt.
  • Simplified sentences across all robots.txt documentation in English. This helps with localization.
  • Removed redundant documentation about how to build, test, and release structured data. Each feature has guidance about this, embedded directly into each guide (for example, the Video structured data guide.
  • Improved the troubleshooting sections across all structured data feature guides (for example, the Product structure data guide.
  • Added more beginner-friendly information about how to get started with structured data.

Here is some clarity on why Google made the changes from Lizzi Harvey and Gary Illyes of Google:

Insane, people sent in 148 comments that the both of them used to revise the robots.txt documents. Lizzi added that they also ended up "fixing issues across 20+ structured data docs."

Forum discussion at Twitter.

 

Popular Categories

The Pulse of the search community

Search Video Recaps

 
- YouTube
Video Details More Videos Subscribe to Videos

Most Recent Articles

Google News

Judge: Google Illegally Engaged In Anticompetitive Monopolistic Ad Tech Practices

Apr 17, 2025 - 11:35 am
Search Forum Recap

Daily Search Forum Recap: April 17, 2025

Apr 17, 2025 - 10:00 am
Google Ads

Google Ads Personalized Boost Ad Performance Email

Apr 17, 2025 - 7:51 am
Google Ads

Google Ads API Version 19.1 Now Available

Apr 17, 2025 - 7:41 am
Google Search Engine Optimization

Google: Nothing Has Changed With International SEO with ccTLD Change

Apr 17, 2025 - 7:31 am
Google

Google Tests Video Player To Shopping / E-Commerce Card

Apr 17, 2025 - 7:21 am
Previous Story: DuckDuckGo Advertisements Even In The Airports