Google: You Can Use A Single Robots.txt For All Your International Sites

Dec 22, 2022 - 7:31 am 0 by

Google Sad Robot

Gary Illyes from Google said on LinkedIn that if you want to you can use a single robots.txt file for all your international sites. He added that he is not saying this is a good idea, but rather, technically, you can implement your robots.txt this way.

Gary wrote, "Technically you could have a single central robots.txt for all your international sites (de.example, ch.example, at.example, etc.) that's hosted on your CDN (cdn.example/robots.txt)."

Although, Gary later added, "Not saying it's a good idea, or bad for that matter, just that it's possible."

Now, Ohgm wrote about this several years ago over here if you want a more detailed technical walkthrough.

But this is just another SEO PSA from Gary.

Forum discussion at LinkedIn.

 

Popular Categories

The Pulse of the search community

Follow

Search Video Recaps

 
- YouTube
Video Details More Videos Subscribe to Videos

Most Recent Articles

Search Forum Recap

Daily Search Forum Recap: November 15, 2024

Nov 15, 2024 - 10:00 am
Search Video Recaps

Search News Buzz Video Recap: Google November 2024 Core Update, AI Overview Hyperlinks, SEO, Ads, AdSense & More

Nov 15, 2024 - 8:01 am
Google Maps

Google Maps Search For Products Nearby Carousel

Nov 15, 2024 - 7:51 am
Google

iPhone Gets Native Google Gemini App

Nov 15, 2024 - 7:41 am
Google

Google Chrome To Spotlight Merchant Center Promotions

Nov 15, 2024 - 7:31 am
Google

Google Search AI Sales Assistant

Nov 15, 2024 - 7:21 am
Previous Story: Bing Will Fully Switch To The New BingBot User Agent In Early January