Google: Soft 404s Do Waste Crawl Budget

Aug 29, 2022 - 7:21 am 1 by

Google Crawl Budget Ads Organic

Google's Gary Illyes said on the latest Search Off The Record podcast that soft 404s, pages Google thinks are 404s but return a 200 server status code, do waste crawl budget. However, 404s or 410s do not waste crawl budget, Gary added.

This came up at the 26:10 mark in the video where Gary said, "404/410, they don't waste crawl budget." He added, "neither do robotted URLs because we didn't get back anything, just a status code."

But when it comes to soft 404s, he said "if you do with, on the other hand, a soft 404, that's a good job. You're not putting anything in the index and wasted crawl budget."

Hat tip to Glenn Gabe for this:

Forum discussion at Twitter.

 

Popular Categories

The Pulse of the search community

Search Video Recaps

 
Video Details More Videos Subscribe to Videos

Most Recent Articles

Search Forum Recap

Daily Search Forum Recap: January 20, 2025

Jan 20, 2025 - 10:00 am
Google Ads

Google Ads Weekly Spend Fluctuations Often Due To Market Conditions Or Budget Changes

Jan 20, 2025 - 7:51 am
Google Ads

Google Ads PMax Search Terms Insights Gains Source Data

Jan 20, 2025 - 7:41 am
Google

Google Search Trending Products Carousel On Right Side

Jan 20, 2025 - 7:31 am
Google Search Engine Optimization

Google Search Quality Analyst Detects & Treats AI-Generated Content

Jan 20, 2025 - 7:21 am
Google Search Engine Optimization

Google: Don't Dynamically Update Robots.txt File Multiple Times Per Day

Jan 20, 2025 - 7:11 am
Previous Story: Google: Adding Video Structured Data Won't Make Your Video More Prominent