Google可以抓取301页吗? [英] Can a 301 page be crawled by google?

问题描述

Google或任何其他爬网程序是否有可能对返回301状态代码的页面进行爬网并编制索引?

Is it possible for google or any other crawler to crawl and index a page which returns a 301 status code?

我在google上看到了一个页面，该页面有301个月的历史了.但是，该页面在索引中的缓存日期是几天前的.

I have seen a page in google, which has had a 301 for months. However the cache date of that page in the index is from a few days ago.

Google可以忽略301并抓取页面内容吗?

Can google just ignore the 301 and crawl the contents of a page?

推荐答案

Google始终抓取重定向目标，HTTP 301也不例外.没有比一个员工的讨论帖. Google Search Appliance文档表示相同，但​​我没有看不到为什么GSA和GoogleBot应该以不同的方式处理重定向.

Google always crawls the target of a redirect, HTTP 301 is not an exception. Could not find a better source than one employee's discussion post, though. Google Search Appliance documentation says the same and I don't see why GSA and GoogleBot should handle redirects differently.

这篇关于Google可以抓取301页吗?的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！