HEAD请求接收到"403禁止".而获得"200 ok"? [英] HEAD request receives "403 forbidden" while GET "200 ok"?
问题描述
几个月后，每个主要搜索引擎的网站都从搜索结果中消失了，我终于找到了可能的原因.
after several months having the site disappear from search results in every major search engine, I finally found out a possible reason.
我使用WebBug调查服务器标头.查看请求是HEAD还是GET的区别.
I used WebBug to investigate server header. See the difference if the request is HEAD or GET.
HEAD发送的数据:
HEAD / HTTP/1.1
Host: www.attu.it
Connection: close
Accept: */*
User-Agent: WebBug/5.0
HEAD收到的数据:
HTTP/1.1 403 Forbidden
Date: Tue, 10 Aug 2010 23:01:00 GMT
Server: Apache/2.2
Connection: close
Content-Type: text/html; charset=iso-8859-1
获取已发送的数据:
GET / HTTP/1.1
Host: www.attu.it
Connection: close
Accept: */*
User-Agent: WebBug/5.0
获取接收到的数据:
HTTP/1.1 200 OK
Date: Tue, 10 Aug 2010 23:06:15 GMT
Server: Apache/2.2
Last-Modified: Fri, 08 Jan 2010 08:58:01 GMT
ETag: "671f91b-2d2-47ca362815840"
Accept-Ranges: bytes
Content-Length: 722
Connection: close
Content-Type: text/html
// HTML code here
现在，默认情况下，浏览器会发送GET请求(至少这是Firebug所说的).搜寻器是否有可能发送HEAD请求呢?如果是这样，为什么仅此服务器以403响应，而我正在维护的其他站点的其他服务器却没有响应?
Now, browsers by default send a GET request (at least this is what firebug says). Is it possible that crawlers send a HEAD request instead? If so, why only this server responds with a 403, while other servers from other sites I'm mantaining do not?
如果很重要，.htaccess中唯一的一行是(除非我的客户端更改了它，因为他们不想让我访问他们的服务器)
In case it's important, the only line present in .htaccess is (unless my client changed it, as they don't want to give me access to their server)
AddType text/x-component .htc
更新
谢谢@Ryk. FireBug和Fiddler都发送GET请求，该请求获得200(或300)个响应.如预期的那样.因此，我想这可能是服务器设置错误(尽管这很奇怪，因为托管来自拥有数百万客户的大型公司)，或者它们放置在.htaccess文件中.他们将不得不让我调查他们的帐户.
UPDATE
Thanks @Ryk. FireBug and Fiddler both send GET requests, which get 200 (or 300) responses. As expected. So I guess it's either a server bad setting (even though it's strange as the hosting is from a major company with millions of clients) or something they put in the .htaccess. They will have to let me look into their account.
我的问题的第二部分是，是否可能是该网站未出现在任何搜索引擎中的原因( site:www.attu.it 没有给出结果).有什么想法吗?
The second part of my question was if that could be the cause of the website not appearing in any search engine (site:www.attu.it gives no results). Any thought?
更新2
经过一番摆弄之后，结果发现根目录中存在phpMyAdmin robots-blocking .htaccess，导致来自机器人的任何请求都被发送回了403 Forbidden
UPDATE 2
After some fiddling around, it turns out there was the phpMyAdmin robots-blocking .htaccess in the root directory, that caused any request from robots to be sent back with a 403 Forbidden
推荐答案
我建议安装Fiddler并仔细查看请求.有时我看到页面上需要身份验证的文件夹中的图标导致返回403.
I would suggest installing Fiddler and looking carefully at the request. I have seen sometimes that an icon on the page that is in a folder that requires authentication causes a 403 to be returned.
Fiddler将为您提供一个好主意，您也可以尝试使用Firefox并安装FireBug附加组件并检查页面中的错误.
Fiddler will give you a good idea, and you can also try Firefox and install FireBug add-on and inspecting the page for errors.
在该站点上，我找到了大量的favicon.ico 404，但是当我执行简单的GET请求时，我得到了200 OK，但是当我执行HEAD时，我也得到了403.现在进入它.
Looking at the site I get a bunch of 404's for the favicon.ico, but apart from that when I do a simple GET request I get a 200 OK, but when I do a HEAD, I also get a 403. Looking into it now.
更新:我认为这可能是Apache服务器上的配置，但不是100％肯定. http://hc.apache.org/httpclient-3.x/methods/head.html
UPDATE: I think it might be a configuration on the Apache server, but not 100% sure. http://hc.apache.org/httpclient-3.x/methods/head.html
UPDATE2:阅读此 http ://www.pubbs.net/200811/httpd/17210-usershttpd-how-to-reject-head-request.html 使我相信可以将您的Apache服务器设置为拒绝HEAD请求.在这种情况下，它将返回403.
UPDATE2: Reading this http://www.pubbs.net/200811/httpd/17210-usershttpd-how-to-reject-head-request.html makes me believe that your Apache server could be set to reject HEAD requests. In that case it will return a 403.
这篇关于HEAD请求接收到"403禁止".而获得"200 ok"?的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！
