Scrapy:如何打印请求引用 [英] Scrapy:How to print request referrer

问题描述

是否可以从解析函数中的响应对象中获取请求引用?

Is it possible to get the request referrer from the response object in parse function?

10 倍

推荐答案

HTTP Referer 字段由 HTTP 客户端在请求头中设置，不在响应头中，如这个标头告诉服务器客户端从哪里到当前页面.

HTTP Referer field is set up by HTTP client in request headers, not in response headers, as this header tells server where did client come from to current page.

在响应中收到 http Referer 标头会很奇怪.

It would be rather weird to receive http Referer header in response.

但是当谈到 scrapy 时，在响应的 request<中有一个对 Request 对象的引用，在该对象上生成了 Response/code> 字段，所以下一个调用结果:

But when talking about scrapy, there's a reference to Request object on which the Response was generated, in response's request field, so the next call result:

response.request.headers.get('Referer', None)

可以包含 Referer 标头，如果它是在发出请求时设置的.

can contain Referer header if it was set when making request.

这篇关于Scrapy:如何打印请求引用的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！