设置机械化以接受Cookie [英] Set Mechanize to accept cookies

问题描述

我正在尝试使用机械化从网站上检索一些数据，以自动搜索住宅(无垃圾邮件)

I am trying to use mechanize to retrieve some data from a website to automatize searching for a flat (no spamming)

但是，当我向网站发送请求时，响应具有以下标头:

However, when I send a request to the site, the response has the following headers:

header: Cache-Control: no-store, no-cache, max-age=0, must-revalidate, private,  max-     stale=0, post-check=0, pre-check=0
header: Content-Type: text/html
header: P3P: CP="ALL IND DSP COR ADM CONo CUR CUSo IVAo IVDo PSA PSD TAI TELo OUR SAMo CNT COM INT NAV ONL PHY PRE PUR UNI"
header: Date: Mon, 16 Jun 2014 19:13:23 GMT
header: Connection: close
header: Set-Cookie: SPSI=1f5cf9461ca8ab1ee7f4d427ce1c895b ; path=/
header: Content-Length: 10965

，响应文本中写着您必须启用Cookie" 如何用机械化模拟它? 这样做似乎不起作用:

and the response text says something along the lines "you must enable cookies" How can I simulate that with mechanize? Doing this doesnt seem to work:

br = mechanize.Browser()
# Cookie Jar
cj = cookielib.LWPCookieJar()
br.set_cookiejar(cj)

仅供参考，我将机械化为0.2.5.如果无法解决问题，我正在考虑硒.

FYI, I have mechanize 0.2.5. If this doesn't work out, I am considering Selenium.

推荐答案

我遇到了同样的问题.添加这些浏览器选项.从这里开始: http://stockrt.github.io /p/emulation-a-browser-in-python-with-mechanize/

I had the same problem. Add these browser options. From here: http://stockrt.github.io/p/emulating-a-browser-in-python-with-mechanize/

 # Browser options
 br.set_handle_equiv(True)
 br.set_handle_gzip(True)
 br.set_handle_redirect(True)
 br.set_handle_referer(True)
 br.set_handle_robots(False)

 # Follows refresh 0 but not hangs on refresh > 0
 br.set_handle_refresh(mechanize._http.HTTPRefreshProcessor(), max_time=1)

我还建议使用调试消息

 # Want debugging messages?
 #br.set_debug_http(True)
 #br.set_debug_redirects(True)
 #br.set_debug_responses(True)

这篇关于设置机械化以接受Cookie的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！