urllib.request.urlopen(url) 带身份验证 [英] urllib.request.urlopen(url) with Authentication
本文介绍了urllib.request.urlopen(url) 带身份验证的处理方法,对大家解决问题具有一定的参考价值,需要的朋友们下面随着小编来一起学习吧!
问题描述
这几天我一直在玩漂亮的汤和解析网页.我一直在使用一行代码,它在我编写的所有脚本中都是我的救星.代码行是:
I've been playing with beautiful soup and parsing web pages for a few days. I have been using a line of code which has been my saviour in all the scripts that I write. The line of code is :
r = requests.get('some_url', auth=('my_username', 'my_password')).
但是……
我想用(OPEN A URL WITH AUTHENTICATION)做同样的事情:
I want to do the same thing with (OPEN A URL WITH AUTHENTICATION):
(1) sauce = urllib.request.urlopen(url).read() (1)
(2) soup = bs.BeautifulSoup(sauce,"html.parser") (2)
我无法打开网址并阅读需要身份验证的网页.我如何实现这样的目标:
I'm not able to open a url and read, the webpage which needs authentication. How do I achieve something like this :
(3) sauce = urllib.request.urlopen(url, auth=(username, password)).read() (3)
instead of (1)
推荐答案
查看 如何使用 urllib 包获取 Internet 资源 来自官方文档:
Have a look at the HOWTO Fetch Internet Resources Using The urllib Package from the official docs:
# create a password manager
password_mgr = urllib.request.HTTPPasswordMgrWithDefaultRealm()
# Add the username and password.
# If we knew the realm, we could use it instead of None.
top_level_url = "http://example.com/foo/"
password_mgr.add_password(None, top_level_url, username, password)
handler = urllib.request.HTTPBasicAuthHandler(password_mgr)
# create "opener" (OpenerDirector instance)
opener = urllib.request.build_opener(handler)
# use the opener to fetch a URL
opener.open(a_url)
# Install the opener.
# Now all calls to urllib.request.urlopen use our opener.
urllib.request.install_opener(opener)
这篇关于urllib.request.urlopen(url) 带身份验证的文章就介绍到这了,希望我们推荐的答案对大家有所帮助,也希望大家多多支持IT屋!
查看全文