Python selenium 屏幕截图无法获取整个页面 [英] Python selenium screen capture not getting whole page
问题描述
我正在尝试创建一个通用的网络爬虫,它将访问一个网站并截取屏幕截图.我正在使用 Python、Selnium 和 PhantomJS.问题是屏幕截图没有捕获页面上的所有图像.例如,如果我去你管,它不会捕捉主页图像下方的图像.(我没有足够高的代表来发布屏幕截图)我认为这可能与动态内容有关,但我尝试了隐式等待和 set_page_load_timeout 方法等等待功能.因为这是一个通用的爬虫,我等不及某个特定的事件(我想爬取数百个站点).
I am trying to create a generic webcrawler that will go to a site and take a screenshot. I am using Python, Selnium, and PhantomJS. The problem is that the screenshot is not capturing all the images on a page. For example, if I go to you tube, it doesn't capture images below the main page image. (I don't have high enough rep to post screen shot) I think this may have something to do with dynamic content, but I have tried the wait functions such as implicitly wait and on set_page_load_timeout methods. Because this is a generic crawler I can't wait for a specific event (I want to crawl hundreds of sites).
是否可以创建一个通用的网络爬虫来执行我想要做的屏幕截图?我使用的代码是:
Is it possible to create a generic webcrawler that can do the screen capture I am trying to do? Code I am using is:
phantom = webdriver.PhantomJS()
phantom.set_page_load_timeout(30)
phantom.get(response.url)
img = phantom.get_screenshot_as_png() #64-bit encoded string
phantom.quit
推荐答案
您的建议解决了问题.使用以下代码(部分从另一个问题的答案中窃取):
Your suggestion solved the problem. Used the following code (stolen in part from answer to another question):
driver = webdriver.PhantomJS()
driver.maximize_window()
driver.get('http://youtube.com')
scheight = .1
while scheight < 9.9:
driver.execute_script("window.scrollTo(0, document.body.scrollHeight/%s);" % scheight)
scheight += .01
driver.save_screenshot('screenshot.png')
这篇关于Python selenium 屏幕截图无法获取整个页面的文章就介绍到这了,希望我们推荐的答案对大家有所帮助,也希望大家多多支持IT屋!