如何从网页中解析动态内容? [英] How can I parse dynamic content from a web page?
本文介绍了如何从网页中解析动态内容?的处理方法,对大家解决问题具有一定的参考价值,需要的朋友们下面随着小编来一起学习吧!
问题描述
我尝试从此网址获取代理列表:
I try to get a proxy list from this url:
这很酷,但端口号是动态JavaScript内容。如何从此页面获取JavaScript生成的内容?我有jsoup和djNativeSwing,但我想在后台线程中执行此操作。
This would be cool, but port number is dynamic JavaScript content. How can I get JavaScript-generated content from this page? I have jsoup and djNativeSwing but I want do this in background thread.
JWebBrowser webBrowser = new JWebBrowser();
webBrowser.navigate("http://spys.ru/en/free-proxy-list/");
System.out.println(webBrowser.getHTMLContent());
此代码返回Null结果。请帮助。
this code returns a Null result. Help please.
推荐答案
当你调用getHtmlContent()方法时,webbrowser还没有完成加载。改为使用类似的东西:
The webbrowser hasn't finnished loading when you call the getHtmlContent() method. Use something like this instead:
JWebBrowser webBrowser = new JWebBrowser();
webBrowser.navigate("http://spys.ru/en/free-proxy-list/");
webBrowser.addWebBrowserListener(new WebBrowserListener(){
public void loadingProgressChanged(WebBrowserEvent e){
if(e.getWebBrowser().getLoadingProgress()==100)
System.out.println(webBrowser.getHTMLContent());
}
}
/* Note: I wrote this in the comment field without any testing,
you probably have to make the webBrowser final. */
JavaDocs 是你的朋友!
这篇关于如何从网页中解析动态内容?的文章就介绍到这了,希望我们推荐的答案对大家有所帮助,也希望大家多多支持IT屋!
查看全文