Jsoup SocketTimeoutException:读取超时 [英] Jsoup SocketTimeoutException: Read timed out

问题描述

当我尝试使用Jsoup解析许多HTML文档时，我得到一个SocketTimeoutException.

I get a SocketTimeoutException when I try to parse a lot of HTML documents using Jsoup.

例如，我有一个链接列表:

For example, I got a list of links :

<a href="www.domain.com/url1.html">link1</a>
<a href="www.domain.com/url2.html">link2</a>
<a href="www.domain.com/url3.html">link3</a>
<a href="www.domain.com/url4.html">link4</a>

对于每个链接，我都会解析链接到URL的文档(来自href属性)，以获取这些页面中的其他信息.

For each link, I parse the document linked to the URL (from the href attribute) to get other pieces of information in those pages.

所以我可以想象这会花费很多时间，但是如何关闭此异常，这是整个堆栈跟踪:

So I can imagine that it takes lot of time, but how to shut off this exception Here is the whole stack trace:

java.net.SocketTimeoutException: Read timed out
    at java.net.SocketInputStream.socketRead0(Native Method)
    at java.net.SocketInputStream.read(Unknown Source)
    at java.io.BufferedInputStream.fill(Unknown Source)
    at java.io.BufferedInputStream.read1(Unknown Source)
    at java.io.BufferedInputStream.read(Unknown Source)
    at sun.net.www.http.HttpClient.parseHTTPHeader(Unknown Source)
    at sun.net.www.http.HttpClient.parseHTTP(Unknown Source)
    at sun.net.www.protocol.http.HttpURLConnection.getInputStream(Unknown Source)
    at java.net.HttpURLConnection.getResponseCode(Unknown Source)
    at org.jsoup.helper.HttpConnection$Response.execute(HttpConnection.java:381)
    at org.jsoup.helper.HttpConnection$Response.execute(HttpConnection.java:364)
    at org.jsoup.helper.HttpConnection.execute(HttpConnection.java:143)
    at org.jsoup.helper.HttpConnection.get(HttpConnection.java:132)
    at app.ForumCrawler.crawl(ForumCrawler.java:50)
    at Main.main(Main.java:15)

推荐答案

我认为你可以做到

Jsoup.connect("...").timeout(10 * 1000).get(); 

将超时设置为10秒.

这篇关于Jsoup SocketTimeoutException:读取超时的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！