快捷導(dǎo)航

java使用Jsoup連接網(wǎng)站超時的解決方法

更新時間：2013年11月20日 11:36:10 作者：

jsoup是一個非常好的解析網(wǎng)頁的包，用java開發(fā)的，提供了類似DOM，CSS選擇器的方式來查找和提取文檔中的內(nèi)容,提取文檔內(nèi)容時會出現(xiàn)超時的情況，解決方法可看下文

今天做了一個Jsoup解析網(wǎng)站的項目，使用Jsoup.connect(url).get()連接某網(wǎng)站時偶爾會出現(xiàn)
java.net.SocketTimeoutException:Read timed out異常。
原因是默認(rèn)的Socket的延時比較短，而有些網(wǎng)站的響應(yīng)速度比較慢，
所以會發(fā)生超時的情況。

解決方法：

鏈接的時候設(shè)定超時時間即可。
doc = Jsoup.connect(url).timeout(5000).get();
5000表示延時時間設(shè)置為5s。

測試代碼如下：
1，不設(shè)定timeout時：

復(fù)制代碼代碼如下:

package jsoupTest;

import java.io.IOException;

import org.jsoup.*;
import org.jsoup.helper.Validate;
import org.jsoup.nodes.Document;
import org.jsoup.nodes.Element;
import org.jsoup.select.Elements;

public class JsoupTest {
public static void main(String[] args) throws IOException{
String url = "http://www.dbjr.com.cn";
long start = System.currentTimeMillis();
Document doc=null;
try{
  doc = Jsoup.connect(url).get();
}
catch(Exception e){
  e.printStackTrace();
}
finally{
  System.out.println("Time is:"+(System.currentTimeMillis()-start) + "ms");
}
Elements elem = doc.getElementsByTag("Title");
System.out.println("Title is:" +elem.text());
}
}

有時發(fā)生超時：
java.net.SocketTimeoutException: Read timed out
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.read(Unknown Source)
at java.net.SocketInputStream.read(Unknown Source)
at java.io.BufferedInputStream.fill(Unknown Source)
at java.io.BufferedInputStream.read1(Unknown Source)
at java.io.BufferedInputStream.read(Unknown Source)
at sun.net.www.http.ChunkedInputStream.fastRead(Unknown Source)
at sun.net.www.http.ChunkedInputStream.read(Unknown Source)
at java.io.FilterInputStream.read(Unknown Source)
at sun.net.www.protocol.http.HttpURLConnection$HttpInputStream.read(Unknown Source)
at java.util.zip.InflaterInputStream.fill(Unknown Source)
at java.util.zip.InflaterInputStream.read(Unknown Source)
at java.util.zip.GZIPInputStream.read(Unknown Source)
at java.io.BufferedInputStream.read1(Unknown Source)
at java.io.BufferedInputStream.read(Unknown Source)
at java.io.FilterInputStream.read(Unknown Source)
at org.jsoup.helper.DataUtil.readToByteBuffer(DataUtil.java:113)
at org.jsoup.helper.HttpConnection$Response.execute(HttpConnection.java:447)
at org.jsoup.helper.HttpConnection$Response.execute(HttpConnection.java:393)
at org.jsoup.helper.HttpConnection.execute(HttpConnection.java:159)
at org.jsoup.helper.HttpConnection.get(HttpConnection.java:148)
at jsoupTest.JsoupTest.main(JsoupTest.java:17)
Time is:3885ms
Exception in thread "main" java.lang.NullPointerException
at jsoupTest.JsoupTest.main(JsoupTest.java:25)

2 設(shè)定了則一般不會超時

復(fù)制代碼代碼如下:

package jsoupTest;

import java.io.IOException;

import org.jsoup.*;
import org.jsoup.helper.Validate;
import org.jsoup.nodes.Document;
import org.jsoup.nodes.Element;
import org.jsoup.select.Elements;

public class JsoupTest {
public static void main(String[] args) throws IOException{
String url = "http://www.dbjr.com.cn";
long start = System.currentTimeMillis();
Document doc=null;
try{
  doc = Jsoup.connect(url).timeout(5000).get();
}
catch(Exception e){
  e.printStackTrace();
}
finally{
  System.out.println("Time is:"+(System.currentTimeMillis()-start) + "ms");
}
Elements elem = doc.getElementsByTag("Title");
System.out.println("Title is:" +elem.text());
}
}