Commit 0336f4cd authored by yihua.huang's avatar yihua.huang

remove IllegalStateException when download error for less error log

parent 4738ae2d
......@@ -401,7 +401,7 @@ public class Spider implements Runnable, Task {
Page page = downloader.download(request, this);
if (page == null) {
sleep(site.getSleepTime());
throw new IllegalStateException("download error");
onError(request);
}
// for cycle retry
if (page.isNeedCycleRetry()) {
......
Markdown is supported
0% or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment