Skip to content

W
webmagic
Commit b92e6b04 authored by yihua.huang's avatar yihua.huang
Browse files
Options

#400 修复FileCacheQueueScheduler自己设置DuplicateRemover会导致NPE的问题

parent dafd2b77
Show whitespace changes
Inline Side-by-side
Showing with 3 additions and 0 deletions
webmagic-extension/src/main/java/us/codecraft/webmagic/scheduler/FileCacheQueueScheduler.java
View file @ b92e6b04
...@@ -179,6 +179,9 @@ public class FileCacheQueueScheduler extends DuplicateRemovedScheduler implement ...@@ -179,6 +179,9 @@ public class FileCacheQueueScheduler extends DuplicateRemovedScheduler implement
@Override @Override
protected void pushWhenNoDuplicate(Request request, Task task) { protected void pushWhenNoDuplicate(Request request, Task task) {
if (!inited.get()) {
init(task);
}
queue.add(request); queue.add(request);
fileUrlWriter.println(request.getUrl()); fileUrlWriter.println(request.getUrl());
} }
......
Markdown is supported
0% or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment