-
zhangheng09 authored
这个改动的原因基于两点:1)代理归还给代理池的时机应该是执行完http请求后就要尽早归还 2)http代理应该是HttpClientDownloader该考虑的事,不应该有Spider来处理,Spider并不知道它的downloader是个HttpClientDownloader
6b179c3d
Name |
Last commit
|
Last update |
---|---|---|
.. | ||
downloader | ||
pipeline | ||
processor | ||
proxy | ||
scheduler | ||
selector | ||
thread | ||
utils | ||
Page.java | ||
Request.java | ||
ResultItems.java | ||
Site.java | ||
Spider.java | ||
SpiderListener.java | ||
Task.java | ||
package.html |