Skip to content
Projects
Groups
Snippets
Help
Loading...
Help
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
W
webmagic
Project
Project
Details
Activity
Releases
Cycle Analytics
Repository
Repository
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Charts
Issues
0
Issues
0
List
Board
Labels
Milestones
Merge Requests
0
Merge Requests
0
CI / CD
CI / CD
Pipelines
Jobs
Schedules
Charts
Wiki
Wiki
Snippets
Snippets
Members
Members
Collapse sidebar
Close sidebar
Activity
Graph
Charts
Create a new issue
Jobs
Commits
Issue Boards
Open sidebar
沈俊林
webmagic
Commits
e8abc280
Commit
e8abc280
authored
May 20, 2017
by
yihua.huang
Browse files
Options
Browse Files
Download
Email Patches
Plain Diff
#552 add some log when crawler stop
parent
cbf80af5
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
2 additions
and
1 deletion
+2
-1
Spider.java
...agic-core/src/main/java/us/codecraft/webmagic/Spider.java
+2
-1
No files found.
webmagic-core/src/main/java/us/codecraft/webmagic/Spider.java
View file @
e8abc280
...
...
@@ -303,7 +303,7 @@ public class Spider implements Runnable, Task {
public
void
run
()
{
checkRunningStat
();
initComponent
();
logger
.
info
(
"Spider
"
+
getUUID
()
+
" started!"
);
logger
.
info
(
"Spider
{} started!"
,
getUUID
()
);
while
(!
Thread
.
currentThread
().
isInterrupted
()
&&
stat
.
get
()
==
STAT_RUNNING
)
{
final
Request
request
=
scheduler
.
poll
(
this
);
if
(
request
==
null
)
{
...
...
@@ -335,6 +335,7 @@ public class Spider implements Runnable, Task {
if
(
destroyWhenExit
)
{
close
();
}
logger
.
info
(
"Spider {} closed! {} pages downloaded."
,
getUUID
(),
pageCount
.
get
());
}
protected
void
onError
(
Request
request
)
{
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment