1.1K Star 3.6K Fork 1.4K

GVP黄亿华 / webmagic

抓取速度太慢了,不知道问题再哪里?

Backlog
奋斗的驴  Opened this issue

PageProcessor中的process的Page的数据已经解析完毕,已经结束了,但是爬虫的线程迟迟没有关闭,导致 Spider spider = Spider.create(pageProcessor);
ResultItems resultItems = spider.get(urlNameBuilder.toString());
一直等待,基本都要4秒左右,不知道是哪里的问题

total 1 participants

Comments (0)

Sign in to comment

Assignees
Labels
Not set
Projects
Milestones
Branches
Planed to start
Not set
Planed to end
Not set
Top level
Priority
Java
1
https://gitee.com/flashsword20/webmagic.git
git@gitee.com:flashsword20/webmagic.git
flashsword20
webmagic
webmagic

Search