The design of webmagic with completely modular, functional coverage throughout the reptile life cycle (link extraction, download page, content extraction, persistence), support multi-threaded crawling, distributed crawling, and supports automatic retry, custom UA/cookie and other functions.

webmagic-samples\README.md
.........extension\README.md
.........selenium\README.md
..........axon\README.md
.........core\README.md
.........scripts\README.md
README.md
webmagic-core\src\test\resources\html\mock-github.html
.........extension\src\test\resources\html\mock-github.html
..................\...\....\.........\....\mock-webmagic.html
.........core\src\main\java\us\codecraft\webmagic\scheduler\component\package.html
.............\...\....\....\..\.........\........\utils\package.html
.........extension\src\main\java\us\codecraft\webmagic\model\annotation\package.html
.........core\src\main\java\us\codecraft\webmagic\scheduler\package.html
.........extension\src\main\java\us\codecraft\webmagic\model\package.html
.........core\src\main\java\us\codecraft\webmagic\processor\package.html
.............\...\....\....\..\.........\........\.ipeline\package.html
.............\...\....\....\..\.........\........\package.html
.............\...\....\....\..\.........\........\downloader\package.html
.............\...\....\....\..\.........\........\selector\package.html
.............\...\....\resources\log4j.xml
.............\...\test\resources\log4j.xml
.........extension\src\main\resources\log4j.xml
..................\...\test\resources\log4j.xml
.........scripts\src\main\resources\log4j.xml
................\...\test\resouces\log4j.xml
..........amples\src\main\resources\log4j.xml
.........core\module_webmagic-core.xml
.........samples\pom.xml
..........elenium\pom.xml
.........extension\pom.xml
.........saxon\pom.xml
.........core\pom.xml
.........scripts\pom.xml
pom.xml
webmagic-extension\src\main\resources\spider-config-draft.xml
..................\...\....\.........\crawl.js
.........samples\src\main\resources\crawl.js
..........cripts\src\main\resources\js\defines.js
................\...\....\.........\..\github.js
................\...\....\.........\..\oschina.js
..........elenium\config.ini
.........core\src\main\java\us\codecraft\webmagic\downloader\AbstractDownloader.java
.............\...\....\....\..\.........\........\selector\AbstractSelectable.java
.........extension\src\main\java\us\codecraft\webmagic\model\AfterExtractor.java
.........samples\src\main\java\us\codecraft\webmagic\samples\AlexanderMcqueenGoodsProcessor.java
................\...\....\....\..\.........\........\.......\AmanzonPageProcessor.java
.........core\src\main\java\us\codecraft\webmagic\selector\AndSelector.java
.........samples\src\main\java\us\codecraft\webmagic\samples\AngularJSProcessor.java
.........extension\src\main\java\us\codecraft\webmagic\example\AppStore.java
..................\...\....\....\..\.........\........\.......\BaiduBaike.java
.........core\src\main\java\us\codecraft\webmagic\processor\example\BaiduBaikePageProcessor.java
.........samples\src\main\java\us\codecraft\webmagic\model\samples\BaiduNews.java
.........core\src\main\java\us\codecraft\webmagic\selector\BaseElementSelector.java
.........extension\src\test\java\us\codecraft\webmagic\model\BaseRepo.java
..................\...\main\java\us\codecraft\webmagic\model\formatter\BasicTypeFormatter.java
.........samples\src\main\java\us\codecraft\webmagic\model\samples\Blog.java
.........extension\src\main\java\us\codecraft\webmagic\scheduler\BloomFilterDuplicateRemover.java
..................\...\test\java\us\codecraft\webmagic\scheduler\BloomFilterDuplicateRemoverTest.java
..................\...\main\java\us\codecraft\webmagic\utils\ClassUtils.java
..................\...\....\....\..\.........\........\pipeline\CollectorPageModelPipeline.java
.........core\src\main\java\us\codecraft\webmagic\pipeline\CollectorPipeline.java
.........extension\src\main\java\us\codecraft\webmagic\model\annotation\ComboExtract.java
..................\...\....\....\..\.........\........\handler\CompositePageProcessor.java
..................\...\....\....\..\.........\........\.......\CompositePipeline.java
..................\...\....\....\..\.........\........\configurable\ConfigurablePageProcessor.java
..................\...\test\java\us\codecraft\webmagic\configurable\Configurable

• We are an exchange download platform that only provides communication channels. The downloaded content comes from the internet. Except for download issues, please Google on your own.
• The downloaded content is provided for members to upload. If it unintentionally infringes on your copyright, please contact us.
• Please use Winrar for decompression tools
• If download fail, Try it againg or Feedback to us.
• If downloaded content did not match the introduction, Feedback to us，Confirm and will be refund.
• Before downloading, you can inquire through the uploaded person information

Nothing．