Using a web crawler written in C#. Users can set the number of threads, thread waiting time, connection time, crawling file types can be Type and priority, the download directory and other parameters, access network, URL, download the data to be stored in the database.

NWebCrawler\bin\config.ini
...........\...\download\0003be8238c8302e17c799d9f5d65876.gif
...........\...\........\00db5534b8261de8099e73da98621410.html
...........\...\........\01682a8f1944c641fc436080f00b2354.html; charset=gb2312
...........\...\........\0718ad68487fa12de0cc75b20f7be03c.html; charset=utf-8
...........\...\........\082e9d970f371da4f6e74dbe2c97f6e2.html; charset=utf-8
...........\...\........\132949602460dfebc35da092329cba0c.gif
...........\...\........\1695505243ceaa9c68e5a00061d1763f.javascript
...........\...\........\16fe8159f5ac4a626e43373186f16e22.x-javascript
...........\...\........\1c16643bc4c7301a90a25a76b9bc2968.html
...........\...\........\1c9c56c90609ba8e4f8a73cb166745d5.x-javascript
...........\...\........\1d876c8016e444f128e51846e997630b.html
...........\...\........\1df7133090a0d07c5cec8fccbf6fd8dd.html; charset=utf-8
...........\...\........\1f84d223f48becbc137342a91cd279a9.html
...........\...\........\203557adfb69f0b4da4e237df2c0899a.html; charset=gb2312
...........\...\........\23e5f50b0b42662c6694e574e74835cd.html; charset=utf-8
...........\...\........\24eebf7019dc355f064372d6a889c60a.html; charset=gb2312
...........\...\........\27439efce81b9ca84182d54aa411418e.html; charset=gb2312
...........\...\........\2a2f02ca86459cde185fc8e8e9045bed.html; charset=utf-8
...........\...\........\349427e49e96cbca35651e55ef94353d.gif
...........\...\........\3891570720e771c847e5ac23e28aa6cc.html
...........\...\........\3ff2932f670fc24203b1290df195dabf.gif
...........\...\........\4054d5675f32bafe56966926a394eebf.html
...........\...\........\417d9e708c95da24b75705338598087f.html
...........\...\........\44b19dec343bee7540d2e563399518f6.html; charset=gb2312
...........\...\........\46a60b53504c0c878220584ecbf26b89.html; charset=gb2312
...........\...\........\46e1c646c9965ce2581be0e2baa182cf.html; charset=utf-8
...........\...\........\487e8322376439a1af4d99b2755f69ec.html
...........\...\........\48bfe5c4818bc6d7d0a86b7c5d5a963a.javascript
...........\...\........\49666858ac1ef54ff09503aabb303e4c.x-javascript
...........\...\........\4cef95f512517e118d0427cdf40d8d91.javascript
...........\...\........\4dcb03467981bb629936a58ad21693b1.x-icon
...........\...\........\54310cdec9fe44958531404ff42b1432.html
...........\...\........\54cd270476c08dc49137cc587d5420e7.html; charset=utf-8
...........\...\........\5ae7c8b442091b3c740b5f89f2202977.gif
...........\...\........\5f194c03340af2c82af0806b4cd95f44.html; charset=gb2312
...........\...\........\61762c64d6451d95218cd92f662edd6b.x-javascript
...........\...\........\6a78a05748d064e4491b674a391174c7.javascript
...........\...\........\6ba086f85f3602a364dae60f740138c5.html; charset=gb2312
...........\...\........\6d6f6fbb6882f38816ab043633854c94.javascript
...........\...\........\73e9259e079ac68519bd2cf67af06c13.html; charset=utf-8
...........\...\........\753a67d9417f20f83e1dce17d6146f85.gif
...........\...\........\767223508f1bd57304d84720065f9ee8.x-javascript
...........\...\........\7780c2d0134fad8b7a05a95d0f7b3378.html; charset=gb2312
...........\...\........\7893643224e9d05ebec09e8f8a6b3f4e.javascript
...........\...\........\7a6721fd05029de13a9df0e2a0948f25.html; charset=UTF-8
...........\...\........\7eedab1d5fa988b034a32f14e08a97c0.gif
...........\...\........\83af271b4a1afe893d144829abd149e1.css
...........\...\........\84675a6817fc8715e33bc1c631154b5d.html
...........\...\........\857c3c382495ba1593a316498236e4f8.html; charset=gb2312
...........\...\........\8769fd41800599144d3fffb49173cf71.x-icon
...........\...\........\89253cefeda362f9b403341ccec22420.gif
...........\...\........\8d52d7ccdc272a6bcaf36ae22d856dfc.html; charset=utf-8
...........\...\........\9339d79eed585c1e0b126588c50477a8.javascript
...........\...\........\93c0e58661019bd4a98aa3790a400cdf.x-javascript
...........\...\........\94f1e7adbd48cf364b19771319db6b3f.gif
...........\...\........\956119ce46fe84d5c1e240ef7d417bdb.html; charset=gb2312
...........\...\........\958d3de226a5e82202509ad6aca140dd.html
...........\...\........\9d71e4ab781e1b9bf3eccf2a47568d6e.html; char

• We are an exchange download platform that only provides communication channels. The downloaded content comes from the internet. Except for download issues, please Google on your own.
• The downloaded content is provided for members to upload. If it unintentionally infringes on your copyright, please contact us.
• Please use Winrar for decompression tools
• If download fail, Try it againg or Feedback to us.
• If downloaded content did not match the introduction, Feedback to us，Confirm and will be refund.
• Before downloading, you can inquire through the uploaded person information

Nothing．