The Web crawler is a program of automatic extraction of Web pages for search engines from the download page on the World Wide Web, is an important component of the search engines. Traditional reptile from one or more of the initial URL of the page to get the URL in the initial pages crawled pages, and continuously extracted from the current page with the new URL into the queue, until a certain cut-off conditions.

NWebCrawler.sln
NWebCrawler.suo
下载必读.txt
bin\config.ini
...\download\0003be8238c8302e17c799d9f5d65876.gif
...\........\0718ad68487fa12de0cc75b20f7be03c.html; charset=utf-8
...\........\082e9d970f371da4f6e74dbe2c97f6e2.html; charset=utf-8
...\........\0db9adff279d18396301a73aede5eadd.html; charset=utf-8
...\........\1319951725aa2e254c529b215915cca7.html; charset=utf-8
...\........\132949602460dfebc35da092329cba0c.gif
...\........\1695505243ceaa9c68e5a00061d1763f.javascript
...\........\174380a4a9c1bc6ac78a70fdeacc7c52.html; charset=utf-8
...\........\1df7133090a0d07c5cec8fccbf6fd8dd.html; charset=utf-8
...\........\20332c05154938c7226bdbf05332aabb.html; charset=utf-8
...\........\203557adfb69f0b4da4e237df2c0899a.html; charset=gb2312
...\........\208ede383ecf52d24017444c66987681.html; charset=utf-8
...\........\23e5f50b0b42662c6694e574e74835cd.html; charset=utf-8
...\........\24eebf7019dc355f064372d6a889c60a.html; charset=gb2312
...\........\27439efce81b9ca84182d54aa411418e.html; charset=gb2312
...\........\2991be82fdab0e0fd1049f42cf43fae7.html; charset=utf-8
...\........\2a2f02ca86459cde185fc8e8e9045bed.html; charset=utf-8
...\........\2bc836c64b3286ec05c047eb4c406f7c.gif
...\........\2c974b13ea0c4c07e666ba6d1758ca7b.css
...\........\31a4e1999bd8c41baaa8e7b90aed3691.html; charset=utf-8
...\........\329be511963944ba550f2c4d6f141ca3.x-javascript
...\........\349427e49e96cbca35651e55ef94353d.gif
...\........\3891570720e771c847e5ac23e28aa6cc.html
...\........\3ff2932f670fc24203b1290df195dabf.gif
...\........\417d9e708c95da24b75705338598087f.html
...\........\42282214358e5effc9b9c7e069da49c4.html
...\........\448461262bf568d650895ee5c39dfabc.gif
...\........\44b19dec343bee7540d2e563399518f6.html; charset=gb2312
...\........\46e1c646c9965ce2581be0e2baa182cf.html; charset=utf-8
...\........\48bfe5c4818bc6d7d0a86b7c5d5a963a.javascript
...\........\4cef95f512517e118d0427cdf40d8d91.javascript
...\........\53a66d3c643047b7d06c0ccc4b8dce91.html; charset=utf-8
...\........\54cd270476c08dc49137cc587d5420e7.html; charset=utf-8
...\........\58f3183ad6e6d48c78c174cf91741698.x-javascript
...\........\5a292fa3a4aec9bbd045c37f37326fd2.html; charset=utf-8
...\........\5ae7c8b442091b3c740b5f89f2202977.gif
...\........\5f194c03340af2c82af0806b4cd95f44.html; charset=gb2312
...\........\64111e164c8868d7e5d346a5c0a81e5e.html; charset=utf-8
...\........\6531a3849b20e503d0d8bcd6b7298fbf.html; charset=utf-8
...\........\6a78a05748d064e4491b674a391174c7.javascript
...\........\6ba086f85f3602a364dae60f740138c5.html; charset=gb2312
...\........\71d7cb2e59c6acfa14a3287ae0e87ef5.html; charset=utf-8
...\........\724aafcb53240acca6dc574718125f2a.html; charset=utf-8
...\........\73e9259e079ac68519bd2cf67af06c13.html; charset=utf-8
...\........\753a67d9417f20f83e1dce17d6146f85.gif
...\........\767223508f1bd57304d84720065f9ee8.x-javascript
...\........\7780c2d0134fad8b7a05a95d0f7b3378.html; charset=gb2312
...\........\78c401781c27236c26ba878ae74256af.html; charset=utf-8
...\........\79f1df1276fc150c69d2ffb9dffa32d6.jpeg
...\........\7a6721fd05029de13a9df0e2a0948f25.html; charset=UTF-8
...\........\7eedab1d5fa988b034a32f14e08a97c0.gif
...\........\84283c4acb86684ba6ad85a666d4d6a0.html; charset=utf-8
...\........\84675a6817fc8715e33bc1c631154b5d.html
...\........\857c3c382495ba1593a316498236e4f8.html; charset=gb2312
...\........\8769fd41800599144d3fffb49173cf71.x-icon
...\........\89253cefeda362f9b403341ccec22420.gif
...\........\8ba9798b147280ce7d7c4545883ed076.html; charset=utf-8
...\........\8bfdfc8e44c003a0ebcedfe7500b62bb.html; charset=utf-8
...\........\8d52d7ccdc272a6bcaf36ae22d856dfc.html; charset=utf-8
...\........\8fac5ffe0dcc710e3e5e8736f9d6ea53.html; charset=utf-8
...\........\9339d79eed585c1e0b126588c50477a8.javascript
...\........\93c0e58661019bd4a98aa3790a400cdf.x-javascript
...\........\94f1e7adbd48cf364b19771319db6b3f.gif
...\........\956119ce46fe84d5c1e240ef7d417bdb.html; charset=gb2312
...\........\9d71e4ab781e1b9bf3eccf2a47568d6e.html; charset=utf-8
...\........\9fb81354ae6989f2798e193b538cc443.gif
...\........\a1f4874e9eba09dcb811021a125

• We are an exchange download platform that only provides communication channels. The downloaded content comes from the internet. Except for download issues, please Google on your own.
• The downloaded content is provided for members to upload. If it unintentionally infringes on your copyright, please contact us.
• Please use Winrar for decompression tools
• If download fail, Try it againg or Feedback to us.
• If downloaded content did not match the introduction, Feedback to us，Confirm and will be refund.
• Before downloading, you can inquire through the uploaded person information

Nothing．