Search - web crawler

Search - web crawler - List

[DataMining] pachong DL : 0: 汽车网站的爬虫，是一种按照一定的规则,自动地抓取万维网信息的程序或者脚本。另-Car web crawler
Date : 2025-12-16 Size : 3kb User : 张聪
[DataMining] Spider DL : 0: JAVA写的网络爬虫小程序，利用正则表达式提取关键信息。-JAVA applet written web crawler using regular expressions to extract key information.
Date : 2025-12-16 Size : 5kb User : YANJZ
[DataMining] ThemeCrawler DL : 0: 现在常见的搜索策略主要分为两种：一种是基于网页链接结构的搜索策略，另一种是基于内容评价的搜索策略。第一种是通过网页之间的链接关系来确定网页的重要性，从而决定链接访问的顺序。此方法虽然考虑了网页链接结构和网页之间的链接关系，但忽略了网页内容与主题的相关度，容易出现网页搜索“主题漂移”。第二种主要考虑网页内容，好处就是思路清晰且计算简单。但这种方法忽略了网页的链接关系，故在预测链接网页价值方面存在不足。考虑到这些问题，提出将布谷鸟搜索算法应用到主题爬虫中。-Now the common search strategy is divided into two kinds: one is based on the link structure of the search strategy, the other is based on content uation of the search strategy. The first is to determine the importance of the page through the link relationships between the pages and determine the order in which the links are accessed. Although this method takes into account the link structure between web pages and links between pages, but ignores the relevance of web content and themes, prone to web search theme drift. The second major consideration of web content, the benefits of clear thinking and calculation is simple. But this method ignores the links of the page, so there is insufficient in predicting the value of the link page. Considering these problems, the cuckoo search algorithm is proposed to apply to the crawler.
Date : 2025-12-16 Size : 1.4mb User : shishi