期刊名称：International Journal of Future Generation Communication and Networking
印刷版ISSN：2233-7857
出版年度：2016
卷号：9
期号：4
页码：171-178
DOI：10.14257/ijfgcn.2016.9.4.14
出版社：SERSC
摘要：With the explosive growth of the web information, acquiring the target information quickly, precisely and effectively in a large number of network information is restricted by many factors. In response to it, this paper analyzed the key technician part in the network information search engine-web crawler technology and proposed a network information target search model based on the web vertical crawler system with discussion on the implementation of the corresponding search strategy. Firstly, it builds the structure of the web crawler system and analyzes different function models. Next, it discusses some crucial problems including the options of deleting duplicated URL, the strategies to choose duplicated URL deletion method and the control model of error probability estimate model to acquire the closest network information to the target information. Finally, it verifies and discusses the operability and effectiveness of the model and the implementation strategy through case study.
