Discussion about the core of search engine again—Web Crawler
- Resource Type
- Conference
- Authors
- Jianghong Wang; Lijun Zhu; Caihong Li
- Source
- 2011 International Conference on Computer Science and Service System (CSSS) Computer Science and Service System (CSSS), 2011 International Conference on. :3188-3191 Jun, 2011
- Subject
- Computing and Processing
Components, Circuits, Devices and Systems
Communication, Networking and Broadcast Technologies
Crawlers
Search engines
Servers
Real time systems
Microcomputers
Local area networks
socket
http
web crawle
client/server
- Language
The web crawler is a common product of the network real-time refresh data and search engine technology at present. This article discusses and studies thoroughly how to apply the Web Crawler technique to realize the real-time refresh data and search engine technology. On the basis of deep analysis to the Web Crawler technique, this article gives a kind of solution to realize network communications between the server and the client in the local area network with the Web Crawler technique.