Skip to search formSkip to main contentSkip to account menu

Web crawler

Known as: Webcrawler, Crawl site, RBSE 
A Web crawler is an Internet bot which systematically browses the World Wide Web, typically for the purpose of Web indexing (web spidering). Web… 
Wikipedia (opens in a new tab)

Papers overview

Semantic Scholar uses AI to extract papers important to this topic.
Highly Cited
2012
Highly Cited
2012
The development of location-based social networking (LBSN) services is growing rapidly these days. Users of LBSN services are… 
2007
2007
"Deep Web" refers to the rich information and data hidden in backend databases, etc., that search engines or Web crawlers cannot… 
Highly Cited
2006
Highly Cited
2006
In recent years, more than 200 viruses have been reported to use a peer-to-peer (P2P) file-sharing network as a propagation… 
Highly Cited
2005
Highly Cited
2005
Many databases have become Web-accessible through form-based search interfaces (i.e., search forms) that allow users to specify… 
Highly Cited
2005
Highly Cited
2005
This paper summarizes and analyses data compiled on the activities of email harvesters gathered through a 5,000+ member honey pot… 
Highly Cited
2005
Highly Cited
2005
Some large scale topical digital libraries, such as CiteSeer, harvest online academic documents by crawling open-access archives… 
Highly Cited
2004
Highly Cited
2004
Modern forestry has created stands with even age distribution of trees and fragmentation of the habitat. In boreal forests, the… 
Highly Cited
2003
Highly Cited
1979
Highly Cited
1979
Summary1.The predictions of game theory concerning the use of resource assessment strategies by animals in conflict situations…