Focused crawler

Known as: Topical crawler, Focused crawling, Focused web crawler 
A focused crawler is a web crawler that collects Web pages that satisfy some specific property, by carefully prioritizing the crawl frontier and… (More)
Wikipedia

Papers overview

Semantic Scholar uses AI to extract papers important to this topic.
2016
2016
There is need for an Integrated Event Focused Crawling system to collect Web data about key events. When a disaster or other… (More)
  • figure 1
  • figure 2
  • figure 3
  • figure 4
  • figure 5
Is this relevant?
2015
2015
Users and uses of internet is growing tremendously these days which causing an extreme trouble and efforts at user side to get… (More)
  • figure 1
  • figure 2
  • figure 3
  • table I
  • figure 4
Is this relevant?
2014
2014
The Linked Data best practices recommend publishers of triplesets to use well-known ontologies in the triplication process and to… (More)
  • table 1
  • table 4
  • table 3
Is this relevant?
2014
2014
It is well recognized that the Internet has become the largest marketplace in the world, and online advertising is very popular… (More)
  • figure 1
  • figure 2
  • figure 3
  • figure 4
  • figure 5
Is this relevant?
2011
2011
As the size of the Web continues to grow, searching it for useful information has become more difficult. Focused crawler intends… (More)
  • figure 1
  • figure 2
  • table 1
Is this relevant?
2011
2011
The World Wide Web is a huge collection of web pages where every second, new piece of information is added. Searching and… (More)
  • figure 1
  • figure 2
  • figure 3
  • figure 4
  • figure 5
Is this relevant?
2008
2008
Ontology is a technology for conceptualizing specific domain knowledge, which can provide machine-readable definitions to the… (More)
Is this relevant?
2008
2008
Vertical search engines use focused crawlers as their key component and develop some specific algorithms to select Web pages… (More)
  • figure 1
  • figure 2
  • table 1
  • figure 4
  • figure 5
Is this relevant?
Highly Cited
2000
Highly Cited
2000
Maintaining currency of search engine indices by exhaustive crawling is rapidly becoming impossible due to the increasing size… (More)
  • figure 1
  • figure 2
  • figure 3
  • figure 4
  • figure 5
Is this relevant?
Highly Cited
1999
Highly Cited
1999
The rapid growth of the World-Wide Web poses unprecedented scaling challenges for general-purpose crawlers and search engines. In… (More)
  • figure 2
  • figure 3
  • figure 4
  • figure 5
  • figure 6
Is this relevant?