Searching the world wide Web

@article{Lawrence1998SearchingTW,
  title={Searching the world wide Web},
  author={Lawrence and Giles},
  journal={Science},
  year={1998},
  volume={280 5360},
  pages={
          98-100
        }
}
The coverage and recency of the major World Wide Web search engines was analyzed, yielding some surprising results. The coverage of any one engine is significantly limited: No single engine indexes more than about one-third of the "indexable Web," the coverage of the six engines investigated varies by an order of magnitude, and combining the results of the six engines yields about 3.5 times as many documents on average as compared with the results from only one engine. Analysis of the overlap… 
How Large Is the World Wide Web
TLDR
The present chapter focuses on size in terms of the number N of Web pages, which is the part of the Web that is considered for indexing by the major search engines.
An Overview of World Wide Web Search Technologies
TLDR
An overview of the Web search technologies is given and they are classed into six categories: hyperlink exploration, information retrieval, metasearches, SQL approaches, content-based multimedia searches, and others.
Indexing and Abstracting on the World Wide Web: An Examination of Six Web Databases
TLDR
In this article, the author draws from library literature to develop a series of questions that can be used to analyze these web searching tools and concludes with a proposal for the ideal web database.
World Wide Web Search Technologies
TLDR
This chapter provides an overview of existing Web search technologies and classifies them into six categories: (i) hyperlink exploration, (ii) information retrieval, (iii) metasearches, (iv) SQL approaches, (v) content-based multimedia searches, and (vi) others.
Web searching, search engines and Information Retrieval
TLDR
The challenges in indexing the World Wide Web, the user behaviour, and the ranking factors used by these engines are discussed, mainly of those that are based on the widely used link popularity measures.
On the Instability of Web Search Engines
The output of major WWW search engines was analyzed and the results led to some surprising observations about their stability. Twenty-five queries were issued repeatedly to the engines and the
The Responsiveness of Search Engine Indexes
TLDR
An experiment to investigate the effect of link count on the indexing of 1000 sites in three search portals over a period of seven months found that, although all engines added sites during the period of the survey, only Google showed evidence of being very responsive to the existence of links on the test site, whereas AltaVista's results were very stable over time.
Text Retrieval Systems for the Web
TLDR
The focus of this paper is to survey the modern approaches to the accomplishment of different Web search engine tasks, as well as modifications of the retrieval problem associated with heterogeneity of both user's needs and architectures of the search systems used.
...
...

References

SHOWING 1-10 OF 19 REFERENCES
Introduction to Modern Information Retrieval
TLDR
Reading is a need and a hobby at once and this condition is the on that will make you feel that you must read.
The World Wide Web as an Instructional Tool
TLDR
Three ways in which the WWW can be profitably used in education are discussed: as a giant encyclopedia, as a virtual classroom, and as a supplement to conventional courses.
and O
  • Etzioni, in Proceedings of the Fourth International World Wide Web Conference, Boston, MA, 11 to 14 December
  • 1995
Brewster's Millions
Measuring the growth of the Web
  • Measuring the growth of the Web
  • 1993
Measuring the growth of the Web: June 1993 to June 1995,
  • www.mit.edu/people/mkgray/ growth/
  • 1996
New Sci
  • New Sci
  • 1997
Proceedings of the 49th Annual Meeting of the American Society for Information Science (Learned Information
  • Proceedings of the 49th Annual Meeting of the American Society for Information Science (Learned Information
  • 1986
Introduction to Modern Information Retrieval (McGraw-Hill
  • New York,
  • 1983
Yianilos, and the anonymous reviewers for useful comments and suggestions. All registered and unregistered trademarks are the property of their respective owners
  • 1998
...
...