Learn More
We describe DSphere - a decentralized system for crawling, indexing, searching and ranking of documents in the World Wide Web. Unlike most of the existing search technologies that depend heavily on a page-centric view of the Web, we advocate a source-centric view of the Web and propose a decentralized architecture for crawling, indexing and searching the(More)
Search Engines like Google have become an Integral part of our life. Search Engine usually consists of 3 major parts-crawling, indexing and searching. A highly efficient web crawler is needed to download billions of web pages to index. Most of the current commercial search engines use a central server model for crawling. Major problems with centralized(More)
  • 1