Focused web crawler with revisit policy

@inproceedings{Mali2011FocusedWC,
  title={Focused web crawler with revisit policy},
  author={S. Mali and B. B. Meshram},
  booktitle={ICWET},
  year={2011}
}
Focused crawlers aim to search only the subset of the web related to a specific topic, and offer a potential solution to the problem. The major problem is how to retrieve the maximal set of relevant and quality pages. In this paper, We propose an architecture that concentrates more over page selection policy and page revisit policy The three-step algorithm for page refreshment serves the purpose. The first layer contributes to decision of page relevance using two methods. The second layer… CONTINUE READING