Implementation of Web Crawler

  title={Implementation of Web Crawler},
  author={Pooja Gupta and Kalpana Johari},
  journal={2009 Second International Conference on Emerging Trends in Engineering & Technology},
The World Wide Web is an interlinked collection of billions of documents formatted using HTML. Ironically the very size of this collection has become an obstacle for information retrieval. The user has to shift through scores of pages to come upon the information he/she desires. Web crawlers are the heart of search engines. Web crawlers continuously keep on crawling the web and find any new web pages that have been added to the web, pages that have been removed from the web. Due to growing and… CONTINUE READING
Highly Cited
This paper has 21 citations. REVIEW CITATIONS


Publications citing this paper.
Showing 1-10 of 12 extracted citations

Opinion mining to strengthen teaching learning process

2016 Second International Innovative Applications of Computational Intelligence on Power, Energy and Controls with their Impact on Humanity (CIPECH) • 2016
View 6 Excerpts
Highly Influenced

Study of Web Crawler and its Different Types

View 3 Excerpts
Highly Influenced

A Dedicated Crawling Engine to Reduce Apps Distribution Risks

2016 European Intelligence and Security Informatics Conference (EISIC) • 2016
View 1 Excerpt

Inducing factors for search engine optimization techniques: A comparative analysis

2016 1st India International Conference on Information Processing (IICIP) • 2016
View 2 Excerpts

Generating domain specific ontology for retrieving Hidden Web contents

2014 International Conference on Information Systems and Computer Networks (ISCON) • 2014
View 1 Excerpt

Web crawlers: To detect security holes

2013 International Conference on Open Source Systems and Technologies • 2013
View 2 Excerpts


Publications referenced by this paper.
Showing 1-3 of 3 references

What ' s New on the Web ? The Evolution of the Web from a Search Engine Perspective

Alexandros Ntoulas, Junghoo Cho

The anatomy of large scale hyper textual web search engine ”

Sergey Brin, Lawrence Page

Similar Papers

Loading similar papers…