Skip to search form
Skip to main content
Skip to account menu
Semantic Scholar
Semantic Scholar's Logo
Search 225,206,848 papers from all fields of science
Search
Sign In
Create Free Account
Msnbot
msnbot was a web-crawling robot (type of internet bot), deployed by Microsoft to collect documents from the web to build a searchable index for the…
Expand
Wikipedia
(opens in a new tab)
Create Alert
Alert
Related topics
Related topics
3 relations
Meta element
Web crawler
Web search engine
Papers overview
Semantic Scholar uses AI to extract papers important to this topic.
2013
2013
A novel defense mechanism against web crawlers intrusion
Alireza Aghamohammadi
,
A. Eydgahi
International Conference on Electronics, Computer…
2013
Corpus ID: 15198286
Web robots also known as crawlers or spiders are used by search engines, hackers and spammers to gather information about web…
Expand
2013
2013
Identification and characterization of crawlers through analysis of web logs
N. Algiriyage
,
Sanath Jayasena
,
G. Dias
,
Amila B. Perera
,
K.H.N.K. Dayananda
IEEE 8th International Conference on Industrial…
2013
Corpus ID: 14043287
Web crawlers are software programs that automatically traverse the hyperlink structure of the world-wide web in order to locate…
Expand
By clicking accept or continuing to use the site, you agree to the terms outlined in our
Privacy Policy
(opens in a new tab)
,
Terms of Service
(opens in a new tab)
, and
Dataset License
(opens in a new tab)
ACCEPT & CONTINUE