JargonFile/entries/spider.txt

4 lines
210 B
Plaintext
Raw Normal View History

2014-04-26 10:52:28 -04:00
spider
The Web-walking part of a search engine that collects pages for indexing in the search engine's database. Also called a bot. The best-known is Scooter, the web-walker for the Alta Vista search engine.