Yahoo! Slurp

Slurp is the Yahoo Search robot for crawling and indexing web page information. Although some Yahoo Search results are powered by our partners, sites should allow Yahoo Slurp access in order to appear in Yahoo Mobile Search results. Additionally, Slurp does the following: Collects content from partner sites for inclusion within sites like Yahoo News, Yahoo Finance and Yahoo Sports. Accesses pages from sites across the Web to confirm accuracy and improve Yahoo's personalized content for our users.