3 links
List of Robot Agent Strings
pgts.com.au
A list from PGTS of Web robots with the identifying data they leave in Web site logs.
Search Engine IP Addresses
iplists.com
Lists IP addresses of search engine spiders. Can be searched by IP address. Also links to resources on spiders.
Search Engine Robots and Other User Agents
jafsoft.com
John A. Fotheringham presents data in tabular form on the robots sent by search engines and other sites to read and index Web pages: their origins, names and IP addresses.
Showing 20–3 of 3 results