https://e-sygoing.link Latest links in the Robots category en-us Sun, 24 May 2026 12:17:51 -0400 https://e-sygoing.link/link/5730915-search-engine-robots-and-other-user-agents John A. Fotheringham presents data in tabular form on the robots sent by search engines and other sites to read and index Web pages: their origins, names and IP addresses. Wed, 10 Dec 2025 18:39:24 -0500 https://e-sygoing.link/go/5730915 https://e-sygoing.link/link/5730916-list-of-robot-agent-strings A list from PGTS of Web robots with the identifying data they leave in Web site logs. Wed, 01 Jan 2025 18:38:30 -0500 https://e-sygoing.link/go/5730916 https://e-sygoing.link/link/5730919-search-engine-ip-addresses Lists IP addresses of search engine spiders. Can be searched by IP address. Also links to resources on spiders. Sun, 21 Jan 2024 05:15:01 -0500 https://e-sygoing.link/go/5730919