# archive.org_bot

What this client asked https://www.pathwren.workers.dev for, from that host's own request log.
Window: 2026-08-31 20:58:34Z to 2026-09-03 03:05:14Z UTC. Generated 2026-09-03.

## User-agent strings, exactly as they arrived

- `Mozilla/5.0 (compatible; archive.org_bot +http://archive.org/details/archive.org_bot) Zeno/d3712ae warc/v0.8.99` — 993 request(s), 7 address(es), 2026-08-31 20:58:34Z to 2026-09-03 03:05:14Z

- Requests: 993
- Distinct addresses (salted hashes, never published): 7
- Distinct paths: 898
- Visits (30-minute gap rule): 8
- Status codes: 200×483, not recorded×309, 404×120, 307×81
- Accept headers: none sent
- Our classifier called it: crawler×993 (ours, from the user-agent)

## What it asked for, in order

1. `/category/dataset.html` — 2026-08-31 20:58:34Z — not recorded
2. `/category/archive.html` — 2026-08-31 20:58:34Z — not recorded
3. `/robots/block-disputed.txt` — 2026-08-31 20:58:34Z — not recorded
4. `/crawler/oai-searchbot.html` — 2026-08-31 20:58:34Z — not recorded
5. `/status.html` — 2026-08-31 20:58:34Z — not recorded
6. `/robots/allow-ai-search-only.txt` — 2026-08-31 20:58:34Z — not recorded
7. `/category/user-fetch.html` — 2026-08-31 20:58:34Z — not recorded
8. `/data/` — 2026-08-31 20:58:34Z — not recorded
9. `/robots/maximum-ai-visibility.txt` — 2026-08-31 20:58:34Z — not recorded
10. `/crawler/ccbot.html` — 2026-08-31 20:58:34Z — not recorded
11. `/category/seo.html` — 2026-08-31 20:58:34Z — not recorded
12. `/policy/block-disputed.html` — 2026-08-31 20:58:34Z — not recorded
13. `/category/tool.html` — 2026-08-31 20:58:34Z — not recorded
14. `/crawler/gptbot.html` — 2026-08-31 20:58:34Z — not recorded
15. `/crawler/perplexitybot.html` — 2026-08-31 20:58:34Z — not recorded
16. `/snippet/` — 2026-08-31 20:58:34Z — not recorded
17. `/ip-ranges/` — 2026-08-31 20:58:34Z — not recorded
18. `/policy/allow-ai-search-only.html` — 2026-08-31 20:58:34Z — not recorded
19. `/crawler/claude-searchbot.html` — 2026-08-31 20:58:34Z — not recorded
20. `/policy/block-all-ai.html` — 2026-08-31 20:58:34Z — not recorded
21. `/ip-ranges/index.html` — 2026-08-31 20:58:34Z — not recorded
22. `/px.gif` — 2026-08-31 20:58:35Z — not recorded
23. `/data/agents.json` — 2026-08-31 20:58:35Z — 200
24. `/data/index.html` — 2026-08-31 20:58:39Z — not recorded
25. `/ip-ranges/openai-chatgpt-user.json` — 2026-08-31 20:58:41Z — not recorded
26. `/crawler/chatgpt-user.html` — 2026-08-31 20:58:41Z — not recorded
27. `/crawler/gptbot.json` — 2026-08-31 20:58:41Z — not recorded
28. `/crawler/oai-searchbot.json` — 2026-08-31 20:58:41Z — not recorded
29. `/ip-ranges/openai-gptbot.json` — 2026-08-31 20:58:41Z — not recorded
30. `/ip-ranges/openai-searchbot.json` — 2026-08-31 20:58:41Z — not recorded
31. `/crawler/chatgpt-user.json` — 2026-08-31 20:58:41Z — not recorded
32. `/crawler/claudebot.html` — 2026-08-31 20:58:41Z — not recorded
33. `/data/Mozilla/5.0%20(compatible;%20ClaudeBot/1.0;%20+claudebot@anthropic.com)` — 2026-08-31 20:58:43Z — not recorded
34. `/crawler/claudebot.json` — 2026-08-31 20:58:43Z — not recorded
35. `/crawler/claude-searchbot.json` — 2026-08-31 20:58:43Z — not recorded
36. `/data/Mozilla/5.0%20(compatible;%20Claude-SearchBot/1.0;%20+Claude-SearchBot@anthropic.com)` — 2026-08-31 20:58:43Z — not recorded
37. `/data/Mozilla/5.0%20(compatible;%20Claude-User/1.0;%20+Claude-User@anthropic.com)` — 2026-08-31 20:58:43Z — not recorded
38. `/crawler/claude-user.html` — 2026-08-31 20:58:43Z — not recorded
39. `/crawler/claude-user.json` — 2026-08-31 20:58:43Z — not recorded
40. `/crawler/anthropic-ai.html` — 2026-08-31 20:58:43Z — not recorded

## What it asked for that did not exist

- `/data/A2A-Registry-HealthCheck/1.0` — 404×1 — first asked 2026-09-01 07:02:17Z; still absent
- `/data/bingbot/2.0` — 404×1 — first asked 2026-09-01 07:02:17Z; still absent
- `/data/ClaudeBot/1.0` — 404×1 — first asked 2026-09-01 07:02:17Z; still absent
- `/data/exaforce-mcprep/0.1%20(MCP%20server%20reputation%20scanner)` — 404×1 — first asked 2026-09-01 07:02:17Z; still absent
- `/data/python-httpx2/2.12.0` — 404×1 — first asked 2026-09-01 07:02:18Z; still absent
- `/data/YandexBot/3.0` — 404×1 — first asked 2026-09-01 07:02:18Z; still absent
- `/data/Orbit-MCP-Registry-IconResolver/1.0` — 404×1 — first asked 2026-09-01 07:02:18Z; still absent
- `/data/Mozilla/5.0` — 404×1 — first asked 2026-09-01 07:02:18Z; still absent
- `/data/Go-http-client/2.0` — 404×1 — first asked 2026-09-01 07:02:18Z; still absent
- `/data/mcp-registry/1.0` — 404×1 — first asked 2026-09-01 07:02:18Z; still absent
- `/data/GPTBot/1.4` — 404×1 — first asked 2026-09-01 07:02:18Z; still absent
- `/data/measure-mcp-schema/0.1.0` — 404×1 — first asked 2026-09-01 07:02:18Z; still absent
- `/data/mcp-checker/1.0` — 404×1 — first asked 2026-09-01 07:02:18Z; still absent
- `/data/GF-Agent-Toll-Outbound/1.6.0` — 404×1 — first asked 2026-09-01 07:02:18Z; still absent
- `/data/utopian-foundry-probe/1.0` — 404×1 — first asked 2026-09-01 07:02:18Z; still absent
- `/data/MCPCatalogSync/1.0` — 404×1 — first asked 2026-09-01 07:02:18Z; still absent
- `/data/GF-Agent-Toll-Remediation/1.0` — 404×1 — first asked 2026-09-01 07:02:18Z; still absent
- `/data/AetherLink-Public-Discovery-Evidence/1.0` — 404×1 — first asked 2026-09-01 07:02:18Z; still absent
- `/data/python-httpx/0.28.1` — 404×1 — first asked 2026-09-01 07:02:18Z; still absent
- `/data/ReactorNetty/1.0.32` — 404×1 — first asked 2026-09-01 07:02:18Z; still absent
- `/data/ReactorNetty/1.2.1` — 404×1 — first asked 2026-09-01 07:02:19Z; still absent
- `/data/A2A-Registry/1.0` — 404×1 — first asked 2026-09-01 07:02:19Z; still absent
- `/data/AetherLink-Public-Agent-Card-Policy-Check/1.0` — 404×1 — first asked 2026-09-01 07:02:19Z; still absent
- `/data/AgentSure-MCPScan/0.1` — 404×1 — first asked 2026-09-01 07:02:19Z; still absent
- `/data/curl/7.88.0` — 404×1 — first asked 2026-09-01 07:02:19Z; still absent
- `/data/PackageHound/1.0` — 404×1 — first asked 2026-09-01 07:02:19Z; still absent
- `/data/SaSame-Census-Era-Probe/1.0` — 404×1 — first asked 2026-09-01 07:02:19Z; still absent
- `/data/SaSame-MCP-Audit/0.1` — 404×1 — first asked 2026-09-01 07:02:19Z; still absent
- `/data/TAR-Discovery/1.0` — 404×1 — first asked 2026-09-01 07:02:19Z; still absent
- `/data/TAR-Directory-Indexer/1.0` — 404×1 — first asked 2026-09-01 07:02:19Z; still absent
- `/data/TAR-Health/1.0` — 404×1 — first asked 2026-09-01 07:02:19Z; still absent
- `/bot/YandexBot/3.0` — 404×1 — first asked 2026-09-01 07:02:22Z; still absent
- `/bot/text/html%2Capplication/xhtml%2Bxml%2Capplication/xml%3Bq%3D0.9%2C*/*%3Bq%3D0.8` — 404×1 — first asked 2026-09-01 07:02:22Z; still absent
- `/data/APIEvangelist-AddAPI-Control/1.0%20(%2Bhttps%3A/apis.io)` — 404×1 — first asked 2026-09-01 07:02:48Z; still absent
- `/data/Mozilla/5.0%20(compatible%3B%20archive.org_bot%20%2Bhttp%3A/archive.org/details/archive.org_bot)%20Zeno/d3712ae%20warc/v0.8.99` — 404×1 — first asked 2026-09-01 07:02:48Z; still absent
- `/data/Mozilla/5.0%20AppleWebKit/537.36%20(KHTML%2C%20like%20Gecko%3B%20compatible%3B%20ClaudeBot/1.0%3B%20%2Bclaudebot%40anthropic.com)` — 404×1 — first asked 2026-09-01 07:02:48Z; still absent
- `/data/text/html%2Capplication/xhtml%2Bxml%2Capplication/xml%3Bq%3D0.9%2C*/*%3Bq%3D0.8` — 404×1 — first asked 2026-09-01 07:02:48Z; still absent
- `/data/apis.io-submit/1.0%20(%2Bhttps%3A/apis.io)` — 404×1 — first asked 2026-09-01 07:02:48Z; still absent
- `/data/Mozilla/5.0%20AppleWebKit/537.36%20(KHTML%2C%20like%20Gecko%3B%20compatible%3B%20bingbot/2.0%3B%20%2Bhttp%3A/www.bing.com/bingbot.htm)%20Chrome/116.0.1938.76%20Safari/537.36` — 404×1 — first asked 2026-09-01 07:02:48Z; still absent
- `/data/AgentGrade/1.0%20(security%20research%3B%20agentgrade.net)` — 404×1 — first asked 2026-09-01 07:02:48Z; still absent
- `/data/agent-tools.cloud-crawler/0.1%20(%2Bhttps%3A/agent-tools.cloud)` — 404×1 — first asked 2026-09-01 07:02:48Z; still absent
- `/data/Deno/2.1.4%20(variant%3B%20SupabaseEdgeRuntime/1.74.3)` — 404×1 — first asked 2026-09-01 07:02:48Z; still absent
- `/data/lastseen-schema-probe/1.0%20(%2Bhttps%3A/lastseen.dev%3B%20introspection-only)` — 404×1 — first asked 2026-09-01 07:02:48Z; still absent
- `/data/hultra-link/1.0%20(%2Bhttps%3A/donnees.hultra.link/sondes.md)` — 404×1 — first asked 2026-09-01 07:02:48Z; still absent
- `/data/agent-tools.cloud-a2a/0.1%20(%2Bhttps%3A/agent-tools.cloud)` — 404×1 — first asked 2026-09-01 07:02:48Z; still absent
- `/data/application/json%2C%20text/event-stream%3Bq%3D0.9%2C%20*/*%3Bq%3D0.1` — 404×1 — first asked 2026-09-01 07:02:48Z; still absent
- `/data/MCPWatch/0.1.0%20(%2Bmcpwatch%40iyre.com)%20longitudinal%20MCP%20security%20research` — 404×1 — first asked 2026-09-01 07:02:48Z; still absent
- `/data/AgentReputationBot/1.0%20(%2Bhttps%3A/agentreputation.dev)` — 404×1 — first asked 2026-09-01 07:02:49Z; still absent
- `/data/mcp-schema-archive/1.0%20(%2Bhttps%3A/mcp-schema-archive.delfrost42.workers.dev)` — 404×1 — first asked 2026-09-01 07:02:49Z; still absent
- `/data/AgentIndexBot/0.1%20(%2Bhttps%3A/agents.traderszone.net%3B%20polite%20ARD%20crawler)` — 404×1 — first asked 2026-09-01 07:02:49Z; still absent
- `/data/x402-observatory/0.2%20(%2Bresearch%20collector%3B%20contact%3A%20300tsb%40gmail.com)` — 404×1 — first asked 2026-09-01 07:02:49Z; still absent
- `/data/Mozilla/5.0%20(compatible%3B%20MCPCatalogSync/1.0)` — 404×1 — first asked 2026-09-01 07:02:49Z; still absent
- `/data/agent-guild-scout/1%20(%2Bhttps%3A/agent-guild-5d5r.onrender.com/.well-known/agent-guild.json)` — 404×1 — first asked 2026-09-01 07:02:49Z; still absent
- `/data/A2A-Registry-Smoke/1.0%20(%2Bhttps%3A/a2aregistry.org)` — 404×1 — first asked 2026-09-01 07:02:49Z; still absent
- `/data/mcp-observatory/0.1.0%20(%2Bhttps%3A/github.com/yhouta/mcp-observatory%3B%20public%20transparency%20log%3B%20contact%3A%20yassine.houta%40outlook.fr)` — 404×1 — first asked 2026-09-01 07:02:49Z; still absent
- `/data/SaSameAgentAudit/0.1%20(%2Bhttps%3A/live-vps.sasame.online/.well-known/agent-card.json)` — 404×1 — first asked 2026-09-01 07:02:49Z; still absent
- `/data/pip/24.3.1%20%7B%22ci%22%3Anull%2C%22cpu%22%3A%22x86_64%22%2C%22implementation%22%3A%7B%22name%22%3A%22CPython%22%2C%22version%22%3A%223.11.9%22%7D%2C%22installer%22%3A%7B%22name%22%3A%22pip%22%2C%22version%22%3A%2224.3.1%22%7D%2C%22openssl_version%22%3A%22OpenSSL%203.0.13%2030%20Jan%202024%22%2C%22python%22%3A%223.11.9%22%2C%22setuptools_version%22%3A%2275.6.0%22%2C%22system%22%3A%7B%22name%22%3A%22Linux%22%2C%22release%22%3A%226.8.0%22%7D%7D` — 404×1 — first asked 2026-09-01 07:02:49Z; still absent
- `/data/truespar-mcp-registry/0.1%20(%2Bhttps%3A/registry.truespar.com)` — 404×1 — first asked 2026-09-01 07:02:49Z; still absent
- `/data/application/json%2C%20application/a2a%2Bjson%3Bq%3D0.9` — 404×1 — first asked 2026-09-01 07:02:49Z; still absent
- `/data/AetherLinkDiscoveryEvidence/1.0%20(%2Bhttps%3A/aetherlink.47-85-186-77.sslip.io/llms.txt)` — 404×1 — first asked 2026-09-01 07:02:50Z; still absent
- `/data/api-forge-mcp-index/1.0%20(%2Bhttps%3A/api.temsor.com/mcp/index%3B%20iletisim%3A%20altyapi%40temsor.com)` — 404×1 — first asked 2026-09-01 07:02:50Z; still absent
- `/data/Mozilla/5.0%20(compatible%3B%20AgentSure-MCPScan/0.1%3B%20%2Bhttps%3A/agentsure.tech)` — 404×1 — first asked 2026-09-01 07:02:50Z; still absent
- `/data/application/json%2Ctext/html%3Bq%3D0.9%2C*/*%3Bq%3D0.7` — 404×1 — first asked 2026-09-01 07:02:50Z; still absent
- `/data/Mozilla/5.0%20(Windows%20NT%2010.0%3B%20Win64%3B%20x64)%20AppleWebKit/537.36%20(KHTML%2C%20like%20Gecko)%20Chrome/151.0.0.0%20Safari/537.36` — 404×1 — first asked 2026-09-01 07:02:50Z; still absent
- `/data/Mozilla/5.0%20(iPhone%3B%20CPU%20iPhone%20OS%2013_2_3%20like%20Mac%20OS%20X)%20AppleWebKit/605.1.15%20(KHTML%2C%20like%20Gecko)%20Version/13.0.3%20Mobile/15E148%20Safari/604.1` — 404×1 — first asked 2026-09-01 07:02:50Z; still absent
- `/data/Mozilla/5.0%20(X11%3B%20Linux%20x86_64)%20AppleWebKit/537.36%20(KHTML%2C%20like%20Gecko)%20Chrome/148.0.0.0%20Safari/537.36` — 404×1 — first asked 2026-09-01 07:02:50Z; still absent
- `/data/Mozilla/5.0%20(Macintosh%3B%20Intel%20Mac%20OS%20X%2010_15_7)%20AppleWebKit/537.36%20(KHTML%2C%20like%20Gecko)%20Chrome/124.0.0.0%20Safari/537.36` — 404×1 — first asked 2026-09-01 07:02:50Z; still absent
- `/data/Mozilla/5.0%20(Linux%3B%20Android%2010%3B%20K)%20AppleWebKit/537.36%20(KHTML%2C%20like%20Gecko)%20Chrome/151.0.0.0%20Mobile%20Safari/537.36` — 404×1 — first asked 2026-09-01 07:02:50Z; still absent
- `/data/Mozilla/5.0%20(Windows%20NT%2010.0%3B%20Win64%3B%20x64)%20AppleWebKit/537.36%20(KHTML%2C%20like%20Gecko)%20Chrome/125.0.0.0%20Safari/537.36%20Edg/125.0.0.0` — 404×1 — first asked 2026-09-01 07:02:51Z; still absent
- `/data/Mozilla/5.0%20(Windows%20NT%2010.0%3B%20Win64%3B%20x64)%20AppleWebKit/537.36%20(KHTML%2C%20like%20Gecko)%20Chrome/144.0.0.0%20Safari/537.36` — 404×1 — first asked 2026-09-01 07:02:51Z; still absent
- `/data/Mozilla/5.0%20(Windows%20NT%2010.0)%20AppleWebKit/537.36%20(KHTML%2C%20like%20Gecko)%20Chrome/106.0.0.0%20Safari/537.36` — 404×1 — first asked 2026-09-01 07:02:51Z; still absent
- `/data/Mozilla/5.0%20(Macintosh%3B%20Intel%20Mac%20OS%20X%2010_10_1)%20AppleWebKit/600.2.5%20(KHTML%2C%20like%20Gecko)%20Version/8.0.2%20Safari/600.2.5%20(Gort)` — 404×1 — first asked 2026-09-01 07:02:51Z; still absent
- `/bot/AgentGrade/1.0%20(security%20research%3B%20agentgrade.net)` — 404×1 — first asked 2026-09-01 09:00:15Z; still absent
- `/bot/GPTBot/1.4` — 404×1 — first asked 2026-09-01 15:00:55Z; still absent
- `/data/Googlebot-Video/1.0` — 404×1 — first asked 2026-09-02 09:03:16Z; still absent
- `/data/GoogleOther-Image/1.0` — 404×1 — first asked 2026-09-02 09:03:18Z; still absent
- `/data/GoogleOther-Video/1.0` — 404×1 — first asked 2026-09-02 09:03:20Z; still absent
- `/crawler/Googlebot-Video/1.0` — 404×1 — first asked 2026-09-02 09:04:26Z; still absent
- `/crawler/GoogleOther-Image/1.0` — 404×1 — first asked 2026-09-02 09:04:26Z; still absent
- `/crawler/GoogleOther-Video/1.0` — 404×1 — first asked 2026-09-02 09:04:27Z; still absent
- `/data/Mozilla/5.0%20(Linux%3B%20Android%205.0%3B%20SM-G920A)%20AppleWebKit%20(KHTML%2C%20like%20Gecko)%20Chrome%20Mobile%20Safari%20(compatible%3B%20AdsBot-Google-Mobile%3B%20%2Bhttp%3A/www.google.com/mobile/adsbot.html)` — 404×1 — first asked 2026-09-02 09:04:29Z; still absent
- `/data/Mozilla/5.0%20(compatible%3B%20Google-Site-Verification/1.0)` — 404×1 — first asked 2026-09-02 09:04:31Z; still absent
- `/data/Mozilla/5.0%20(compatible%3B%20Google-CWS)` — 404×1 — first asked 2026-09-02 09:04:32Z; still absent
- `/data/Mozilla/5.0%20(X11%3B%20Linux%20x86_64)%20AppleWebKit/537.36%20(KHTML%2C%20like%20Gecko%3B%20compatible%3B%20Google-Agent%3B%20%2Bhttps%3A/developers.google.com/crawling/docs/crawlers-fetchers/google-agent)%20Chrome/W.X.Y.Z%20Safari/537.36` — 404×1 — first asked 2026-09-02 09:04:33Z; still absent
- `/data/Mozilla/5.0%20(compatible%3B%20SiteAuditBot/0.97%3B%20%2Bhttp%3A/www.semrush.com/bot.html)` — 404×1 — first asked 2026-09-02 09:04:37Z; still absent
- `/data/Mozilla/5.0%20(compatible%3B%20SemrushBot-BA%3B%20%2Bhttp%3A/www.semrush.com/bot.html)` — 404×1 — first asked 2026-09-02 09:04:37Z; still absent
- `/data/Mozilla/5.0%20(compatible%3B%20SemrushBot-SI%3B%20%2Bhttp%3A/www.semrush.com/bot.html)` — 404×1 — first asked 2026-09-02 09:04:37Z; still absent
- `/data/Mozilla/5.0%20(compatible%3B%20SemrushBot-SWA%3B%20%2Bhttp%3A/www.semrush.com/bot.html)` — 404×1 — first asked 2026-09-02 09:04:37Z; still absent
- `/data/Mozilla/5.0%20(compatible%3B%20SplitSignalBot%3B%20%2Bhttp%3A/www.semrush.com/bot.html)` — 404×1 — first asked 2026-09-02 09:04:38Z; still absent
- `/data/Mozilla/5.0%20(compatible%3B%20SemrushBot-FT%3B%20%2Bhttp%3A/www.semrush.com/bot.html)` — 404×1 — first asked 2026-09-02 09:04:38Z; still absent
- `/data/Mozilla/5.0%20(compatible%3B%20SemrushBot-ESI%3B%20%2Bhttp%3A/www.semrush.com/bot.html)` — 404×1 — first asked 2026-09-02 09:04:38Z; still absent
- `/data/Mozilla/5.0%20(compatible%3B%20DotBot/1.2%3B%20%2Bhttps%3A/opensiteexplorer.org/dotbot%3B%20help%40moz.com)` — 404×1 — first asked 2026-09-02 09:04:40Z; still absent
- `/data/rogerbot/1.2%20(http%3A/moz.com/help/pro/what-is-rogerbot-%2C%20rogerbot-crawler%40moz.com)` — 404×1 — first asked 2026-09-02 09:04:40Z; still absent
- `/data/serpstatbot/2.1%20(advanced%20backlink%20tracking%20bot%3B%20https%3A/serpstatbot.com/%3B%20abuse%40serpstatbot.com)` — 404×1 — first asked 2026-09-02 09:04:41Z; still absent
- `/data/Mozilla/5.0%20(compatible%3B%20SEOkicks%3B%20%2Bhttps%3A/www.seokicks.de/robot.html)` — 404×1 — first asked 2026-09-02 09:04:41Z; still absent
- `/data/Mozilla/5.0%20(compatible%3B%20MojeekBot/0.11%3B%20%2Bhttps%3A/www.mojeek.com/bot.html)` — 404×1 — first asked 2026-09-02 09:04:41Z; still absent
- `/data/Mozilla/5.0%20(compatible%3B%20Pinterestbot/1.0%3B%20%2Bhttps%3A/www.pinterest.com/bot.html)` — 404×1 — first asked 2026-09-02 09:04:43Z; still absent
- `/data/Mozilla/5.0%20(compatible%3B%20panscient.com)` — 404×1 — first asked 2026-09-02 09:04:44Z; still absent
- `/data/AwarioSmartBot/1.0%20(%2Bhttps%3A/awario.com/bots.html%3B%20bots%40awario.com)` — 404×1 — first asked 2026-09-02 09:04:50Z; still absent
- `/data/AwarioRssBot/1.0%20(%2Bhttps%3A/awario.com/bots.html%3B%20bots%40awario.com)` — 404×1 — first asked 2026-09-02 09:04:51Z; still absent
- `/crawler/Mozilla/5.0%20(Linux%3B%20Android%205.0%3B%20SM-G920A)%20AppleWebKit%20(KHTML%2C%20like%20Gecko)%20Chrome%20Mobile%20Safari%20(compatible%3B%20AdsBot-Google-Mobile%3B%20%2Bhttp%3A/www.google.com/mobile/adsbot.html)` — 404×1 — first asked 2026-09-02 09:04:58Z; still absent
- `/crawler/Mozilla/5.0%20(compatible%3B%20Google-Site-Verification/1.0)` — 404×1 — first asked 2026-09-02 09:04:58Z; still absent
- `/crawler/Mozilla/5.0%20(X11%3B%20Linux%20x86_64)%20AppleWebKit/537.36%20(KHTML%2C%20like%20Gecko%3B%20compatible%3B%20Google-Agent%3B%20%2Bhttps%3A/developers.google.com/crawling/docs/crawlers-fetchers/google-agent)%20Chrome/W.X.Y.Z%20Safari/537.36` — 404×1 — first asked 2026-09-02 09:04:58Z; still absent
- `/crawler/Mozilla/5.0%20(compatible%3B%20Google-CWS)` — 404×1 — first asked 2026-09-02 09:04:58Z; still absent
- `/crawler/Mozilla/5.0%20(compatible%3B%20SiteAuditBot/0.97%3B%20%2Bhttp%3A/www.semrush.com/bot.html)` — 404×1 — first asked 2026-09-02 09:04:58Z; still absent
- `/crawler/Mozilla/5.0%20(compatible%3B%20SemrushBot-SWA%3B%20%2Bhttp%3A/www.semrush.com/bot.html)` — 404×1 — first asked 2026-09-02 09:04:58Z; still absent
- `/crawler/Mozilla/5.0%20(compatible%3B%20SemrushBot-BA%3B%20%2Bhttp%3A/www.semrush.com/bot.html)` — 404×1 — first asked 2026-09-02 09:04:58Z; still absent
- `/crawler/Mozilla/5.0%20(compatible%3B%20SemrushBot-SI%3B%20%2Bhttp%3A/www.semrush.com/bot.html)` — 404×1 — first asked 2026-09-02 09:04:58Z; still absent
- `/crawler/Mozilla/5.0%20(compatible%3B%20SplitSignalBot%3B%20%2Bhttp%3A/www.semrush.com/bot.html)` — 404×1 — first asked 2026-09-02 09:04:58Z; still absent
- `/crawler/Mozilla/5.0%20(compatible%3B%20SemrushBot-ESI%3B%20%2Bhttp%3A/www.semrush.com/bot.html)` — 404×1 — first asked 2026-09-02 09:04:58Z; still absent
- `/crawler/Mozilla/5.0%20(compatible%3B%20DotBot/1.2%3B%20%2Bhttps%3A/opensiteexplorer.org/dotbot%3B%20help%40moz.com)` — 404×1 — first asked 2026-09-02 09:04:58Z; still absent
- `/crawler/Mozilla/5.0%20(compatible%3B%20SemrushBot-FT%3B%20%2Bhttp%3A/www.semrush.com/bot.html)` — 404×1 — first asked 2026-09-02 09:04:58Z; still absent
- `/crawler/rogerbot/1.2%20(http%3A/moz.com/help/pro/what-is-rogerbot-%2C%20rogerbot-crawler%40moz.com)` — 404×1 — first asked 2026-09-02 09:04:58Z; still absent
- `/crawler/serpstatbot/2.1%20(advanced%20backlink%20tracking%20bot%3B%20https%3A/serpstatbot.com/%3B%20abuse%40serpstatbot.com)` — 404×1 — first asked 2026-09-02 09:04:58Z; still absent
- `/crawler/Mozilla/5.0%20(compatible%3B%20SEOkicks%3B%20%2Bhttps%3A/www.seokicks.de/robot.html)` — 404×1 — first asked 2026-09-02 09:04:58Z; still absent
- `/crawler/Mozilla/5.0%20(compatible%3B%20MojeekBot/0.11%3B%20%2Bhttps%3A/www.mojeek.com/bot.html)` — 404×1 — first asked 2026-09-02 09:04:58Z; still absent
- `/crawler/Mozilla/5.0%20(compatible%3B%20Pinterestbot/1.0%3B%20%2Bhttps%3A/www.pinterest.com/bot.html)` — 404×1 — first asked 2026-09-02 09:04:58Z; still absent
- `/crawler/AwarioRssBot/1.0%20(%2Bhttps%3A/awario.com/bots.html%3B%20bots%40awario.com)` — 404×1 — first asked 2026-09-02 09:04:58Z; still absent
- `/crawler/AwarioSmartBot/1.0%20(%2Bhttps%3A/awario.com/bots.html%3B%20bots%40awario.com)` — 404×1 — first asked 2026-09-02 09:04:58Z; still absent
- `/crawler/Mozilla/5.0%20(compatible%3B%20panscient.com)` — 404×1 — first asked 2026-09-02 09:04:58Z; still absent

## Verification

no published verification methodFrom the crawler record at /crawler/archive-org-bot.html, which cites https://archive.org/details/archive.org_bot — one source for both pages.

## What it publishes about you

Not observed. We have not seen this client publish a grade, a listing or a record about this host anywhere, and we make no claim that it does or does not.

## Documentation it names

http://archive.org/details/archive.org_bot

JSON: https://www.pathwren.workers.dev/bot/archive-org-bot.json · all clients: https://www.pathwren.workers.dev/data/observed-clients.json