What this client asked www.pathwren.workers.dev for, when, and what it got.
Every number below is from this host's own server-side request log, 2026-09-01 00:46:32Z to 2026-09-03 06:00:46Z UTC.
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; ClaudeBot/1.0; +http://www.anthropic.com/claude-bot
1342 request(s) from 6 distinct address(es), 861 distinct path(s), first seen 2026-09-01 00:46:32Z, last seen 2026-09-03 06:00:46Z UTC. 40 separate visit(s), counting a gap of more than 30 minutes as a new one, median 74.3 minutes between them.
It describes itself, inside its own user-agent, as ClaudeBot/1.0
. That is the client's own words, quoted; this page makes no claim about what it is for.
The crawler catalogue on this site has a record for it: /crawler/claudebot.html — what it is for, and what blocking it costs. This page is only what it did here.
| user-agent | requests | addresses | first seen | last seen |
|---|---|---|---|---|
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) | 1341 | 5 | 2026-09-01 00:46:32Z | 2026-09-03 05:57:59Z |
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; ClaudeBot/1.0; +http://www.anthropic.com/claude-bot | 1 | 1 | 2026-09-03 06:00:46Z | 2026-09-03 06:00:46Z |
First request to each path, oldest first, first 40 shown.
| # | path | at (UTC) | status |
|---|---|---|---|
| 1 | /robots.txt | 2026-09-01 00:46:32Z | 200 |
| 2 | /mcp.html | 2026-09-01 00:46:32Z | 200 |
| 3 | / | 2026-09-01 01:09:23Z | 200 |
| 4 | /data/ | 2026-09-01 01:09:23Z | 200 |
| 5 | /feed.xml | 2026-09-01 01:09:46Z | 200 |
| 6 | /api.html | 2026-09-01 01:09:46Z | 200 |
| 7 | /openapi.json | 2026-09-01 01:09:51Z | 200 |
| 8 | /operator/ | 2026-09-01 01:09:52Z | 200 |
| 9 | /about.html | 2026-09-01 01:10:11Z | 200 |
| 10 | /status.html | 2026-09-01 01:10:11Z | 200 |
| 11 | /data/agents.json | 2026-09-01 01:10:20Z | 200 |
| 12 | /feed.json | 2026-09-01 01:10:21Z | 200 |
| 13 | /policy/ | 2026-09-01 01:10:38Z | 200 |
| 14 | /crawler/ | 2026-09-01 01:10:38Z | 200 |
| 15 | /llms.txt | 2026-09-01 01:10:46Z | 200 |
| 16 | /ip-ranges/ | 2026-09-01 01:10:46Z | 200 |
| 17 | /favicon.ico | 2026-09-01 01:10:48Z | 200 |
| 18 | /icon.png | 2026-09-01 01:10:48Z | 200 |
| 19 | /apple-touch-icon.png | 2026-09-01 01:11:04Z | 200 |
| 20 | /px.gif | 2026-09-01 01:11:12Z | 200 |
| 21 | /data/agents.csv | 2026-09-01 01:32:51Z | 200 |
| 22 | /operator/diffbot.html | 2026-09-01 01:32:51Z | 200 |
| 23 | /crawler/diffbot.html | 2026-09-01 01:32:51Z | 200 |
| 24 | /operator/amazon.html | 2026-09-01 01:32:52Z | 200 |
| 25 | /stats.json | 2026-09-01 01:32:53Z | 200 |
| 26 | /operator/google.html | 2026-09-01 01:32:53Z | 200 |
| 27 | /status.json | 2026-09-01 01:32:53Z | 200 |
| 28 | /operator/microsoft.html | 2026-09-01 01:32:54Z | 200 |
| 29 | /operator/semrush.html | 2026-09-01 01:32:54Z | 200 |
| 30 | /operator/perplexity.html | 2026-09-01 01:32:55Z | 200 |
| 31 | /operator/apple.html | 2026-09-01 01:33:26Z | 200 |
| 32 | /index.html | 2026-09-01 01:33:26Z | 200 |
| 33 | /data/index.html | 2026-09-01 01:33:26Z | 200 |
| 34 | /operator/meta.html | 2026-09-01 01:33:26Z | 200 |
| 35 | /openapi.yaml | 2026-09-01 01:33:27Z | 200 |
| 36 | /operator/cohere.html | 2026-09-01 01:33:27Z | 200 |
| 37 | /operator/commoncrawl.html | 2026-09-01 01:33:27Z | 200 |
| 38 | /apis.json | 2026-09-01 01:33:27Z | 200 |
| 39 | /operator/webz.html | 2026-09-01 01:33:28Z | 200 |
| 40 | /operator/you.html | 2026-09-01 01:33:28Z | 200 |
| path | requests | status codes | first | last |
|---|---|---|---|---|
/px.gif | 368 | 200×368 | 2026-09-01 01:11:12Z | 2026-09-03 03:51:42Z |
/robots.txt | 28 | 200×28 | 2026-09-01 00:46:32Z | 2026-09-03 05:16:23Z |
/sitemap.xml | 26 | 200×26 | 2026-09-01 03:13:03Z | 2026-09-03 05:16:23Z |
/ | 3 | 200×3 | 2026-09-01 01:09:23Z | 2026-09-03 06:00:46Z |
/category/ai-training.json | 2 | 200×2 | 2026-09-01 01:59:19Z | 2026-09-01 12:04:56Z |
/category/preview.json | 2 | 200×2 | 2026-09-01 01:58:06Z | 2026-09-01 12:04:15Z |
/category/user-fetch.json | 2 | 200×2 | 2026-09-01 01:59:14Z | 2026-09-01 12:04:37Z |
/crawler/ai2bot.md | 2 | 200×2 | 2026-09-01 01:59:14Z | 2026-09-01 12:04:37Z |
/crawler/amazonbot.md | 2 | 200×2 | 2026-09-01 01:58:05Z | 2026-09-01 12:04:14Z |
/crawler/applebot-extended.json | 2 | 200×2 | 2026-09-01 01:59:19Z | 2026-09-01 12:04:57Z |
/crawler/applebot-extended.md | 2 | 200×2 | 2026-09-01 01:59:31Z | 2026-09-01 12:05:09Z |
/crawler/applebot.json | 2 | 200×2 | 2026-09-01 01:58:05Z | 2026-09-01 12:04:13Z |
/crawler/baiduspider.md | 2 | 200×2 | 2026-09-01 01:59:19Z | 2026-09-01 12:04:57Z |
/crawler/bingbot.json | 2 | 200×2 | 2026-09-01 01:58:06Z | 2026-09-01 12:04:16Z |
/crawler/chatgpt-user.json | 2 | 200×2 | 2026-09-01 01:59:30Z | 2026-09-01 12:05:08Z |
/crawler/chatgpt-user.md | 2 | 200×2 | 2026-09-01 01:59:47Z | 2026-09-01 12:05:27Z |
/crawler/claude-user.json | 2 | 200×2 | 2026-09-01 01:59:19Z | 2026-09-01 12:04:56Z |
/crawler/claude-user.md | 2 | 200×2 | 2026-09-01 01:59:31Z | 2026-09-01 12:05:08Z |
/crawler/claude-web.json | 2 | 200×2 | 2026-09-01 01:59:15Z | 2026-09-01 12:04:38Z |
/crawler/claude-web.md | 2 | 200×2 | 2026-09-01 01:59:30Z | 2026-09-01 12:05:08Z |
/crawler/claudebot.json | 2 | 200×2 | 2026-09-01 01:59:14Z | 2026-09-01 12:04:37Z |
/crawler/claudebot.md | 2 | 200×2 | 2026-09-01 01:59:30Z | 2026-09-01 12:05:08Z |
/crawler/cohere-ai.json | 2 | 200×2 | 2026-09-01 01:59:20Z | 2026-09-01 12:04:58Z |
/crawler/cohere-ai.md | 2 | 200×2 | 2026-09-01 01:59:47Z | 2026-09-01 12:05:27Z |
/crawler/duckduckbot.json | 2 | 200×2 | 2026-09-01 01:59:19Z | 2026-09-01 12:04:57Z |
/crawler/duckduckbot.md | 2 | 200×2 | 2026-09-01 01:59:31Z | 2026-09-01 12:05:09Z |
/crawler/google-cloudvertexbot.md | 2 | 200×2 | 2026-09-01 01:59:14Z | 2026-09-01 12:04:37Z |
/crawler/google-extended.md | 2 | 200×2 | 2026-09-01 01:59:19Z | 2026-09-01 12:04:56Z |
/crawler/googlebot.md | 2 | 200×2 | 2026-09-01 01:58:06Z | 2026-09-01 12:04:14Z |
/crawler/imagesiftbot.md | 2 | 200×2 | 2026-09-01 01:59:19Z | 2026-09-01 12:04:57Z |
/crawler/img2dataset.json | 2 | 200×2 | 2026-09-01 01:59:19Z | 2026-09-01 12:04:57Z |
/crawler/img2dataset.md | 2 | 200×2 | 2026-09-01 01:59:31Z | 2026-09-01 12:05:09Z |
/crawler/meta-externalagent.md | 2 | 200×2 | 2026-09-01 01:59:14Z | 2026-09-01 12:04:36Z |
/crawler/omgili.json | 2 | 200×2 | 2026-09-01 01:59:30Z | 2026-09-01 12:05:08Z |
/crawler/omgili.md | 2 | 200×2 | 2026-09-01 01:59:47Z | 2026-09-01 12:05:27Z |
/crawler/petalbot.md | 2 | 200×2 | 2026-09-01 01:59:19Z | 2026-09-01 12:04:58Z |
/crawler/semrushbot-ocob.json | 2 | 200×2 | 2026-09-01 01:59:19Z | 2026-09-01 12:04:57Z |
/crawler/semrushbot-ocob.md | 2 | 200×2 | 2026-09-01 01:59:31Z | 2026-09-01 12:05:09Z |
/crawler/semrushbot.json | 2 | 200×2 | 2026-09-01 01:58:05Z | 2026-09-01 12:04:12Z |
/crawler/timpibot.json | 2 | 200×2 | 2026-09-01 01:59:15Z | 2026-09-01 12:04:38Z |
/crawler/timpibot.md | 2 | 200×2 | 2026-09-01 01:59:31Z | 2026-09-01 12:05:08Z |
/crawler/yandexbot.json | 2 | 200×2 | 2026-09-01 01:59:15Z | 2026-09-01 12:04:38Z |
/crawler/yandexbot.md | 2 | 200×2 | 2026-09-01 01:59:30Z | 2026-09-01 12:05:08Z |
/crawler/yeti.md | 2 | 200×2 | 2026-09-01 01:59:14Z | 2026-09-01 12:04:36Z |
/ip-ranges/apple-applebot.json | 2 | 200×2 | 2026-09-01 01:59:20Z | 2026-09-01 12:04:58Z |
/ip-ranges/apple-applebot.txt | 2 | 200×2 | 2026-09-01 01:59:47Z | 2026-09-01 12:05:28Z |
/ip-ranges/bing-bingbot.json | 2 | 200×2 | 2026-09-01 01:59:30Z | 2026-09-01 12:05:08Z |
/ip-ranges/duckduckgo-duckduckbot.json | 2 | 200×2 | 2026-09-01 01:59:47Z | 2026-09-01 12:05:28Z |
/ip-ranges/google-special.json | 2 | 200×2 | 2026-09-01 01:59:15Z | 2026-09-01 12:04:39Z |
/ip-ranges/google-special.txt | 2 | 200×2 | 2026-09-01 01:59:47Z | 2026-09-01 12:05:28Z |
/ip-ranges/openai-chatgpt-user.json | 2 | 200×2 | 2026-09-01 01:59:47Z | 2026-09-01 12:05:28Z |
/mcp.html | 2 | 200×2 | 2026-09-01 00:46:32Z | 2026-09-02 05:38:29Z |
/operator/ahrefs.json | 2 | 200×2 | 2026-09-01 01:58:05Z | 2026-09-01 12:04:12Z |
/operator/baidu.json | 2 | 200×2 | 2026-09-01 01:58:06Z | 2026-09-01 12:04:15Z |
/operator/duckduckgo.json | 2 | 200×2 | 2026-09-01 01:59:14Z | 2026-09-01 12:04:37Z |
/operator/internetarchive.json | 2 | 200×2 | 2026-09-01 01:58:05Z | 2026-09-01 12:04:11Z |
/operator/laion.json | 2 | 200×2 | 2026-09-01 01:58:05Z | 2026-09-01 12:04:13Z |
/operator/mistral.json | 2 | 200×2 | 2026-09-01 01:58:05Z | 2026-09-01 12:04:11Z |
/operator/scrapy.json | 2 | 200×2 | 2026-09-01 01:58:06Z | 2026-09-01 12:04:15Z |
/operator/timpi.json | 2 | 200×2 | 2026-09-01 01:58:06Z | 2026-09-01 12:04:15Z |
801 further paths are in the JSON.
| path it asked for | what it got | first asked | since then |
|---|---|---|---|
/.well-known/oauth-authorization-server | 404×1 | 2026-09-01 18:32:06Z | still absent — on purpose: No |
no published verification method
From the crawler record at /crawler/claudebot.html, which cites https://support.anthropic.com/en/articles/8896518 — one source for both pages.
Not observed. We have not seen this client publish a grade, a listing or a record about this host anywhere, and we make no claim that it does or does not.
It names mailto:claudebot@anthropic.com in its own user-agent. That is the operator's own claim about itself; we neither endorse nor verify what is on it.
curl -s https://www.pathwren.workers.dev/bot/claudebot.json curl -s https://www.pathwren.workers.dev/data/observed-clients.json # every client, one request
JSON · markdown · all clients seen here · index as JSON · check a crawler yourself, no key
Rows come from a server-side log written before anything is served, so clients that
run no JavaScript are counted exactly like browsers. The window is the whole life of the log,
2026-09-01 00:46:32Z to 2026-09-03 06:00:46Z UTC, and it is stated on every number because a count without a window is
not a fact. Addresses are stored as salted hashes and counted, never printed. Our own checks
send X-Self: 1 and are excluded, together with every request the analyst flagged
as one of our own agents reaching for a URL through a model provider's fetch tool
(the numbers are on the index). Nothing here is a claim about
intent: where this page does not know something it says not observed
.