ClaudeBot

What this client asked www.pathwren.workers.dev for, when, and what it got. Every number below is from this host's own server-side request log, 2026-09-01 00:46:32Z to 2026-09-03 06:00:46Z UTC.

Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; ClaudeBot/1.0; +http://www.anthropic.com/claude-bot

1342 request(s) from 6 distinct address(es), 861 distinct path(s), first seen 2026-09-01 00:46:32Z, last seen 2026-09-03 06:00:46Z UTC. 40 separate visit(s), counting a gap of more than 30 minutes as a new one, median 74.3 minutes between them.

It describes itself, inside its own user-agent, as ClaudeBot/1.0. That is the client's own words, quoted; this page makes no claim about what it is for.

The crawler catalogue on this site has a record for it: /crawler/claudebot.html — what it is for, and what blocking it costs. This page is only what it did here.

The user-agent strings, exactly as they arrived

user-agentrequestsaddressesfirst seenlast seen
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)134152026-09-01 00:46:32Z2026-09-03 05:57:59Z
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; ClaudeBot/1.0; +http://www.anthropic.com/claude-bot112026-09-03 06:00:46Z2026-09-03 06:00:46Z

What it asked for, in the order it asked

First request to each path, oldest first, first 40 shown.

#pathat (UTC)status
1/robots.txt2026-09-01 00:46:32Z200
2/mcp.html2026-09-01 00:46:32Z200
3/2026-09-01 01:09:23Z200
4/data/2026-09-01 01:09:23Z200
5/feed.xml2026-09-01 01:09:46Z200
6/api.html2026-09-01 01:09:46Z200
7/openapi.json2026-09-01 01:09:51Z200
8/operator/2026-09-01 01:09:52Z200
9/about.html2026-09-01 01:10:11Z200
10/status.html2026-09-01 01:10:11Z200
11/data/agents.json2026-09-01 01:10:20Z200
12/feed.json2026-09-01 01:10:21Z200
13/policy/2026-09-01 01:10:38Z200
14/crawler/2026-09-01 01:10:38Z200
15/llms.txt2026-09-01 01:10:46Z200
16/ip-ranges/2026-09-01 01:10:46Z200
17/favicon.ico2026-09-01 01:10:48Z200
18/icon.png2026-09-01 01:10:48Z200
19/apple-touch-icon.png2026-09-01 01:11:04Z200
20/px.gif2026-09-01 01:11:12Z200
21/data/agents.csv2026-09-01 01:32:51Z200
22/operator/diffbot.html2026-09-01 01:32:51Z200
23/crawler/diffbot.html2026-09-01 01:32:51Z200
24/operator/amazon.html2026-09-01 01:32:52Z200
25/stats.json2026-09-01 01:32:53Z200
26/operator/google.html2026-09-01 01:32:53Z200
27/status.json2026-09-01 01:32:53Z200
28/operator/microsoft.html2026-09-01 01:32:54Z200
29/operator/semrush.html2026-09-01 01:32:54Z200
30/operator/perplexity.html2026-09-01 01:32:55Z200
31/operator/apple.html2026-09-01 01:33:26Z200
32/index.html2026-09-01 01:33:26Z200
33/data/index.html2026-09-01 01:33:26Z200
34/operator/meta.html2026-09-01 01:33:26Z200
35/openapi.yaml2026-09-01 01:33:27Z200
36/operator/cohere.html2026-09-01 01:33:27Z200
37/operator/commoncrawl.html2026-09-01 01:33:27Z200
38/apis.json2026-09-01 01:33:27Z200
39/operator/webz.html2026-09-01 01:33:28Z200
40/operator/you.html2026-09-01 01:33:28Z200

Everything it asked for

pathrequestsstatus codesfirstlast
/px.gif368200×3682026-09-01 01:11:12Z2026-09-03 03:51:42Z
/robots.txt28200×282026-09-01 00:46:32Z2026-09-03 05:16:23Z
/sitemap.xml26200×262026-09-01 03:13:03Z2026-09-03 05:16:23Z
/3200×32026-09-01 01:09:23Z2026-09-03 06:00:46Z
/category/ai-training.json2200×22026-09-01 01:59:19Z2026-09-01 12:04:56Z
/category/preview.json2200×22026-09-01 01:58:06Z2026-09-01 12:04:15Z
/category/user-fetch.json2200×22026-09-01 01:59:14Z2026-09-01 12:04:37Z
/crawler/ai2bot.md2200×22026-09-01 01:59:14Z2026-09-01 12:04:37Z
/crawler/amazonbot.md2200×22026-09-01 01:58:05Z2026-09-01 12:04:14Z
/crawler/applebot-extended.json2200×22026-09-01 01:59:19Z2026-09-01 12:04:57Z
/crawler/applebot-extended.md2200×22026-09-01 01:59:31Z2026-09-01 12:05:09Z
/crawler/applebot.json2200×22026-09-01 01:58:05Z2026-09-01 12:04:13Z
/crawler/baiduspider.md2200×22026-09-01 01:59:19Z2026-09-01 12:04:57Z
/crawler/bingbot.json2200×22026-09-01 01:58:06Z2026-09-01 12:04:16Z
/crawler/chatgpt-user.json2200×22026-09-01 01:59:30Z2026-09-01 12:05:08Z
/crawler/chatgpt-user.md2200×22026-09-01 01:59:47Z2026-09-01 12:05:27Z
/crawler/claude-user.json2200×22026-09-01 01:59:19Z2026-09-01 12:04:56Z
/crawler/claude-user.md2200×22026-09-01 01:59:31Z2026-09-01 12:05:08Z
/crawler/claude-web.json2200×22026-09-01 01:59:15Z2026-09-01 12:04:38Z
/crawler/claude-web.md2200×22026-09-01 01:59:30Z2026-09-01 12:05:08Z
/crawler/claudebot.json2200×22026-09-01 01:59:14Z2026-09-01 12:04:37Z
/crawler/claudebot.md2200×22026-09-01 01:59:30Z2026-09-01 12:05:08Z
/crawler/cohere-ai.json2200×22026-09-01 01:59:20Z2026-09-01 12:04:58Z
/crawler/cohere-ai.md2200×22026-09-01 01:59:47Z2026-09-01 12:05:27Z
/crawler/duckduckbot.json2200×22026-09-01 01:59:19Z2026-09-01 12:04:57Z
/crawler/duckduckbot.md2200×22026-09-01 01:59:31Z2026-09-01 12:05:09Z
/crawler/google-cloudvertexbot.md2200×22026-09-01 01:59:14Z2026-09-01 12:04:37Z
/crawler/google-extended.md2200×22026-09-01 01:59:19Z2026-09-01 12:04:56Z
/crawler/googlebot.md2200×22026-09-01 01:58:06Z2026-09-01 12:04:14Z
/crawler/imagesiftbot.md2200×22026-09-01 01:59:19Z2026-09-01 12:04:57Z
/crawler/img2dataset.json2200×22026-09-01 01:59:19Z2026-09-01 12:04:57Z
/crawler/img2dataset.md2200×22026-09-01 01:59:31Z2026-09-01 12:05:09Z
/crawler/meta-externalagent.md2200×22026-09-01 01:59:14Z2026-09-01 12:04:36Z
/crawler/omgili.json2200×22026-09-01 01:59:30Z2026-09-01 12:05:08Z
/crawler/omgili.md2200×22026-09-01 01:59:47Z2026-09-01 12:05:27Z
/crawler/petalbot.md2200×22026-09-01 01:59:19Z2026-09-01 12:04:58Z
/crawler/semrushbot-ocob.json2200×22026-09-01 01:59:19Z2026-09-01 12:04:57Z
/crawler/semrushbot-ocob.md2200×22026-09-01 01:59:31Z2026-09-01 12:05:09Z
/crawler/semrushbot.json2200×22026-09-01 01:58:05Z2026-09-01 12:04:12Z
/crawler/timpibot.json2200×22026-09-01 01:59:15Z2026-09-01 12:04:38Z
/crawler/timpibot.md2200×22026-09-01 01:59:31Z2026-09-01 12:05:08Z
/crawler/yandexbot.json2200×22026-09-01 01:59:15Z2026-09-01 12:04:38Z
/crawler/yandexbot.md2200×22026-09-01 01:59:30Z2026-09-01 12:05:08Z
/crawler/yeti.md2200×22026-09-01 01:59:14Z2026-09-01 12:04:36Z
/ip-ranges/apple-applebot.json2200×22026-09-01 01:59:20Z2026-09-01 12:04:58Z
/ip-ranges/apple-applebot.txt2200×22026-09-01 01:59:47Z2026-09-01 12:05:28Z
/ip-ranges/bing-bingbot.json2200×22026-09-01 01:59:30Z2026-09-01 12:05:08Z
/ip-ranges/duckduckgo-duckduckbot.json2200×22026-09-01 01:59:47Z2026-09-01 12:05:28Z
/ip-ranges/google-special.json2200×22026-09-01 01:59:15Z2026-09-01 12:04:39Z
/ip-ranges/google-special.txt2200×22026-09-01 01:59:47Z2026-09-01 12:05:28Z
/ip-ranges/openai-chatgpt-user.json2200×22026-09-01 01:59:47Z2026-09-01 12:05:28Z
/mcp.html2200×22026-09-01 00:46:32Z2026-09-02 05:38:29Z
/operator/ahrefs.json2200×22026-09-01 01:58:05Z2026-09-01 12:04:12Z
/operator/baidu.json2200×22026-09-01 01:58:06Z2026-09-01 12:04:15Z
/operator/duckduckgo.json2200×22026-09-01 01:59:14Z2026-09-01 12:04:37Z
/operator/internetarchive.json2200×22026-09-01 01:58:05Z2026-09-01 12:04:11Z
/operator/laion.json2200×22026-09-01 01:58:05Z2026-09-01 12:04:13Z
/operator/mistral.json2200×22026-09-01 01:58:05Z2026-09-01 12:04:11Z
/operator/scrapy.json2200×22026-09-01 01:58:06Z2026-09-01 12:04:15Z
/operator/timpi.json2200×22026-09-01 01:58:06Z2026-09-01 12:04:15Z

801 further paths are in the JSON.

What it asked for that did not exist

path it asked forwhat it gotfirst askedsince then
/.well-known/oauth-authorization-server404×12026-09-01 18:32:06Zstill absent — on purpose: No

What it got, and what it sent

Status codes
200×1341, 404×1
Accept headers
*/*
Bytes served
7692997
Attributed to a channel
huggingface-datasets (9), mcp-registry-official (6), a2a-directory (6), agent-tools-cloud (3), direct (1), pypi-registry (1), mcpservers-org (1), freepublicapis (1), a2a-registry-org (1), thecolony (1)
Our instrument classed it
agent×917, crawler×425 — that is our classifier's label from the user-agent, not the operator's, and it has been wrong before.

How to verify it is really them

no published verification method

From the crawler record at /crawler/claudebot.html, which cites https://support.anthropic.com/en/articles/8896518 — one source for both pages.

What it publishes about you afterwards

Not observed. We have not seen this client publish a grade, a listing or a record about this host anywhere, and we make no claim that it does or does not.

Its own documentation

It names mailto:claudebot@anthropic.com in its own user-agent. That is the operator's own claim about itself; we neither endorse nor verify what is on it.

This page as data

curl -s https://www.pathwren.workers.dev/bot/claudebot.json
curl -s https://www.pathwren.workers.dev/data/observed-clients.json   # every client, one request

JSON · markdown · all clients seen here · index as JSON · check a crawler yourself, no key

Method, and what this page will not say

Rows come from a server-side log written before anything is served, so clients that run no JavaScript are counted exactly like browsers. The window is the whole life of the log, 2026-09-01 00:46:32Z to 2026-09-03 06:00:46Z UTC, and it is stated on every number because a count without a window is not a fact. Addresses are stored as salted hashes and counted, never printed. Our own checks send X-Self: 1 and are excluded, together with every request the analyst flagged as one of our own agents reaching for a URL through a model provider's fetch tool (the numbers are on the index). Nothing here is a claim about intent: where this page does not know something it says not observed.