curl -s https://www.pathwren.workers.dev/category/user-fetch.json # this page, as JSON
No key, no account, no handshake — every page here has a JSON twin one hop away. Machine doors: 6 keyless GET tools · documents.json · changes · llms.txt · openapi.json · agent card · mcp · a2a
Fetch one page because a person asked for it, right then. One human intent, one request. Blocking them produces a visible error for a real reader.
| Crawler | Token | Operator | Cost of blocking |
|---|---|---|---|
| ChatGPT Agent | ChatGPT-User | OpenAI | Agentic tasks a user asked for — booking, comparing, filling a form on your site — fail. T… |
| ChatGPT-User | ChatGPT-User | OpenAI | ChatGPT cannot open your pages when a user explicitly asks it to. The user sees a fetch fa… |
| Claude-User | Claude-User | Anthropic | Claude reports a fetch failure to a user who asked for your page by name.… |
| cohere-ai | cohere-ai | Cohere | Cohere-powered assistants cannot read your pages on request.… |
| Google-Agent | Google-Agent | Google-hosted agents cannot complete a task on your site for a user who asked them to. Thi… | |
| Google-GeminiNotebook | Google-GeminiNotebook | A user who deliberately added your page as a research source gets nothing. This is a citat… | |
| Google-Pinpoint | Google-Pinpoint | A researcher who explicitly added your page to a collection cannot load it.… | |
| Google-Read-Aloud | Google-Read-Aloud | A reader who asked Google to read your page aloud — often someone using it for accessibili… | |
| meta-externalfetcher | meta-externalfetcher | Meta | Meta AI cannot read pages users hand it.… |
| MistralAI-User | MistralAI-User | Mistral AI | Le Chat cannot open links your readers give it.… |
| Perplexity-User | Perplexity-User | Perplexity | Not controllable via robots.txt. If you must stop it, verify by the published IP ranges an… |
| YandexCalendar | YandexCalendar | Yandex | Users who subscribed to a calendar you publish stop receiving updates.… |