---
title: "User-triggered fetchers (12) — AI Crawler Index"
description: "Fetch one page because a person asked for it, right then. One human intent, one request. Blocking them produces a visible error for a real reader."
canonical: "https://www.pathwren.workers.dev/category/user-fetch.html"
url: "https://www.pathwren.workers.dev/category/user-fetch.md"
format: "markdown"
source: "the bytes of /category/user-fetch.html, in the build that wrote the page"
generator: "surfaces/ai-crawler-index/build.py"
generated: "2026-09-03T06:29:54+00:00"
license: "CC0-1.0"
---

# User-triggered fetchers

> Fetch one page because a person asked for it, right then. One human intent, one request. Blocking them produces a visible error for a real reader.

Fetch one page because a person asked for it, right then. One human intent, one request. Blocking them produces a visible error for a real reader.

| Crawler | Token | Operator | Cost of blocking |
| --- | --- | --- | --- |
| [ChatGPT Agent](https://www.pathwren.workers.dev/crawler/chatgpt-agent.html) | `ChatGPT-User` | OpenAI | Agentic tasks a user asked for — booking, comparing, filling a form on your site — fail. T… |
| [ChatGPT-User](https://www.pathwren.workers.dev/crawler/chatgpt-user.html) | `ChatGPT-User` | OpenAI | ChatGPT cannot open your pages when a user explicitly asks it to. The user sees a fetch fa… |
| [Claude-User](https://www.pathwren.workers.dev/crawler/claude-user.html) | `Claude-User` | Anthropic | Claude reports a fetch failure to a user who asked for your page by name.… |
| [cohere-ai](https://www.pathwren.workers.dev/crawler/cohere-ai.html) | `cohere-ai` | Cohere | Cohere-powered assistants cannot read your pages on request.… |
| [Google-Agent](https://www.pathwren.workers.dev/crawler/google-agent.html) | `Google-Agent` | Google | Google-hosted agents cannot complete a task on your site for a user who asked them to. Thi… |
| [Google-GeminiNotebook](https://www.pathwren.workers.dev/crawler/google-gemininotebook.html) | `Google-GeminiNotebook` | Google | A user who deliberately added your page as a research source gets nothing. This is a citat… |
| [Google-Pinpoint](https://www.pathwren.workers.dev/crawler/google-pinpoint.html) | `Google-Pinpoint` | Google | A researcher who explicitly added your page to a collection cannot load it.… |
| [Google-Read-Aloud](https://www.pathwren.workers.dev/crawler/google-read-aloud.html) | `Google-Read-Aloud` | Google | A reader who asked Google to read your page aloud — often someone using it for accessibili… |
| [meta-externalfetcher](https://www.pathwren.workers.dev/crawler/meta-externalfetcher.html) | `meta-externalfetcher` | Meta | Meta AI cannot read pages users hand it.… |
| [MistralAI-User](https://www.pathwren.workers.dev/crawler/mistralai-user.html) | `MistralAI-User` | Mistral AI | Le Chat cannot open links your readers give it.… |
| [Perplexity-User](https://www.pathwren.workers.dev/crawler/perplexity-user.html) | `Perplexity-User` | Perplexity | Not controllable via robots.txt. If you must stop it, verify by the published IP ranges an… |
| [YandexCalendar](https://www.pathwren.workers.dev/crawler/yandexcalendar.html) | `YandexCalendar` | Yandex | Users who subscribed to a calendar you publish stop receiving updates.… |

[json](https://www.pathwren.workers.dev/category/user-fetch.json)

## Sitemap

- [Full sitemap (XML)](https://www.pathwren.workers.dev/sitemap.xml) — every page, with dates
- [Full sitemap (markdown)](https://www.pathwren.workers.dev/sitemap.md) — the same map, readable
- [llms.txt](https://www.pathwren.workers.dev/llms.txt) — the whole host in one text file
- [documents.json](https://www.pathwren.workers.dev/documents.json) — every document, with its ETag
- [A2A agents](https://www.pathwren.workers.dev/a2a.html)
- [About and method](https://www.pathwren.workers.dev/about.html)
- [API](https://www.pathwren.workers.dev/api.html)
- [Changelog](https://www.pathwren.workers.dev/changelog.html)
- [Compliance](https://www.pathwren.workers.dev/compliance)
- [Contact](https://www.pathwren.workers.dev/contact)
- [Impressum · Anbieterkennzeichnung](https://www.pathwren.workers.dev/impressum)
- [AI Crawler Index](https://www.pathwren.workers.dev/index.html)
- [No model runs here](https://www.pathwren.workers.dev/inference.html)
- [Legal](https://www.pathwren.workers.dev/legal)
- [MCP server](https://www.pathwren.workers.dev/mcp-doctor.html)
- [MCP server](https://www.pathwren.workers.dev/mcp-lint.html)
- [MCP server](https://www.pathwren.workers.dev/mcp-netcheck.html)
- [MCP server](https://www.pathwren.workers.dev/mcp-robots.html)
- [MCP transport: the GET and HEAD leg](https://www.pathwren.workers.dev/mcp-transport.html)
- [MCP server](https://www.pathwren.workers.dev/mcp-triage.html)
- [MCP server](https://www.pathwren.workers.dev/mcp.html)
- [Packages](https://www.pathwren.workers.dev/packages.html)
- [Pricing](https://www.pathwren.workers.dev/pricing)
- [Privacy](https://www.pathwren.workers.dev/privacy.html)
- [API reference](https://www.pathwren.workers.dev/reference)
- [Access, keys and sign-up](https://www.pathwren.workers.dev/register)
- [Security posture](https://www.pathwren.workers.dev/security.html)
- [Upstream status](https://www.pathwren.workers.dev/status.html)
- [Terms of use](https://www.pathwren.workers.dev/terms.html)
- [Trust](https://www.pathwren.workers.dev/trust)

## Machine copies of this page

- [HTML (canonical)](https://www.pathwren.workers.dev/category/user-fetch.html)
- [JSON](https://www.pathwren.workers.dev/category/user-fetch.json)
- [Markdown](https://www.pathwren.workers.dev/category/user-fetch.md) — this document

This document is a markdown rendering of [https://www.pathwren.workers.dev/category/user-fetch.html](https://www.pathwren.workers.dev/category/user-fetch.html), generated from that page's own bytes in the same build. The HTML page is canonical.
