curl -s https://www.pathwren.workers.dev/policy/index.json   # this page, as JSON

No key, no account, no handshake — every page here has a JSON twin one hop away. Machine doors: 6 keyless GET tools · documents.json · changes · llms.txt · openapi.json · agent card · mcp · a2a

Ready-made robots.txt

Each file names every relevant crawler explicitly, so a later change is a one-line diff and the intent stays readable. Pick the trade-off, curl the file.

curl -s https://www.pathwren.workers.dev/robots/block-ai-training.txt
PolicyCrawlers namedFile
Allow everything, explicitly150.txt
Block AI training, keep AI search27.txt
Block every AI crawler77.txt
Block corpus and dataset builders17.txt
Allow AI search and user fetches, block the rest65.txt
Block SEO and backlink crawlers17.txt
Block the crawlers with disputed robots compliance18.txt
Maximum AI visibility133.txt