robots.txt policy: Block every AI crawler

Training, AI search, user-triggered fetches and corpus builders, all refused. Classic search engines still allowed. The maximal AI opt-out that still leaves you in Google and Bing. Understand the price before deploying it: you will not be cited by any assistant, and when a reader explicitly asks ChatGPT or Claude to open your page, they get an error. Note also that Perplexity-User and Bytespider are listed here but documented as not governed by robots.txt, so this file is a statement of intent for those two, not an enforcement mechanism. curl -s https://www.pathwren.workers.dev/robots/block-all-ai.txt