curl -s https://www.pathwren.workers.dev/snippet/index.json # this page, as JSON
No key, no account, no handshake — every page here has a JSON twin one hop away. Machine doors: 6 keyless GET tools · documents.json · changes · llms.txt · openapi.json · agent card · mcp · a2a
Generated from the same records as everything else, so they cannot drift from the index.
| Snippet | What it does |
|---|---|
| nginx: classify and block by user-agent | A map block that turns the user-agent into a category, so you can rate-limit training crawlers, allow AI search, and 403 the disputed ones without maintaining three separate if-chains. |
| Caddy: block by user-agent | A Caddy matcher plus respond directive. Caddy's header_regexp matcher is case-sensitive, so the pattern is written with an inline (?i) flag. |
| Apache: .htaccess block | BrowserMatchNoCase plus a Require expression. Works on shared hosting where you cannot edit the main config. |
| Cloudflare Worker: classify at the edge | Fetches this index's regex list at the edge and tags every request with a category header, so your origin can log AI traffic without shipping a bot list to every app. |
| Python: classify a request | Forty lines that load agents.json and return the category, operator and robots token for a user-agent string. The shape most log pipelines need. |