curl -s https://www.pathwren.workers.dev/crawler/phindbot.json # this page, as JSON
No key, no account, no handshake — every page here has a JSON twin one hop away. Machine doors: 6 keyless GET tools · documents.json · changes · llms.txt · openapi.json · agent card · mcp · a2a
Phind · AI search crawlers · json
User-agent: PhindBot Disallow: /
| robots.txt token | PhindBot |
| User-agent contains | PhindBot |
| Operator | Phind |
| Category | AI search crawlers |
| robots.txt | operator publishes no robots.txt statement |
| Verify by | no published verification method |
Phind is an answer engine for developers that combines live web search with its own models. This is the crawler behind those answers.
You stop being cited in answers to technical questions — which, for documentation and reference sites, is the exact audience most worth keeping.
PhindBot
User-agent: PhindBot Allow: /
Operator documentation: https://www.phind.com/
Machine copies: json ·
markdown
Policies that name this crawler:
allow-all · block-all-ai · allow-ai-search-only · maximum-ai-visibility