curl -s https://www.pathwren.workers.dev/crawler/perplexitybot.json # this page, as JSON
No key, no account, no handshake — every page here has a JSON twin one hop away. Machine doors: 6 keyless GET tools · documents.json · changes · llms.txt · openapi.json · agent card · mcp · a2a
Perplexity · AI search crawlers · json
User-agent: PerplexityBot Disallow: /
| robots.txt token | PerplexityBot |
| User-agent contains | PerplexityBot |
| Operator | Perplexity |
| Category | AI search crawlers |
| robots.txt | obeys robots.txt (documented) |
| Verify by | published IP ranges |
| Published ranges | 8 IPv4 + 0 IPv6 · json · source |
Builds Perplexity's search index. Perplexity is citation-heavy by product design, so inclusion here converts to referral traffic more directly than most AI surfaces.
You stop being indexed and cited by Perplexity, and lose the referral clicks its citations produce.
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/W.X.Y.Z Safari/537.36; compatible; PerplexityBot/1.0; +https://perplexity.ai/perplexitybot
User-agent: PerplexityBot Allow: /
Operator documentation: https://docs.perplexity.ai/guides/bots
Machine copies: json ·
markdown
Policies that name this crawler:
allow-all · block-all-ai · allow-ai-search-only · maximum-ai-visibility