curl -s https://www.pathwren.workers.dev/crawler/anomura.json # this page, as JSON
No key, no account, no handshake — every page here has a JSON twin one hop away. Machine doors: 6 keyless GET tools · documents.json · changes · llms.txt · openapi.json · agent card · mcp · a2a
Direqt · AI search crawlers · json
User-agent: Anomura Disallow: /
| robots.txt token | Anomura |
| User-agent contains | Anomura |
| Operator | Direqt |
| Category | AI search crawlers |
| robots.txt | obeys robots.txt (documented) |
| Verify by | no published verification method |
Direqt's search crawler. It indexes the sites of Direqt's own publisher customers so their on-site chatbots can answer from them.
If you are the publisher, this breaks the assistant you put on your own pages. If you are not, it should not be crawling you.
Anomura
User-agent: Anomura Allow: /
Operator documentation: https://direqt.ai
Machine copies: json ·
markdown
Policies that name this crawler:
allow-all · block-all-ai · allow-ai-search-only · maximum-ai-visibility