curl -s https://www.pathwren.workers.dev/crawler/amazonbot.json   # this page, as JSON

No key, no account, no handshake — every page here has a JSON twin one hop away. Machine doors: 6 keyless GET tools · documents.json · changes · llms.txt · openapi.json · agent card · mcp · a2a

Amazonbot

Amazon · AI search crawlers · json

User-agent: Amazonbot
Disallow: /
robots.txt tokenAmazonbot
User-agent containsAmazonbot
OperatorAmazon
CategoryAI search crawlers
robots.txtobeys robots.txt (documented)
Verify byreverse DNS

What it is

Amazon's crawler, feeding Alexa's ability to answer questions from the web and Amazon's own search and assistant products.

What blocking it costs you

Alexa and Amazon's assistants stop answering from your pages. Verify with reverse DNS to crawl.amazonbot.amazon before trusting the user-agent.

Full user-agent string

Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/W.X.Y.Z Mobile Safari/537.36 (compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot)

Allow it instead

User-agent: Amazonbot
Allow: /

Operator documentation: https://developer.amazon.com/amazonbot
Machine copies: json · markdown
Policies that name this crawler: allow-all · block-all-ai · allow-ai-search-only · maximum-ai-visibility