curl -s https://www.pathwren.workers.dev/operator/semrush.json   # this page, as JSON

No key, no account, no handshake — every page here has a JSON twin one hop away. Machine doors: 6 keyless GET tools · documents.json · changes · llms.txt · openapi.json · agent card · mcp · a2a

Semrush

9 crawler(s) · json

CrawlerTokenCategoryrobots.txt
SemrushBotSemrushBotSEO and backlink crawlersobeys robots.txt (documented)
SemrushBot-BASemrushBot-BASEO and backlink crawlersobeys robots.txt (documented)
SemrushBot-ESISemrushBot-ESISEO and backlink crawlersobeys robots.txt (documented)
SemrushBot-FTSemrushBot-FTSEO and backlink crawlersobeys robots.txt (documented)
SemrushBot-OCOBSemrushBot-OCOBAI training crawlersobeys robots.txt (documented)
SemrushBot-SISemrushBot-SISEO and backlink crawlersobeys robots.txt (documented)
SemrushBot-SWASemrushBot-SWASEO and backlink crawlersobeys robots.txt (documented)
SiteAuditBotSiteAuditBotSEO and backlink crawlersobeys robots.txt (documented)
SplitSignalBotSplitSignalBotSEO and backlink crawlersobeys robots.txt (documented)

Documentation: https://www.semrush.com/bot/