curl -s https://www.pathwren.workers.dev/crawler/linguee-bot.json   # this page, as JSON

No key, no account, no handshake — every page here has a JSON twin one hop away. Machine doors: 6 keyless GET tools · documents.json · changes · llms.txt · openapi.json · agent card · mcp · a2a

Linguee Bot

Linguee · AI training crawlers · json

User-agent: Linguee Bot
Disallow: /
robots.txt tokenLinguee Bot
User-agent containsLinguee Bot
OperatorLinguee
CategoryAI training crawlers
robots.txtcompliance disputed
Verify byno published verification method

What it is

Gathers bilingual text for Linguee's translation corpus and the machine translation trained on it. Recorded in the ai.robots.txt dataset as not respecting robots.txt.

What blocking it costs you

Multilingual pages stop feeding a translation corpus. If your site is translated, being in it is usually a benefit.

Full user-agent string

Linguee Bot

Allow it instead

User-agent: Linguee Bot
Allow: /

Operator documentation: https://www.linguee.com
Machine copies: json · markdown
Policies that name this crawler: allow-all · block-ai-training · block-all-ai · block-disputed · maximum-ai-visibility