--- title: "Yandex crawlers (17) — AI Crawler Index" description: "Every crawler Yandex operates, its robots.txt token, and what blocking it costs." canonical: "https://www.pathwren.workers.dev/operator/yandex.html" url: "https://www.pathwren.workers.dev/operator/yandex.md" format: "markdown" source: "the bytes of /operator/yandex.html, in the build that wrote the page" generator: "surfaces/ai-crawler-index/build.py" generated: "2026-09-03T07:55:35+00:00" license: "CC0-1.0" --- # Yandex > Every crawler Yandex operates, its robots.txt token, and what blocking it costs. 17 crawler(s) · [json](https://www.pathwren.workers.dev/operator/yandex.json) | Crawler | Token | Category | robots.txt | | --- | --- | --- | --- | | [YandexAdditional](https://www.pathwren.workers.dev/crawler/yandexadditional.html) | `YandexAdditional` | AI training crawlers | ignores the * group; obeys rules named for its own token | | [YandexAdditionalBot](https://www.pathwren.workers.dev/crawler/yandexadditionalbot.html) | `YandexAdditionalBot` | AI training crawlers | ignores the * group; obeys rules named for its own token | | [YandexBlogs](https://www.pathwren.workers.dev/crawler/yandexblogs.html) | `YandexBlogs` | Search engines | obeys robots.txt (documented) | | [YandexBot](https://www.pathwren.workers.dev/crawler/yandexbot.html) | `YandexBot` | Search engines | obeys robots.txt (documented) | | [YandexCalendar](https://www.pathwren.workers.dev/crawler/yandexcalendar.html) | `YandexCalendar` | User-triggered fetchers | ignores the * group; obeys rules named for its own token | | [YandexComBot](https://www.pathwren.workers.dev/crawler/yandexcombot.html) | `YandexComBot` | Search engines | ignores the * group; obeys rules named for its own token | | [YandexDirect](https://www.pathwren.workers.dev/crawler/yandexdirect.html) | `YandexDirect` | Tools and frameworks | ignores the * group; obeys rules named for its own token | | [YandexFavicons](https://www.pathwren.workers.dev/crawler/yandexfavicons.html) | `YandexFavicons` | Search engines | ignores the * group; obeys rules named for its own token | | [YandexImages](https://www.pathwren.workers.dev/crawler/yandeximages.html) | `YandexImages` | Search engines | obeys robots.txt (documented) | | [YandexMarket](https://www.pathwren.workers.dev/crawler/yandexmarket.html) | `YandexMarket` | Search engines | obeys robots.txt (documented) | | [YandexMedia](https://www.pathwren.workers.dev/crawler/yandexmedia.html) | `YandexMedia` | Search engines | obeys robots.txt (documented) | | [YandexMetrika](https://www.pathwren.workers.dev/crawler/yandexmetrika.html) | `YandexMetrika` | Tools and frameworks | not governed by robots.txt (user-initiated, by operator policy) | | [YandexMobileBot](https://www.pathwren.workers.dev/crawler/yandexmobilebot.html) | `YandexMobileBot` | Search engines | ignores the * group; obeys rules named for its own token | | [YandexRenderResourcesBot](https://www.pathwren.workers.dev/crawler/yandexrenderresourcesbot.html) | `YandexRenderResourcesBot` | Search engines | ignores the * group; obeys rules named for its own token | | [YandexScreenshotBot](https://www.pathwren.workers.dev/crawler/yandexscreenshotbot.html) | `YandexScreenshotBot` | Tools and frameworks | ignores the * group; obeys rules named for its own token | | [YandexVideo](https://www.pathwren.workers.dev/crawler/yandexvideo.html) | `YandexVideo` | Search engines | obeys robots.txt (documented) | | [YandexWebmaster](https://www.pathwren.workers.dev/crawler/yandexwebmaster.html) | `YandexWebmaster` | Tools and frameworks | obeys robots.txt (documented) | Documentation: [https://yandex.com/support/webmaster/robot-workings/check-yandex-robots.html](https://yandex.com/support/webmaster/robot-workings/check-yandex-robots.html) ## Sitemap - [Full sitemap (XML)](https://www.pathwren.workers.dev/sitemap.xml) — every page, with dates - [Full sitemap (markdown)](https://www.pathwren.workers.dev/sitemap.md) — the same map, readable - [llms.txt](https://www.pathwren.workers.dev/llms.txt) — the whole host in one text file - [documents.json](https://www.pathwren.workers.dev/documents.json) — every document, with its ETag - [A2A agents](https://www.pathwren.workers.dev/a2a.html) - [About and method](https://www.pathwren.workers.dev/about.html) - [API](https://www.pathwren.workers.dev/api.html) - [Changelog](https://www.pathwren.workers.dev/changelog.html) - [Compliance](https://www.pathwren.workers.dev/compliance) - [Contact](https://www.pathwren.workers.dev/contact) - [Impressum · Anbieterkennzeichnung](https://www.pathwren.workers.dev/impressum) - [AI Crawler Index](https://www.pathwren.workers.dev/index.html) - [No model runs here](https://www.pathwren.workers.dev/inference.html) - [Legal](https://www.pathwren.workers.dev/legal) - [MCP server](https://www.pathwren.workers.dev/mcp-doctor.html) - [MCP server](https://www.pathwren.workers.dev/mcp-lint.html) - [MCP server](https://www.pathwren.workers.dev/mcp-netcheck.html) - [MCP server](https://www.pathwren.workers.dev/mcp-robots.html) - [MCP transport: the GET and HEAD leg](https://www.pathwren.workers.dev/mcp-transport.html) - [MCP server](https://www.pathwren.workers.dev/mcp-triage.html) - [MCP server](https://www.pathwren.workers.dev/mcp.html) - [Packages](https://www.pathwren.workers.dev/packages.html) - [Pricing](https://www.pathwren.workers.dev/pricing) - [Privacy](https://www.pathwren.workers.dev/privacy.html) - [API reference](https://www.pathwren.workers.dev/reference) - [Access, keys and sign-up](https://www.pathwren.workers.dev/register) - [Security posture](https://www.pathwren.workers.dev/security.html) - [Upstream status](https://www.pathwren.workers.dev/status.html) - [Terms of use](https://www.pathwren.workers.dev/terms.html) - [Trust](https://www.pathwren.workers.dev/trust) ## Machine copies of this page - [HTML (canonical)](https://www.pathwren.workers.dev/operator/yandex.html) - [JSON](https://www.pathwren.workers.dev/operator/yandex.json) - [Markdown](https://www.pathwren.workers.dev/operator/yandex.md) — this document This document is a markdown rendering of [https://www.pathwren.workers.dev/operator/yandex.html](https://www.pathwren.workers.dev/operator/yandex.html), generated from that page's own bytes in the same build. The HTML page is canonical.