zootom.ru
robots.txt

Robots Exclusion Standard data for zootom.ru

Resource Scan

Scan Details

Site Domain zootom.ru
Base Domain zootom.ru
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2026-01-27T04:34:45+00:00
Next Scan 2026-04-27T04:34:45+00:00

Last Successful Scan

Scanned2025-09-29T13:00:54+00:00
URL https://zootom.ru/robots.txt
Domain IPs 82.202.170.130
Response IP 82.202.170.130
Found Yes
Hash 30c5ef78b3c1b7bf3d794ecabce2324bf10ba45c881aa6decfdf976955591d61
SimHash 6f05de518317

Groups

yandex

Rule Path
Disallow /ajax
Disallow /go/
Disallow /avtor
Disallow /cabinet
Disallow /login
Disallow /api/captcha
Disallow /api
Disallow /images
Disallow /moderation
Disallow /*?*

Other Records

Field Value
crawl-delay 5

*

Rule Path
Disallow /ajax
Disallow /go/
Disallow /avtor
Disallow /cabinet
Disallow /login
Disallow /api/captcha
Disallow /api
Disallow /images
Disallow /moderation
Disallow /*?*

Other Records

Field Value
crawl-delay 5

sputnikbot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

megaindex

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

bingbot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

amazon

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 120

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 120

Other Records

Field Value
sitemap http://zootom.ru/sitemap.xml
sitemap http://zootom.ru/sitemap.xml

Warnings

  • `host` is not a known field.