fanski.ru
robots.txt

Robots Exclusion Standard data for fanski.ru

Resource Scan

Scan Details

Site Domain fanski.ru
Base Domain fanski.ru
Scan Status Ok
Last Scan2026-01-04T16:58:30+00:00
Next Scan 2026-01-11T16:58:30+00:00

Last Scan

Scanned2026-01-04T16:58:30+00:00
URL http://fanski.ru/robots.txt
Domain IPs 2a00:f940:2:2:1:1:0:15, 31.31.198.142
Response IP 31.31.198.142
Found Yes
Hash 1aad58f979008cedb8ecffd985b1c350313959a467d8bcbe85b81be7ae5cb830
SimHash 275fdae08700

Groups

petalbot

Rule Path
Disallow /

mediapartners-google

Rule Path
Disallow /awstats
Disallow /fancybox1
Disallow /maps
Disallow /share42
Disallow /weather
Disallow /cgi-bin
Disallow /wp-login
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-content/plugins
Disallow /wp-content/languages
Disallow /wp-content/themes
Disallow /wp-content/cache
Disallow /trackback
Disallow */trackback
Disallow */*/trackback
Disallow */*/feed/*/
Disallow */feed
Disallow /wp-trackback
Disallow /wp-feed
Disallow /wp-comments
Disallow /author/
Disallow /feed/
Disallow /*feed
Disallow /comments
Disallow /comment
Disallow /wp-rssya.php
Disallow /wp-rssra.php

yandex

Rule Path
Disallow /wp-rssya.php
Disallow /wp-rssra.php
Disallow /awstats
Disallow /fancybox1
Disallow /maps
Disallow /share42
Disallow /weather
Disallow /cgi-bin
Disallow /wp-login
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-content/plugins
Disallow /wp-content/languages
Disallow /wp-content/themes
Disallow /wp-content/cache
Disallow /trackback
Disallow */trackback
Disallow */*/trackback
Disallow */*/feed/*/
Disallow */feed
Disallow /wp-trackback
Disallow /wp-feed
Disallow /wp-comments
Disallow /author/
Disallow /feed/
Disallow /*feed
Disallow /comments
Disallow /comment
Disallow */sitemap-pt*
Disallow */*/sitemap-pt*
Disallow /wp-rssra.php

Other Records

Field Value
crawl-delay 120
crawl-delay 120

*

Rule Path
Disallow /awstats
Disallow /fancybox1
Disallow /maps
Disallow /share42
Disallow /weather
Disallow /cgi-bin
Disallow /wp-login
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-content/plugins
Disallow /wp-content/languages
Disallow /wp-content/themes
Disallow /wp-content/cache
Disallow /trackback
Disallow */trackback
Disallow */*/trackback
Disallow */*/feed/*/
Disallow */feed
Disallow /wp-trackback
Disallow /wp-feed
Disallow /wp-comments
Disallow /author/
Disallow /feed/
Disallow /*feed
Disallow /comments
Disallow /comment
Disallow /wp-rssya.php
Disallow /wp-rssra.php
Disallow

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 120

amazonbot

Rule Path
Disallow /

Other Records

Field Value
sitemap http://fanski.ru/sitemap.xml

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.