vladimirka.ru
robots.txt

Robots Exclusion Standard data for vladimirka.ru

Resource Scan

Scan Details

Site Domain vladimirka.ru
Base Domain vladimirka.ru
Scan Status Ok
Last Scan2025-02-25T03:32:58+00:00
Next Scan 2025-03-27T03:32:58+00:00

Last Scan

Scanned2025-02-25T03:32:58+00:00
URL http://vladimirka.ru/robots.txt
Domain IPs 195.161.62.167
Response IP 195.161.62.167
Found Yes
Hash 0aa52c210640cc9fe8bef27d899037654a590428cf52f968bc1dac3593f8e411
SimHash 66918065c731

Groups

yandex

Rule Path
Disallow /?
Disallow /board/rss/
Disallow /cgi-bin/
Disallow /stat/
Disallow /blogs/
Disallow /blogs/bin/
Disallow /files/

Other Records

Field Value
crawl-delay 5

*

Rule Path
Disallow /?
Disallow /board/rss/
Disallow /cgi-bin/
Disallow /read/?
Disallow /stat/
Disallow /blogs/
Disallow /blogs/bin/

Other Records

Field Value
crawl-delay 5

Warnings

  • `host` is not a known field.