chertown.ru
robots.txt

Robots Exclusion Standard data for chertown.ru

Resource Scan

Scan Details

Site Domain chertown.ru
Base Domain chertown.ru
Scan Status Ok
Last Scan2026-03-16T03:42:24+00:00
Next Scan 2026-04-15T03:42:24+00:00

Last Scan

Scanned2026-03-16T03:42:24+00:00
URL http://chertown.ru/robots.txt
Domain IPs 77.222.62.219
Response IP 77.222.62.219
Found Yes
Hash 652e4e2c5b24616dca3740f9910afa3b7219781b788ff1b8d8fce2eadab4d3c7
SimHash 7e59b0a171c0

Groups

yandex

Rule Path
Disallow /banners
Disallow /cms
Disallow /css
Disallow /ctimg
Disallow /database
Disallow /docs
Disallow /dozor
Disallow /extplorer
Disallow /forum
Disallow /gal
Disallow /gibdd
Disallow /images
Disallow /js
Disallow /mircd
Disallow /o_gorode
Disallow /other
Disallow /pollax
Disallow /prog
Disallow /scripts
Disallow /t4n
Disallow /upload
Disallow /user_images

Other Records

Field Value
crawl-delay 10

googlebot

Rule Path
Disallow /banners
Disallow /cms
Disallow /css
Disallow /ctimg
Disallow /database
Disallow /docs
Disallow /dozor
Disallow /extplorer
Disallow /forum
Disallow /gal
Disallow /gibdd
Disallow /images
Disallow /js
Disallow /mircd
Disallow /o_gorode
Disallow /other
Disallow /pollax
Disallow /prog
Disallow /scripts
Disallow /t4n
Disallow /upload
Disallow /user_images

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /

Warnings

  • `host` is not a known field.