gorodvlesu.ru
robots.txt

Robots Exclusion Standard data for gorodvlesu.ru

Resource Scan

Scan Details

Site Domain gorodvlesu.ru
Base Domain gorodvlesu.ru
Scan Status Ok
Last Scan2026-02-03T09:53:28+00:00
Next Scan 2026-03-05T09:53:28+00:00

Last Scan

Scanned2026-02-03T09:53:28+00:00
URL https://gorodvlesu.ru/robots.txt
Domain IPs 109.95.210.220
Response IP 109.95.210.220
Found Yes
Hash a7c6d3875bd370e71665b63463ad613325e000bb953e406a23a28252bbb37041
SimHash 6f56147702b0

Groups

googlebot-image

Rule Path
Disallow /

yandeximages

Rule Path
Disallow /

msnbot-mm

Rule Path
Disallow /

googlebot-mobile

Rule Path
Allow /

mediapartners-google

Rule Path
Allow /

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 100

twiceler

Rule Path
Disallow /

w3c-checklink

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

radiation retriever 1.1

Rule Path
Disallow /

webmasterworld extractor

Rule Path
Disallow /

*

Rule Path
Allow /$
Allow /*forum$
Allow /*page*page
Allow /*media$
Allow /*media*album
Allow /*media*item
Allow /MGalleryItem.php?id
Allow /*action%3D.xml
Allow /*sitemap
Allow /*board
Allow /*topic
Allow /*page
Disallow /*action
Disallow /*wap
Disallow /*board%3D*wap
Disallow /*topic%3D*wap
Disallow /*topic%3D*.msg
Disallow /*topic%3D*.new
Disallow /*%3B
Disallow /*PHPSESSID
Disallow /go.php
Disallow /*page*sh
Disallow /*page*shhh
Disallow /*page*shahmatka
Disallow /*page*s
Disallow /*page*sh_instr
Disallow /*all
Disallow /*attachments
Disallow /

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap http://gorodvlesu.ru/forumsitemap.xml

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.