poiskvod.ru
robots.txt

Robots Exclusion Standard data for poiskvod.ru

Resource Scan

Scan Details

Site Domain poiskvod.ru
Base Domain poiskvod.ru
Scan Status Ok
Last Scan2024-05-31T09:50:50+00:00
Next Scan 2024-06-30T09:50:50+00:00

Last Scan

Scanned2024-05-31T09:50:50+00:00
URL http://poiskvod.ru/robots.txt
Redirect http://www.poiskvod.ru/robots.txt
Redirect Domain www.poiskvod.ru
Redirect Base poiskvod.ru
Domain IPs 2a00:15f8:a000:5:1:11:5:dae, 2a00:15f8:a000:5:1:12:5:dae, 2a00:15f8:a000:5:1:13:5:dae, 2a00:15f8:a000:5:1:14:5:dae, 90.156.201.17, 90.156.201.18, 90.156.201.48, 90.156.201.85
Redirect IPs 2a00:15f8:a000:5:1:11:5:dae, 2a00:15f8:a000:5:1:12:5:dae, 2a00:15f8:a000:5:1:13:5:dae, 2a00:15f8:a000:5:1:14:5:dae, 90.156.201.17, 90.156.201.18, 90.156.201.48, 90.156.201.85
Response IP 90.156.201.18
Found Yes
Hash 3ab925b0c1b7dc3263c3fa97c54d6d738e58bdff8226db2a0bb8688d7383cda9
SimHash f51b5df2c7b3

Groups

yahoo

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

*

Rule Path
Disallow /admin/
Disallow /calendar/
Disallow /classes/
Disallow /css/
Disallow /FCKeditor/
Disallow /FrontOffice/
Disallow /image/preview/
Disallow /image/catalog/original/
Disallow /images/
Disallow /libs/
Disallow /scripts/

sitecheck.internetseer.com

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

fetch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

webzip

Rule Path
Disallow /

linko

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

xenu

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

wget

Rule Path
Disallow /

npbot

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

Other Records

Field Value
sitemap http://www.decostyle.ru/sitemap.xml

Warnings

  • `host` is not a known field.