dodiplom.ru
robots.txt

Robots Exclusion Standard data for dodiplom.ru

Resource Scan

Scan Details

Site Domain dodiplom.ru
Base Domain dodiplom.ru
Scan Status Ok
Last Scan2024-10-06T13:54:33+00:00
Next Scan 2024-10-13T13:54:33+00:00

Last Scan

Scanned2024-10-06T13:54:33+00:00
URL https://dodiplom.ru/robots.txt
Domain IPs 185.26.122.58
Response IP 185.26.122.58
Found Yes
Hash 04ff5f27c5772ee5897053c40a04bdb45a16dfe6261c24754d0c9b3cba0540a6
SimHash 4809504581b1

Groups

yandex

Rule Path
Disallow /.doc*
Disallow /index.php/*

googlebot

Rule Path
Disallow /.doc*
Disallow /index.php/*

mail.ru

Rule Path
Disallow /.doc*
Disallow /index.php/*

stackrambler

Rule Path
Disallow /.doc*
Disallow /index.php/*

*

Rule Path
Disallow /.doc*
Disallow /index.php/*

Other Records

Field Value
crawl-delay 30

yahoo! slurp

Rule Path
Disallow /

webalta

Rule Path
Disallow /

Other Records

Field Value
sitemap http://dodiplom.ru/sitemap.xml

Warnings

  • `host` is not a known field.