classinform.ru
robots.txt

Robots Exclusion Standard data for classinform.ru

Resource Scan

Scan Details

Site Domain classinform.ru
Base Domain classinform.ru
Scan Status Ok
Last Scan2024-11-09T02:00:43+00:00
Next Scan 2024-11-16T02:00:43+00:00

Last Scan

Scanned2024-11-09T02:00:43+00:00
URL https://classinform.ru/robots.txt
Domain IPs 178.32.120.152
Response IP 178.32.120.152
Found Yes
Hash 70d9a793d05731bef72ede9afdae57d576c3bc46d14ef9636e493d68717de522
SimHash 680fd872978b

Groups

*

Rule Path
Disallow /cgi-bin
Disallow /go.php
Disallow /go2.php
Disallow /go3.php
Disallow /go4.php
Disallow /go5.php
Disallow /vacancies/vacancygo.php
Disallow /vacancies/search.php
Disallow /contragent.php*
Disallow /contragents.php*
Disallow /kladr
Disallow /okpo/300/
Disallow /okpo/300/mysqldump.htm
Disallow /test/
Disallow /okato/search.php?*
Disallow /oktmo/search.php?*

Other Records

Field Value
crawl-delay 1.5

yandexdirect

Rule Path
Disallow /contragents.php*
Disallow /kladr
Disallow /okpo/300/

Other Records

Field Value
crawl-delay 2.0

mj12bot

Rule Path
Disallow /

riddler

Rule Path
Disallow /

www.ru

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://classinform.ru/sitemap.xml
sitemap https://classinform.ru/okpo/sitemap_okpo.xml