classinform.ru
robots.txt
Robots Exclusion Standard data for classinform.ru
Resource Scan
Scan Details
Site Domain | classinform.ru |
Base Domain | classinform.ru |
Scan Status | Ok |
Last Scan | 2024-11-09T02:00:43+00:00 |
Next Scan | 2024-11-16T02:00:43+00:00 |
Last Scan
Scanned | 2024-11-09T02:00:43+00:00 |
URL | https://classinform.ru/robots.txt |
Domain IPs | 178.32.120.152 |
Response IP | 178.32.120.152 |
Found | Yes |
Hash | 70d9a793d05731bef72ede9afdae57d576c3bc46d14ef9636e493d68717de522 |
SimHash | 680fd872978b |
Groups
*
Rule | Path |
---|---|
Disallow | /cgi-bin |
Disallow | /go.php |
Disallow | /go2.php |
Disallow | /go3.php |
Disallow | /go4.php |
Disallow | /go5.php |
Disallow | /vacancies/vacancygo.php |
Disallow | /vacancies/search.php |
Disallow | /contragent.php* |
Disallow | /contragents.php* |
Disallow | /kladr |
Disallow | /okpo/300/ |
Disallow | /okpo/300/mysqldump.htm |
Disallow | /test/ |
Disallow | /okato/search.php?* |
Disallow | /oktmo/search.php?* |
Other Records
Field | Value |
---|---|
crawl-delay | 1.5 |
Other Records
Field | Value |
---|---|
sitemap | https://classinform.ru/sitemap.xml |
sitemap | https://classinform.ru/okpo/sitemap_okpo.xml |