cosmo-frost.ru
robots.txt
Robots Exclusion Standard data for cosmo-frost.ru
Resource Scan
Scan Details
| Site Domain | cosmo-frost.ru |
| Base Domain | cosmo-frost.ru |
| Scan Status | Ok |
| Last Scan | 2024-09-27T04:20:11+00:00 |
| Next Scan | 2024-10-04T04:20:11+00:00 |
Last Scan
| Scanned | 2024-09-27T04:20:11+00:00 |
| URL | https://cosmo-frost.ru/robots.txt |
| Domain IPs | 87.236.21.207 |
| Response IP | 87.236.21.207 |
| Found | Yes |
| Hash | 20dbd648cd95fe42efe41ea8caf1b53100e9cfe45ea20b45e00ea4765a89bdae |
| SimHash | 437d5df29060 |
Groups
googlebot
| Rule | Path |
|---|---|
| Disallow | /? |
| Disallow | /dlya_vstavki/ |
| Disallow | /admin |
| Disallow | /emarket/addToCompare |
| Disallow | /emarket/basket |
| Disallow | /go-out.php |
| Disallow | /wp-json/* |
| Disallow | /captcha.php* |
| Disallow | /images/cms* |
| Disallow | /category/ |
| Disallow | /wp-content/plugins/captcha-code-authentication/ |
| Disallow | /?wordfence* |
| Disallow | /wp- |
| Allow | /*/*.ttf |
| Allow | /*/*.woff |
| Allow | /*/*.js |
| Allow | /*/*.css |
| Allow | /wp-*.png |
| Allow | /wp-*.jpg |
| Allow | /wp-*.jpeg |
| Allow | /wp-*.gif |
| Allow | */uploads |
| Allow | *ajax.php |
| Disallow | *android* |
| Disallow | *google* |
| Disallow | *googlequicksearchbox |
| Disallow | *null |
| Disallow | *flash%3D* |
| Disallow | /?s=* |
| Disallow | /search/* |
| Disallow | *%26ved%3D* |
| Disallow | *?oprd=* |
| Disallow | /rutube* |
| Disallow | /instrukcii/*/?b=* |
| Disallow | /instrukcii/*/?act=* |
| Disallow | *pdfjs* |
| Disallow | /button-bar/* |
yandex
| Rule | Path |
|---|---|
| Disallow | /tag/* |
| Disallow | /tag/ |
| Disallow | /? |
| Disallow | */?s=* |
| Disallow | /dlya_vstavki/ |
| Disallow | /admin |
| Disallow | /emarket/addToCompare |
| Disallow | /emarket/basket |
| Disallow | /go-out.php |
| Disallow | /captcha.php* |
| Disallow | /images/cms* |
| Disallow | /category/ |
| Disallow | /cgi-bin |
| Disallow | /wp-json/ |
| Disallow | /wp-content/uploads/wpcf7_captcha/ |
| Disallow | /wp-content/plugins/captcha-code-authentication/ |
| Disallow | /wp-includes/ |
| Disallow | /wp-admin/ |
| Disallow | /xmlrpc.php |
| Disallow | /wp-login.php |
| Disallow | /wp-register.php |
| Disallow | */comments |
| Disallow | */comment-page* |
| Disallow | /comments/feed/ |
| Disallow | /*trackback |
| Disallow | */trackback |
| Disallow | /*?source_type* |
| Disallow | /*?ad* |
| Disallow | /*?utm_source* |
| Disallow | /*?yclid* |
| Disallow | */attachment/ |
| Disallow | /?attachment_id |
| Disallow | /?p=* |
| Disallow | /?attachment_id=* |
| Disallow | /*type%3D* |
| Disallow | /*added* |
| Disallow | /*?rs* |
| Disallow | /*?print= |
| Disallow | /*%26print%3D |
| Disallow | /wp- |
| Disallow | */amp/ |
| Disallow | *?gclid* |
| Disallow | /?wordfence* |
| Disallow | /seo* |
| Disallow | *android* |
| Disallow | *google* |
| Disallow | *googlequicksearchbox |
| Disallow | *null |
| Disallow | *flash%3D* |
| Disallow | */undefined |
| Disallow | /search/* |
| Disallow | *%26ved%3D* |
| Disallow | *?oprd=* |
| Disallow | /rutube* |
| Disallow | /instrukcii/*/?b=* |
| Disallow | /instrukcii/*/?act=* |
| Disallow | */assets/pdfjs/viewer/* |
| Disallow | /company/ |
| Disallow | /company/* |
| Disallow | /company |
| Disallow | */feed/ |
| Disallow | */view/ |
| Allow | /*/*.ttf |
| Allow | /*/*.woff |
| Allow | /*/*.js |
| Allow | /*/*.css |
| Allow | /wp-*.png |
| Allow | /wp-*.jpg |
| Allow | /wp-*.jpeg |
| Allow | /wp-*.gif |
| Allow | */uploads |
| Allow | *ajax.php |
| Disallow | /button-bar/* |
| Disallow | /wp-content/uploads/*.pdf |
*
| Rule | Path |
|---|---|
| Disallow | /? |
| Disallow | /dlya_vstavki/ |
| Disallow | /admin |
| Disallow | /emarket/addToCompare |
| Disallow | /emarket/basket |
| Disallow | /go-out.php |
| Disallow | /wp-json/* |
| Disallow | *feed* |
| Disallow | /captcha.php* |
| Disallow | /images/cms* |
| Disallow | /category/ |
| Disallow | /wp-content/plugins/captcha-code-authentication/ |
| Disallow | /?wordfence* |
| Disallow | /seo* |
| Disallow | *android* |
| Disallow | *google* |
| Disallow | *googlequicksearchbox |
| Disallow | *null |
| Disallow | /search/* |
| Disallow | *%26ved%3D* |
| Disallow | *?oprd=* |
| Disallow | *pdfjs* |
| Disallow | /company/ |
| Disallow | /company/* |
| Disallow | /company |
| Disallow | /button-bar/* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 120 |