cref.ru
robots.txt
Robots Exclusion Standard data for cref.ru
Resource Scan
Scan Details
| Site Domain | cref.ru |
| Base Domain | cref.ru |
| Scan Status | Ok |
| Last Scan | 2025-11-01T12:17:00+00:00 |
| Next Scan | 2025-12-01T12:17:00+00:00 |
Last Scan
| Scanned | 2025-11-01T12:17:00+00:00 |
| URL | https://cref.ru/robots.txt |
| Domain IPs | 87.236.16.231 |
| Response IP | 87.236.16.231 |
| Found | Yes |
| Hash | 2d30e358277bd788f61dd51e534f43e28a510110bb9291a3db63ecc2982dfcef |
| SimHash | 6955e944d033 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /cgi-bin |
| Disallow | */?* |
| Disallow | /wp- |
| Disallow | *?s= |
| Disallow | *%26s%3D |
| Disallow | /search |
| Disallow | */page/ |
| Disallow | /wp-content/uploads/*.pdf |
| Disallow | /comments/feed/ |
| Disallow | /feed/ |
| Disallow | /?w3tc_note=* |
| Disallow | /zire.php |
| Disallow | /savetool.php |
| Allow | /*/*.js |
| Allow | /*/*.css |
| Allow | /wp-*.png |
| Allow | /wp-*.jpg |
| Allow | /wp-*.jpeg |
| Allow | */uploads |
| Allow | */themes |
| Allow | */page/* |
yandex
| Rule | Path |
|---|---|
| Disallow | /amp/ |
| Disallow | /cgi-bin |
| Disallow | */?* |
| Disallow | /wp- |
| Disallow | *?s= |
| Disallow | *%26s%3D |
| Disallow | /search |
| Disallow | */page/ |
| Disallow | /wp-content/uploads/*.pdf |
| Disallow | /comments/feed/ |
| Disallow | /feed/ |
| Disallow | /?w3tc_note=* |
| Disallow | /zire.php |
| Disallow | /savetool.php |
| Allow | /*/*.js |
| Allow | /*/*.css |
| Allow | /wp-*.png |
| Allow | /wp-*.jpg |
| Allow | /wp-*.jpeg |
| Allow | */uploads |
| Allow | */themes |
| Allow | */page/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.cref.ru/sitemap.xml |
| sitemap | https://www.cref.ru/images_sitemap.xml |