crithin.ru
robots.txt
Robots Exclusion Standard data for crithin.ru
Resource Scan
Scan Details
| Site Domain | crithin.ru |
| Base Domain | crithin.ru |
| Scan Status | Ok |
| Last Scan | 2025-04-15T06:39:14+00:00 |
| Next Scan | 2025-04-22T06:39:14+00:00 |
Last Scan
| Scanned | 2025-04-15T06:39:14+00:00 |
| URL | https://crithin.ru/robots.txt |
| Domain IPs | 2a00:f940:2:2:1:1:0:191, 31.31.196.193 |
| Response IP | 31.31.196.193 |
| Found | Yes |
| Hash | 090411b16ec1eab48b33412eb8a26f5396d5ea8d3c6eb333838e5ffb19e50bb9 |
| SimHash | 1430f0418531 |
Groups
*
| Product | Comment |
|---|---|
| * | обÑие пÑавила Ð´Ð»Ñ ÑобоÑов, кÑоме ЯндекÑа и Google, |
| Rule | Path | Comment |
|---|---|---|
| Disallow | /cgi-bin | папка на Ñ |
| Disallow | /? | вÑе паÑамеÑÑÑ Ð·Ð°Ð¿ÑоÑа на главной |
| Disallow | /wp- | вÑе ÑÐ°Ð¹Ð»Ñ WP: /wp-json/, /wp-includes, /wp-content/plugins |
| Disallow | *?s= | поиÑк |
| Disallow | *%26s%3D | поиÑк |
| Disallow | /search/ | поиÑк |
| Disallow | /author/ | аÑÑ |
| Disallow | /users/ | аÑÑ |
| Disallow | */trackback | ÑÑекбеки, ÑÐ²ÐµÐ´Ð¾Ð¼Ð»ÐµÐ½Ð¸Ñ Ð² комменÑаÑиÑÑ |
| Disallow | */feed | вÑе ÑÐ¸Ð´Ñ |
| Disallow | */rss | rss Ñид |
| Disallow | */embed | вÑе вÑÑÑÐ°Ð¸Ð²Ð°Ð½Ð¸Ñ |
| Disallow | */wlwmanifest.xml | xml-Ñайл маниÑеÑÑа Windows Live Writer (еÑли не иÑполÑзÑеÑе, |
| Disallow | /xmlrpc.php | Ñайл WordPress API |
| Disallow | *utm*%3D | ÑÑÑлки Ñ utm-меÑками |
| Disallow | *openstat%3D | ÑÑÑлки Ñ Ð¼ÐµÑками openstat |
| Allow | */uploads | оÑкÑÑваем Ð¿Ð°Ð¿ÐºÑ Ñ Ñайлами uploads |
Other Records
| Field | Value |
|---|---|
| sitemap | https://crithin.ru/sitemap_index.xml |
| sitemap | https://crithin.ru/sitemap_index.xml.gz |
Warnings
- 5 invalid lines.
- `host` is not a known field.
Comments