consuitant.ru
robots.txt
Robots Exclusion Standard data for consuitant.ru
Resource Scan
Scan Details
| Site Domain | consuitant.ru |
| Base Domain | consuitant.ru |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Couldn't connect to server. |
| Last Scan | 2024-11-01T16:01:57+00:00 |
| Next Scan | 2025-01-30T16:01:57+00:00 |
Last Successful Scan
| Scanned | 2024-07-05T10:06:27+00:00 |
| URL | https://consuitant.ru/robots.txt |
| Domain IPs | 91.201.43.51 |
| Response IP | 91.201.43.51 |
| Found | Yes |
| Hash | 213ce904ed48d3be54385d522deb569383b4e37bd8f56e1a48298c10f6c49fe7 |
| SimHash | 1518d0488631 |
Groups
*
| Rule | Path | Comment |
|---|---|---|
| Disallow | /cgi-bin | папка на Ñ |
| Disallow | /? | вÑе паÑамеÑÑÑ Ð·Ð°Ð¿ÑоÑа на главной |
| Disallow | /wp- | вÑе ÑÐ°Ð¹Ð»Ñ WP: /wp-json/, /wp-includes, /wp-content/plugins |
| Disallow | /wp/ | еÑли еÑÑÑ Ð¿Ð¾Ð´ÐºÐ°Ñалог /wp/, где ÑÑÑановлена CMS (еÑли неÑ, |
| Disallow | *?s= | поиÑк |
| Disallow | *%26s%3D | поиÑк |
| Disallow | /search/ | поиÑк |
| Disallow | /author/ | аÑÑ |
| Disallow | /users/ | аÑÑ |
| Disallow | */trackback | ÑÑекбеки, ÑÐ²ÐµÐ´Ð¾Ð¼Ð»ÐµÐ½Ð¸Ñ Ð² комменÑаÑиÑÑ |
| Disallow | */feed | вÑе ÑÐ¸Ð´Ñ |
| Disallow | */rss | rss Ñид |
| Disallow | */embed | вÑе вÑÑÑÐ°Ð¸Ð²Ð°Ð½Ð¸Ñ |
| Disallow | */wlwmanifest.xml | xml-Ñайл маниÑеÑÑа Windows Live Writer (еÑли не иÑполÑзÑеÑе, |
| Disallow | /readme.html | - |
| Disallow | /work.html | - |
| Disallow | /pravoobladateljam/ | - |
| Disallow | /xmlrpc.php | Ñайл WordPress API |
| Disallow | *utm*%3D | ÑÑÑлки Ñ utm-меÑками |
| Disallow | *openstat%3D | ÑÑÑлки Ñ Ð¼ÐµÑками openstat |
| Allow | */uploads | оÑкÑÑваем Ð¿Ð°Ð¿ÐºÑ Ñ Ñайлами uploads |
Other Records
| Field | Value |
|---|---|
| sitemap | https://consuitant.ru/sitemap.xml |
Warnings
- 4 invalid lines.
- `host` is not a known field.
Comments