vseanekdoty.ru
robots.txt
Robots Exclusion Standard data for vseanekdoty.ru
Resource Scan
Scan Details
Site Domain | vseanekdoty.ru |
Base Domain | vseanekdoty.ru |
Scan Status | Ok |
Last Scan | 2024-09-24T19:56:35+00:00 |
Next Scan | 2024-10-01T19:56:35+00:00 |
Last Scan
Scanned | 2024-09-24T19:56:35+00:00 |
URL | https://vseanekdoty.ru/robots.txt |
Domain IPs | 91.201.41.96 |
Response IP | 91.201.41.96 |
Found | Yes |
Hash | 05bd673472dbaf43180e5c72aaedeffb8bd0415327d2079dbc0252e99dc63820 |
SimHash | 7618d2638d25 |
Groups
*
Product | Comment |
---|---|
* | обÑие пÑавила Ð´Ð»Ñ ÑобоÑов, кÑоме ЯндекÑа и Google, |
Rule | Path | Comment |
---|---|---|
Disallow | /cgi-bin | папка на Ñ |
Disallow | /? | вÑе паÑамеÑÑÑ Ð·Ð°Ð¿ÑоÑа на главной |
Disallow | /wp- | вÑе ÑÐ°Ð¹Ð»Ñ WP: /wp-json/, /wp-includes, /wp-content/plugins |
Disallow | /wp/ | еÑли еÑÑÑ Ð¿Ð¾Ð´ÐºÐ°Ñалог /wp/, где ÑÑÑановлена CMS (еÑли неÑ, |
Disallow | *?s= | поиÑк |
Disallow | *%26s%3D | поиÑк |
Disallow | /search/ | поиÑк |
Disallow | /author/ | аÑÑ |
Disallow | /users/ | аÑÑ |
Disallow | */trackback | ÑÑекбеки, ÑÐ²ÐµÐ´Ð¾Ð¼Ð»ÐµÐ½Ð¸Ñ Ð² комменÑаÑиÑÑ |
Disallow | */feed | вÑе ÑÐ¸Ð´Ñ |
Disallow | */rss | rss Ñид |
Disallow | */embed | вÑе вÑÑÑÐ°Ð¸Ð²Ð°Ð½Ð¸Ñ |
Disallow | */wlwmanifest.xml | xml-Ñайл маниÑеÑÑа Windows Live Writer (еÑли не иÑполÑзÑеÑе, |
Disallow | /xmlrpc.php | Ñайл WordPress API |
Disallow | *utm*%3D | ÑÑÑлки Ñ utm-меÑками |
Disallow | *openstat%3D | ÑÑÑлки Ñ Ð¼ÐµÑками openstat |
Allow | */uploads | оÑкÑÑваем Ð¿Ð°Ð¿ÐºÑ Ñ Ñайлами uploads |
googlebot
Product | Comment |
---|---|
googlebot | пÑавила Ð´Ð»Ñ Google (комменÑаÑии не дÑблиÑÑÑ) |
Rule | Path | Comment |
---|---|---|
Disallow | /cgi-bin | - |
Disallow | /? | - |
Disallow | /wp- | - |
Disallow | /wp/ | - |
Disallow | *?s= | - |
Disallow | *%26s%3D | - |
Disallow | /search/ | - |
Disallow | /author/ | - |
Disallow | /users/ | - |
Disallow | */trackback | - |
Disallow | */feed | - |
Disallow | */rss | - |
Disallow | */embed | - |
Disallow | */wlwmanifest.xml | - |
Disallow | /xmlrpc.php | - |
Disallow | *utm*%3D | - |
Disallow | *openstat%3D | - |
Allow | */uploads | - |
Allow | /*/*.js | оÑкÑÑваем js-ÑкÑипÑÑ Ð²Ð½ÑÑÑи /wp- (/*/ - Ð´Ð»Ñ Ð¿ÑиоÑиÑеÑа) |
Allow | /*/*.css | оÑкÑÑваем css-ÑÐ°Ð¹Ð»Ñ Ð²Ð½ÑÑÑи /wp- (/*/ - Ð´Ð»Ñ Ð¿ÑиоÑиÑеÑа) |
Allow | /wp-*.png | каÑÑинки в Ð¿Ð»Ð°Ð³Ð¸Ð½Ð°Ñ |
Allow | /wp-*.jpg | каÑÑинки в Ð¿Ð»Ð°Ð³Ð¸Ð½Ð°Ñ |
Allow | /wp-*.jpeg | каÑÑинки в Ð¿Ð»Ð°Ð³Ð¸Ð½Ð°Ñ |
Allow | /wp-*.gif | каÑÑинки в Ð¿Ð»Ð°Ð³Ð¸Ð½Ð°Ñ |
Allow | /wp-admin/admin-ajax.php | иÑполÑзÑеÑÑÑ Ð¿Ð»Ð°Ð³Ð¸Ð½Ð°Ð¼Ð¸, ÑÑÐ¾Ð±Ñ Ð½Ðµ блокиÑоваÑÑ JS и CSS |
yandex
Product | Comment |
---|---|
yandex | пÑавила Ð´Ð»Ñ Ð¯Ð½Ð´ÐµÐºÑа (комменÑаÑии не дÑблиÑÑÑ) |
Rule | Path | Comment |
---|---|---|
Disallow | /cgi-bin | - |
Disallow | /? | - |
Disallow | /wp- | - |
Disallow | /wp/ | - |
Disallow | *?s= | - |
Disallow | *%26s%3D | - |
Disallow | /search/ | - |
Disallow | /author/ | - |
Disallow | /users/ | - |
Disallow | */trackback | - |
Disallow | */feed | - |
Allow | */feed/turbo/* | Ð´Ð»Ñ ÑÑÑбо |
Disallow | */rss | - |
Disallow | */embed | - |
Disallow | */wlwmanifest.xml | - |
Disallow | /xmlrpc.php | - |
Disallow | */amp/* | - |
Disallow | */*/amp/* | - |
Disallow | */*/*/amp/* | - |
Allow | */uploads | - |
Allow | /*/*.js | - |
Allow | /*/*.css | - |
Allow | /wp-*.png | - |
Allow | /wp-*.jpg | - |
Allow | /wp-*.jpeg | - |
Allow | /wp-*.gif | - |
Allow | /wp-admin/admin-ajax.php | - |
Other Records
Field | Value |
---|---|
sitemap | https://vseanekdoty.ru/sitemap.xml |
Warnings
- 9 invalid lines.
- `clean-param` is not a known field.
- `host` is not a known field.
Comments