Log In Sign Up

classcook.ru
robots.txt

Robots Exclusion Standard data for classcook.ru

Resource Scan

Scan Details

Site Domain classcook.ru
Base Domain classcook.ru
Scan Status Ok
Last Scan2024-09-21T06:31:28+00:00
Next Scan 2024-09-28T06:31:28+00:00

Last Scan

Scanned2024-09-21T06:31:28+00:00
URL https://classcook.ru/robots.txt
Domain IPs 178.159.42.60
Response IP 178.159.42.60
Found Yes
Hash 0d682e9eb0eb71ea557b245110cab53278b7467b96aeb805bd5f03978df45107
SimHash 6480b9f2821d

Groups

*

Rule Path Comment
Disallow /cgi-bin -
Disallow /? -
Disallow /search/ -
Disallow /author/ -
Disallow /users/ -
Disallow */trackback -
Disallow */feed -
Disallow */rss -
Disallow /wp- -
Disallow *?s= -
Disallow *%26s%3D -
Disallow */embed -
Disallow /xmlrpc.php -
Disallow *utm%3D -
Disallow *openstat%3D -
Disallow /tag/ Закрываем для того, чтобы не индексировалось слишком много дублей.
Allow */uploads -

Other Records

Field Value
crawl-delay 20
Back to top

Comments

  • Если вы Ñ
  • User-agent: Yandex
  • Disallow: /cgi-bin
  • Disallow: /?
  • Disallow: /wp-
  • Disallow: *?s=
  • Disallow: *&s=
  • Disallow: /search/
  • Disallow: /author/
  • Disallow: /users/
  • Disallow: */trackback
  • Disallow: */feed
  • Disallow: */rss
  • Disallow: */embed
  • Disallow: /xmlrpc.php
  • Allow: /wp-*.jpg
  • Allow: /wp-admin/admin-ajax.php
  • Allow: */uploads
  • Allow: /wp-*.jpeg
  • Allow: /wp-*.gif
  • Allow: /*/*.js
  • Allow: /*/*.css
  • Allow: /wp-*.png
  • Clean-Param: utm_source&utm_medium&utm_campaign
  • Clean-Param: openstat
  • Sitemap: https://classcook.ru/sitemap.xml
Back to top

Warnings

  • 1 invalid line.
  • `host` is not a known field.
Back to top