citilinkcatalog.ru
robots.txt

Robots Exclusion Standard data for citilinkcatalog.ru

Resource Scan

Scan Details

Site Domain citilinkcatalog.ru
Base Domain citilinkcatalog.ru
Scan Status Ok
Last Scan2024-07-01T11:49:04+00:00
Next Scan 2024-07-08T11:49:04+00:00

Last Scan

Scanned2024-07-01T11:49:04+00:00
URL https://citilinkcatalog.ru/robots.txt
Domain IPs 217.107.34.191
Response IP 217.107.34.191
Found Yes
Hash 425160857d86daec71b01742cf7ff06af9ff6022292541cb44a98d300f282281
SimHash 2c80a9e391bc

Groups

*

Product Comment
* Для всеÑ
Rule Path Comment
Disallow /cgi-bin -
Disallow /? -
Disallow /copyright -
Disallow /personal-data -
Disallow /privacy-policy -
Disallow /user-agreement -
Disallow /wp- -
Disallow *?s= -
Disallow *%26s%3D -
Disallow /search/ -
Disallow /category/ -
Disallow /katalog* -
Disallow /author/ -
Disallow /users/ -
Disallow */trackback -
Disallow */feed -
Disallow */rss -
Disallow */embed -
Disallow /xmlrpc.php -
Disallow *utm%3D -
Disallow *openstat%3D -
Disallow /tag/ Закрываем метки
Disallow /readme.html Закрываем бесполезный мануал по установке WordPress (лежит в корне)
Disallow *?replytocom -
Allow */uploads -

googlebot

Product Comment
googlebot Для Гугла
Rule Path Comment
Disallow /cgi-bin -
Disallow /katalog* -
Disallow /category/ -
Disallow /copyright -
Disallow /personal-data -
Disallow /privacy-policy -
Disallow /user-agreement -
Disallow /? -
Disallow /wp- -
Disallow *?s= -
Disallow *%26s%3D -
Disallow /search/ -
Disallow /author/ -
Disallow /users/ -
Disallow */trackback -
Disallow */feed -
Disallow */rss -
Disallow */embed -
Disallow /xmlrpc.php -
Disallow *utm%3D -
Disallow *openstat%3D -
Disallow /tag/ Закрываем метки
Disallow /readme.html -
Disallow *?replytocom -
Allow */uploads -
Allow /*/*.js -
Allow /*/*.css -
Allow /wp-*.png -
Allow /wp-*.jpg -
Allow /wp-*.jpeg -
Allow /wp-*.gif -
Allow /wp-admin/admin-ajax.php -

yandex

Product Comment
yandex Для Яндекса
Rule Path Comment
Disallow /cgi-bin -
Disallow /katalog* -
Disallow /category/ -
Disallow /copyright -
Disallow /personal-data -
Disallow /privacy-policy -
Disallow /user-agreement -
Disallow /? -
Disallow /wp- -
Disallow *?s= -
Disallow *%26s%3D -
Disallow /search/ -
Disallow /author/ -
Disallow /users/ -
Disallow */trackback -
Disallow */feed -
Disallow */rss -
Disallow */embed -
Disallow /xmlrpc.php -
Disallow /tag/ Закрываем метки
Disallow /readme.html -
Disallow *?replytocom -
Allow */uploads -
Allow /*/*.js -
Allow /*/*.css -
Allow /wp-*.png -
Allow /wp-*.jpg -
Allow /wp-*.jpeg -
Allow /wp-*.gif -
Allow /wp-admin/admin-ajax.php -

Other Records

Field Value
sitemap https://citilinkcatalog.ru/sitemap_index.xml

Warnings

  • 2 invalid lines.
  • `clean-param` is not a known field.