newsherenow.ru
robots.txt

Robots Exclusion Standard data for newsherenow.ru

Resource Scan

Scan Details

Site Domain newsherenow.ru
Base Domain newsherenow.ru
Scan Status Ok
Last Scan2024-10-02T07:02:14+00:00
Next Scan 2024-10-09T07:02:14+00:00

Last Scan

Scanned2024-10-02T07:02:14+00:00
URL https://newsherenow.ru/robots.txt
Domain IPs 109.95.212.31
Response IP 109.95.212.31
Found Yes
Hash b037449fcb93f68dc654a8a193e7d6999ea6aee2f44bc3fcfd9d5c5ab6be2765
SimHash 4c8c49c2a69d

Groups

*

Rule Path Comment
Disallow /wp-admin/ -
Allow /wp-admin/admin-ajax.php -
Disallow /cgi-bin/ -
Disallow /?%2F -
Disallow /wp-/ -
Disallow /*?s=%2F -
Disallow /*%26s%3D/ -
Disallow /search/ -
Disallow /author/ -
Disallow /users/ -
Disallow /*/trackback/ -
Disallow /*/feed/ -
Disallow /*/rss/ -
Disallow /*/embed/ -
Disallow /xmlrpc.php -
Disallow /*utm%3D/ -
Disallow /*openstat%3D/ -
Disallow /tag/ Закрываем метки/
Disallow /readme.html Закрываем бесполезный мануал по установке wordpress (лежит в корне)
Disallow /*?replytocom%2F -
Allow /*/uploads/ -

googlebot

Product Comment
googlebot Для Гугла
Rule Path Comment
Disallow /cgi-bin/ -
Disallow /?%2F -
Disallow /wp-/ -
Disallow /*?s=%2F -
Disallow /*%26s%3D/ -
Disallow /search/ -
Disallow /author/ -
Disallow /users/ -
Disallow /*/trackback/ -
Disallow /*/feed/ -
Disallow /*/rss/ -
Disallow /*/embed/ -
Disallow /xmlrpc.php -
Disallow /*utm%3D/ -
Disallow /*openstat%3D/ -
Disallow /tag/ Закрываем метки/
Disallow /readme.html -
Disallow /*?replytocom%2F -
Allow /*/uploads/ -
Allow /*/*.js -
Allow /*/*.css -
Allow /wp-*.png -
Allow /wp-*.jpg -
Allow /wp-*.jpeg -
Allow /wp-*.gif -

yandex

Product Comment
yandex Для Яндекса
Rule Path Comment
Disallow /cgi-bin/ -
Disallow /?%2F -
Disallow /wp-/ -
Disallow /*?s=%2F -
Disallow /*%26s%3D/ -
Disallow /search/ -
Disallow /author/ -
Disallow /users/ -
Disallow /*/trackback/ -
Disallow /*/feed/ -
Disallow /*/rss/ -
Disallow /*/embed/ -
Disallow /xmlrpc.php -
Disallow /tag/ Закрываем метки/
Disallow /readme.html -
Disallow /*?replytocom%2F -
Allow /*/uploads/ -
Allow /*/*.js -
Allow /*/*.css -
Allow /wp-*.png -
Allow /wp-*.jpg -
Allow /wp-*.jpeg -
Allow /wp-*.gif -

Other Records

Field Value
sitemap https://newsherenow.ru/sitemap_index.xml

Comments

  • START YOAST BLOCK
  • ---------------------------
  • ---------------------------
  • END YOAST BLOCK