moreulybok.ru
robots.txt

Robots Exclusion Standard data for moreulybok.ru

Resource Scan

Scan Details

Site Domain moreulybok.ru
Base Domain moreulybok.ru
Scan Status Ok
Last Scan2024-11-14T01:55:35+00:00
Next Scan 2024-11-21T01:55:35+00:00

Last Scan

Scanned2024-11-14T01:55:35+00:00
URL https://moreulybok.ru/robots.txt
Domain IPs 147.45.251.212
Response IP 147.45.251.212
Found Yes
Hash 197b4285a7f8fd1af3fb7925c1928bdbb5199ae05c031d4091ad113a4e5d529b
SimHash a4951ad27e99

Groups

a.pr-cy.ru

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

facebookexternalhit

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

begunadvertising

Rule Path
Disallow /

begun

Rule Path
Disallow /

ntentbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

sputnikbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

yahoo

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

*

Product Comment
* Для всех поисковых систем, кроме Яндекса и Гугла
Rule Path Comment
Disallow /cgi-bin -
Disallow *?* -
Disallow /wp- -
Disallow /search/ -
Disallow /author/ -
Disallow /users/ -
Disallow */trackback -
Disallow */feed -
Disallow */rss -
Disallow */embed -
Disallow /xmlrpc.php -
Disallow *utm%3D -
Disallow *openstat%3D -
Disallow /moi-zakladki -
Disallow /readme.html Закрываем бесполезный мануал по установке WordPress (лежит в корне)
Disallow /avtorskaja-stranica*%26tab%3Dpublics -
Allow */uploads -

googlebot

Product Comment
googlebot Для Гугла
Rule Path
Disallow /cgi-bin
Disallow /wp-
Disallow /search/
Disallow */trackback
Disallow */feed
Disallow */rss
Disallow */embed
Disallow /xmlrpc.php
Disallow *utm%3D
Disallow *openstat%3D
Disallow /readme.html
Disallow /moi-zakladki
Allow */uploads
Allow /*/*.js
Allow /*/*.css
Allow /wp-*.png
Allow /wp-*.jpg
Allow /wp-*.jpeg
Allow /wp-*.gif
Allow /wp-admin/admin-ajax.php

yandex

Product Comment
yandex Для Яндекса
Rule Path
Disallow /cgi-bin
Disallow *?
Disallow /wp-
Disallow *?s=
Disallow *%26s%3D
Disallow /search/
Disallow /author/
Disallow /users/
Disallow */trackback
Disallow */feed
Disallow */rss
Disallow */embed
Disallow /xmlrpc.php
Disallow /readme.html
Disallow *?replytocom
Disallow /moi-zakladki
Disallow /*?wpfpaction=add&postid=
Disallow /avtorskaja-stranica
Disallow /avtorskaja-stranica*%26tab%3Dpublics
Disallow /wp-json/
Disallow */embed*
Disallow */wp-json*
Allow /feed/turbo/
Allow */uploads
Allow /*/*.js
Allow /*/*.css
Allow /wp-*.png
Allow /wp-*.jpg
Allow /wp-*.jpeg
Allow /wp-*.gif
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://moreulybok.ru/sitemap.xml
sitemap https://moreulybok.ru/sitemap.xml.gz

Warnings

  • 1 invalid line.
  • `clean-param` is not a known field.