Log In Sign Up

mebeloptovik.ru
robots.txt

Robots Exclusion Standard data for mebeloptovik.ru

Resource Scan

Scan Details

Site Domain mebeloptovik.ru
Base Domain mebeloptovik.ru
Scan Status Ok
Last Scan2024-11-11T05:09:16+00:00
Next Scan 2024-11-18T05:09:16+00:00

Last Scan

Scanned2024-11-11T05:09:16+00:00
URL https://mebeloptovik.ru/robots.txt
Domain IPs 193.176.77.104
Response IP 193.176.77.104
Found Yes
Hash 5cb83cd4d18f56c48f939743c3c2c5320442fff7d1f0c33ec49d326e5353d5ca
SimHash a49539f393bd

Groups

*

Product Comment
* Для всеÑ
Rule Path Comment
Disallow /cgi-bin -
Disallow /? -
Disallow /wp- -
Disallow *%26s%3D -
Disallow /author/ -
Disallow /users/ -
Disallow */trackback -
Disallow */feed -
Disallow */rss -
Disallow */embed -
Disallow /xmlrpc.php -
Disallow *utm%3D -
Disallow *openstat%3D -
Disallow /readme.html Закрываем бесполезный мануал по установке WordPress (лежит в корне)
Disallow *?replytocom -
Disallow /*search/* -
Disallow /*?s=* -
Disallow /*?fbclid=* -
Disallow /*?customize_changeset_uuid* -
Disallow /*?sfw=pass* -
Allow */uploads -

Other Records

Field Value
crawl-delay 5

googlebot

Product Comment
googlebot Для Гугла
Rule Path
Disallow /cgi-bin
Disallow /?
Disallow /wp-
Disallow *%26s%3D
Disallow /author/
Disallow /users/
Disallow */trackback
Disallow */feed
Disallow */rss
Disallow */embed
Disallow /xmlrpc.php
Disallow *utm%3D
Disallow *openstat%3D
Disallow /readme.html
Disallow *?replytocom
Disallow /*search/*
Disallow /*?s=*
Disallow /*?fbclid=*
Disallow /*?customize_changeset_uuid*
Disallow /*?sfw=pass*
Allow */uploads
Allow /*/*.js
Allow /*/*.css
Allow /wp-*.png
Allow /wp-*.jpg
Allow /wp-*.jpeg
Allow /wp-*.gif
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
crawl-delay 5

yandex

Product Comment
yandex Для Яндекса
Rule Path
Disallow */amp
Disallow /cgi-bin
Disallow /?
Disallow /wp-
Disallow *%26s%3D
Disallow /author/
Disallow /users/
Disallow */trackback
Disallow */feed
Disallow */rss
Disallow */embed
Disallow /xmlrpc.php
Disallow /readme.html
Disallow *?replytocom
Disallow /*search/*
Disallow /*?s=*
Disallow /*?fbclid=*
Disallow /*?customize_changeset_uuid*
Disallow /*?sfw=pass*
Allow */uploads
Allow /*/*.js
Allow /*/*.css
Allow /wp-*.png
Allow /wp-*.jpg
Allow /wp-*.jpeg
Allow /wp-*.gif
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
crawl-delay 5
Back to top

Other Records

Field Value Comment
sitemap https://mebeloptovik.ru/sitemap.xml Карта сайта, меняем site.com на нужный адрес.
Back to top

Warnings

  • 2 invalid lines.
Back to top