estetika52.ru
robots.txt

Robots Exclusion Standard data for estetika52.ru

Resource Scan

Scan Details

Site Domain estetika52.ru
Base Domain estetika52.ru
Scan Status Ok
Last Scan2025-03-13T02:39:26+00:00
Next Scan 2025-04-12T02:39:26+00:00

Last Scan

Scanned2025-03-13T02:39:26+00:00
URL https://estetika52.ru/robots.txt
Redirect https://www.estetika52.ru/robots.txt
Redirect Domain www.estetika52.ru
Redirect Base estetika52.ru
Domain IPs 104.21.73.236, 172.67.193.91, 2606:4700:3030::6815:49ec, 2606:4700:3033::ac43:c15b
Redirect IPs 104.21.73.236, 172.67.193.91, 2606:4700:3030::6815:49ec, 2606:4700:3033::ac43:c15b
Response IP 104.21.73.236
Found Yes
Hash 5d07d5ba853ebdcf4f3aef1c48967ec72430ec332bc9908fd520970f111575ed
SimHash 0e2f8771ada3

Groups

rookeebot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

yandex
*

Rule Path
Disallow /admin
Allow /image/catalog/doors
Allow /image/catalog/factories
Allow /image/catalog/articles
Allow /image/catalog/banners
Allow /image/catalog/categories
Allow /index.php?route=extension%2Ffeed%2Ffx_sitemap
Allow /index.php?route=extension%2Ffeed%2Funi_news_sitemap
Allow /index.php?route=extension%2Ffeed%2Focfilter_sitemap
Disallow /*search/?tag
Disallow /*route%3Daccount/
Disallow /*route%3Daffiliate/
Disallow /*route%3Dcheckout/
Disallow /*route%3Dproduct/search
Disallow /*route%3Dproduct/compare
Disallow /export
Disallow /system
Disallow /*?sort=
Disallow /*%26sort%3D
Disallow /*?filter_ocfilter=
Disallow /*%26filter_ocfilter%3D
Disallow /*?order=
Disallow /*%26order%3D
Disallow /*?limit=
Disallow /*%26limit%3D
Disallow /*?filter_name=
Disallow /*%26filter_name%3D
Disallow /*?poip_ov=
Disallow /*%26poip_ov%3D
Disallow /*?filter_category_id=
Disallow /*%26filter_category_id%3D
Disallow /*?filter_sub_category=
Disallow /*%26filter_sub_category%3D
Disallow /*?filter_description=
Disallow /*%26filter_description%3D
Disallow /*?tracking=
Disallow /*%26tracking%3D
Disallow /*utm_source
Disallow /*utm_medium
Disallow /*utm_campaign
Disallow /*_openstat
Disallow /*color%5B%5D
Disallow /*store
Disallow /*search
Disallow /cart
Disallow /*?min
Disallow /*?max
Disallow /*size_id
Disallow /*set_id
Disallow *.swf
Disallow /*?route
Disallow /includes
Disallow /forgot-password/
Disallow /login/
Disallow /*?*clear

Other Records

Field Value
crawl-delay 1.0

Other Records

Field Value
sitemap https://www.estetika52.ru/index.php?route=extension/feed/fx_sitemap
sitemap https://www.estetika52.ru/index.php?route=extension/feed/ocfilter_sitemap
sitemap https://www.estetika52.ru/index.php?route=extension/feed/uni_news_sitemap

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.