ukrshina.com.ua
robots.txt

Robots Exclusion Standard data for ukrshina.com.ua

Resource Scan

Scan Details

Site Domain ukrshina.com.ua
Base Domain ukrshina.com.ua
Scan Status Ok
Last Scan2024-09-07T01:20:55+00:00
Next Scan 2024-10-07T01:20:55+00:00

Last Scan

Scanned2024-09-07T01:20:55+00:00
URL https://ukrshina.com.ua/robots.txt
Domain IPs 104.21.85.160, 172.67.207.161, 2606:4700:3032::ac43:cfa1, 2606:4700:3033::6815:55a0
Response IP 172.67.207.161
Found Yes
Hash a40daad510983d2447ba9f1ad4a8fc227e487b3019e857e3c1db67bf83ffda4f
SimHash d6570a41a8b8

Groups

*

Rule Path
Disallow /*_openstat
Disallow /*from%3Dadwords
Disallow /*utm_source*
Disallow /*gclid%3D
Disallow /*srsltid%3D
Disallow /*%2C
Disallow /checkout
Disallow /notebook/
Disallow /comparison/
Disallow /set-page-mode
Disallow /*product-question/*
Disallow /*product-availability/*
Disallow /*product-reviews/*
Disallow /*one-click/*
Disallow /*reviews/*
Disallow /brand/
Disallow /brands$
Disallow /checkout-dispatcher
Disallow /get_parent_description_ajax
Disallow /*get_lfs_portlet_slot_ajax/*
Disallow /*esender-subscribe-portlet-ajax/*
Disallow /*reviewed-with-chains/*
Disallow /*recent_products/*
Disallow /my-account
Disallow /my-orders
Disallow /my-password
Disallow /checkout

Other Records

Field Value
crawl-delay 15

googlebot

Rule Path
Disallow /*_openstat
Disallow /*from%3Dadwords
Disallow /*utm_source*
Disallow /*gclid%3D
Disallow /*srsltid%3D
Disallow /*%2C
Disallow /checkout
Disallow /notebook/
Disallow /comparison/
Disallow /set-page-mode
Disallow /*product-question/*
Disallow /*product-availability/*
Disallow /*product-reviews/*
Disallow /*one-click/*
Disallow /*reviews/*
Disallow /brand/
Disallow /brands$
Disallow /checkout-dispatcher
Disallow /get_parent_description_ajax
Disallow /*get_lfs_portlet_slot_ajax/*
Disallow /*esender-subscribe-portlet-ajax/*
Disallow /*reviewed-with-chains/*
Disallow /*recent_products/*
Disallow /my-account
Disallow /my-orders
Disallow /my-password
Disallow /checkout

Other Records

Field Value
crawl-delay 15

semrushbot

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

applebot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

censysinspect

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

geedobot

Rule Path
Disallow /

geedoproductsearch

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

awariobot
awariorssbot
awariosmartbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

yandeximages

Rule Path
Disallow /

yandexcalendar

Rule Path
Disallow /

yandexmobilebot

Rule Path
Disallow /

yandexmetrika

Rule Path
Disallow /

yandexaccessibilitybot

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

s1z.ru

Rule Path
Disallow /

Other Records

Field Value
sitemap https://ukrshina.com.ua/sitemap.xml

Comments

  • other
  • ******

Warnings

  • `host` is not a known field.