astoreo.cz
robots.txt

Robots Exclusion Standard data for astoreo.cz

Resource Scan

Scan Details

Site Domain astoreo.cz
Base Domain astoreo.cz
Scan Status Ok
Last Scan2026-02-07T23:38:40+00:00
Next Scan 2026-02-21T23:38:40+00:00

Last Scan

Scanned2026-02-07T23:38:40+00:00
URL https://astoreo.cz/robots.txt
Redirect https://www.astoreo.cz/robots.txt
Redirect Domain www.astoreo.cz
Redirect Base astoreo.cz
Domain IPs 104.26.4.206, 104.26.5.206, 172.67.70.240, 2606:4700:20::681a:4ce, 2606:4700:20::681a:5ce, 2606:4700:20::ac43:46f0
Redirect IPs 104.26.4.206, 104.26.5.206, 172.67.70.240, 2606:4700:20::681a:4ce, 2606:4700:20::681a:5ce, 2606:4700:20::ac43:46f0
Response IP 104.26.4.206
Found Yes
Hash a0cbfb5b1d7a5e53cb40cd84bc3ce4770073ae445259a5eba83507113f87f8dd
SimHash 520dc844a81b

Groups

*

Rule Path
Disallow /*sorting
Disallow /*switch
Disallow /*reviews

sogou spider

Rule Path
Disallow /wishlist

ia_archiver

Rule Path
Disallow /wishlist

baiduspider

Rule Path
Disallow /wishlist

yandexbot

Rule Path
Disallow /wishlist

shopstyle bot/1.0

Rule Path
Disallow /wishlist

python-grcrawler

Rule Path
Disallow /wishlist

mail.ru

Rule Path
Disallow /wishlist

seokicks-robot

Rule Path
Disallow /wishlist

axis/1.4

Rule Path
Disallow /wishlist

proximic

Rule Path
Disallow /wishlist

grapeshot

Rule Path
Disallow /wishlist

blexbot

Rule Path
Disallow /wishlist

semrushbot

Rule Path
Disallow /wishlist

wget

Rule Path
Disallow /wishlist

ahrefsbot

Rule Path
Disallow /wishlist

dotbot
dotbot

Rule Path
Disallow /wishlist

dataforseobot

Rule Path
Disallow /wishlist

mj12bot

Rule Path
Disallow /wishlist

semanticscholarbot

Rule Path
Disallow /wishlist

Other Records

Field Value
sitemap https://astoreo.cz/sitemap_index.xml

Comments

  • www.robotstxt.org/
  • www.google.com/support/webmasters/bin/answer.py?hl=en&answer=156449
  • http://www.opensiteexplorer.org/dotbot
  • https://dataforseo.com/dataforseo-bot
  • http://www.majestic12.co.uk/projects/dsearch/mj12bot.php