kriso.ee
robots.txt

Robots Exclusion Standard data for kriso.ee

Resource Scan

Scan Details

Site Domain kriso.ee
Base Domain kriso.ee
Scan Status Ok
Last Scan2024-09-08T01:52:34+00:00
Next Scan 2024-10-08T01:52:34+00:00

Last Scan

Scanned2024-09-08T01:52:34+00:00
URL https://kriso.ee/robots.txt
Redirect https://www.kriso.ee//robots.txt
Redirect Domain www.kriso.ee
Redirect Base kriso.ee
Domain IPs 213.219.118.138
Redirect IPs 213.219.118.138
Response IP 213.219.118.138
Found Yes
Hash b110fc404afea842b07916b2008b085cce1faca92417ef9e1ea1a1ffa5c80f33
SimHash 6f565450cb30

Groups

*

Rule Path
Disallow /cgi-bin/shop/ord/basket.html
Disallow /cgi-bin/shop/order.html
Disallow /cgi-bin/shop/ord/ebasket.html
Disallow /cgi-bin/pangalink.pl
Disallow /cgi-bin/shop/googlebookpreview.html
Disallow /cgi-bin/shop/ajaxwishlist.html
Disallow /cgi-bin/shop/locale.html
Disallow /cgi-bin/shop/refinefilters.html
Disallow /cgi-bin/shop/download.html
Disallow /cgi-bin/shop/change_password.html
Disallow /cgi-bin/shop/login.html
Disallow /cgi-bin/shop/changeaccount.html
Disallow /cgi-bin/shop/new_account.html
Disallow /kasutajatugi/
Disallow /failid/
Disallow /booksru/

turnitinbot

Rule Path
Disallow /
Disallow /cgi-bin/

diffbot/0.1

Rule Path
Disallow /
Disallow /cgi-bin/

geedobot

Rule Path
Disallow /
Disallow /cgi-bin/

gptbot/1.0

Rule Path
Disallow /
Disallow /cgi-bin/

bytespider

Rule Path
Disallow /
Disallow /cgi-bin/

psbot

Rule Path
Disallow /
Disallow /cgi-bin/

awariobot

Rule Path
Disallow /
Disallow /cgi-bin/

yandex

Rule Path
Disallow /
Disallow /cgi-bin/

amazonbot

Rule Path
Disallow /
Disallow /cgi-bin/

msnbot

Rule Path
Disallow /
Disallow /cgi-bin/

accompanybot

Rule Path
Disallow /
Disallow /cgi-bin/

petalbot

Rule Path
Disallow /
Disallow /cgi-bin/

ccbot

Rule Path
Disallow /
Disallow /cgi-bin/

yandexbot

Rule Path
Disallow /
Disallow /cgi-bin/

zumbot

Rule Path
Disallow /
Disallow /cgi-bin/

mail.ru_bot

Rule Path
Disallow /
Disallow /cgi-bin/

pinterestbot

Rule Path
Disallow /
Disallow /cgi-bin/

msnbot

Rule Path
Disallow /
Disallow /cgi-bin/

seznambot

Rule Path
Disallow /
Disallow /cgi-bin/

semanticscholarbot

Rule Path
Disallow /
Disallow /cgi-bin/

semrushbot

Rule Path
Disallow /
Disallow /cgi-bin/

dataforseobot

Rule Path
Disallow /
Disallow /cgi-bin/

baiduspider

Rule Path
Disallow /
Disallow /cgi-bin/

slurp

Rule Path
Disallow /
Disallow /cgi-bin/

mj12bot

Rule Path
Disallow /
Disallow /cgi-bin/

slurp

Rule Path
Disallow /
Disallow /cgi-bin/

blexbot/1.0

Rule Path
Disallow /
Disallow /cgi-bin/

blexbot

Rule Path
Disallow /
Disallow /cgi-bin/

facebot

Rule Path
Disallow /
Disallow /cgi-bin/

barkrowler/0.9

Rule Path
Disallow /
Disallow /cgi-bin/

barkrowler

Rule Path
Disallow /
Disallow /cgi-bin/

serpstatbot/2.1

Rule Path
Disallow /
Disallow /cgi-bin/

serpstatbot

Rule Path
Disallow /
Disallow /cgi-bin/

facebookexternalhit/1.1

Rule Path
Disallow /
Disallow /cgi-bin/