bahchisaray.org.ua
robots.txt

Robots Exclusion Standard data for bahchisaray.org.ua

Resource Scan

Scan Details

Site Domain bahchisaray.org.ua
Base Domain bahchisaray.org.ua
Scan Status Ok
Last Scan2024-11-13T12:29:06+00:00
Next Scan 2024-11-20T12:29:06+00:00

Last Scan

Scanned2024-11-13T12:29:06+00:00
URL https://bahchisaray.org.ua/robots.txt
Domain IPs 94.23.149.233
Response IP 94.23.149.233
Found Yes
Hash 10192ed3076628b33edb0fb3c5b2247b561c0918e32ff252cdb6dc9f76698030
SimHash 40545c8a0314

Groups

*

Rule Path
Disallow /lofiversion/
Disallow /index.php?showuser=
Disallow /index.php?act=
Disallow /?act=
Disallow /?showuser=
Disallow /*mode%3Dlinear
Disallow /*mode%3Dthreaded
Disallow /*mode%3Dlinearplus

mj12bot

Rule Path
Disallow /

slurp

Rule Path
Disallow /

teoma

Rule Path
Disallow /

twiceler

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

scrubby

Rule Path
Disallow /

robozilla

Rule Path
Disallow /

nutch

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

naverbot

Rule Path
Disallow /

yeti

Rule Path
Disallow /

yahoo-mmcrawler

Rule Path
Disallow /

psbot

Rule Path
Disallow /

asterias

Rule Path
Disallow /

yahoo-blogs/v3.9

Rule Path
Disallow /

twengabot-2.0

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

flexum

Rule Path
Disallow /

Warnings

  • `host` is not a known field.