kopiraiteka.com
robots.txt

Robots Exclusion Standard data for kopiraiteka.com

Resource Scan

Scan Details

Site Domain kopiraiteka.com
Base Domain kopiraiteka.com
Scan Status Ok
Last Scan2024-05-18T19:44:52+00:00
Next Scan 2024-06-17T19:44:52+00:00

Last Scan

Scanned2024-05-18T19:44:52+00:00
URL https://kopiraiteka.com/robots.txt
Domain IPs 77.87.196.85
Response IP 77.87.196.85
Found Yes
Hash c9b6fa2244090a5312d4494ab5a9b0a8a5c6c84d51aff86d51642172e256c0e2
SimHash 431671824400

Groups

voilabot

Rule Path
Disallow /

xenu's link sleuth 1.1c

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

baiduspider
baiduspider-video
baiduspider-image

Rule Path
Disallow /

nutch

Rule Path
Disallow /

psbot

Rule Path
Disallow /

purebot

Rule Path
Disallow /

robozilla

Rule Path
Disallow /

moget
ichiro

Rule Path
Disallow /

naverbot
yeti

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

youdaobot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

scrubby

Rule Path
Disallow /

bingbot
msnbot
asterias

Rule Path
Disallow /usercontrols/

slurp
slurp/si

Rule Path
Disallow /

teoma

Rule Path
Disallow /

voilabot

Rule Path
Disallow /

xenu's link sleuth 1.1c

Rule Path
Disallow /

yahoo-mmcrawler
yahoo-blogs/v3.9
slurp/3.0

Rule Path
Disallow /

mediapartners-google/2.1
mediapartners-google
googlebot-image/1.0
googlebot
ia_archiver
mj12bot
scoutjet
speedyspider
technoratibot/8.1
twiceler
yandexantivirus/2.0
yandexbot/3.0
yandeximageresizer/2.0
yandeximages/3.0
yandexmedia/3.0
yandexpagechecker/1.0
yandexwebmaster/2.0
yandexzakladki/3.0

Rule Path
Disallow /usercontrols/
Disallow *DependencyHandler
Disallow /umbraco/
Disallow /umbraco_client/
Disallow /Errorpages/
Disallow /Config/
Disallow /install/

*

Rule Path
Disallow /

Warnings

  • 2 invalid lines.