ilacrehberi.com
robots.txt

Robots Exclusion Standard data for ilacrehberi.com

Resource Scan

Scan Details

Site Domain ilacrehberi.com
Base Domain ilacrehberi.com
Scan Status Ok
Last Scan2024-10-09T10:41:00+00:00
Next Scan 2024-10-16T10:41:00+00:00

Last Scan

Scanned2024-10-09T10:41:00+00:00
URL https://ilacrehberi.com/robots.txt
Redirect https://www.ilacrehberi.com/robots.txt
Redirect Domain www.ilacrehberi.com
Redirect Base ilacrehberi.com
Domain IPs 82.165.99.198
Redirect IPs 82.165.99.198
Response IP 82.165.99.198
Found Yes
Hash 4ce501d07342477c471802f8e5c4706f30c6f3c5026294c8cc6e6943dbb24757
SimHash 176e2001c630

Groups

*

Rule Path
Disallow /cgi-bin/NewAdmin/
Disallow /img/
Disallow /flash/
Disallow /aspnet_client/
Disallow /data/
Disallow /fiyat_listesi/
Disallow /mecicine_tr_TR/
Disallow /rss/
Disallow /XML/
Disallow /ilacs/

mj12bot

Rule Path
Disallow /

wget

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

oozbot/setoozbot/oozbot/setoozbot

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

yacybot

Rule Path
Disallow /

crawler4j

Rule Path
Disallow /

mediapartners-google

Rule Path
Disallow