hitparadeitalia.it
robots.txt

Groups

*

httrack*

httrack 3.0x

bloodhound*

deweb*

doc*

download ninja*

fetch*

israbot*

jbh*

larbin*

libwww*

linko*

microsoft.url.control*

msiecrawler*

npbot*

offline explorer*

orthogaffe*

packrat*

physics*

psbot*

pycurl*

sitecheck*

sitesnagger*

spiderbot*

teleport*

tlspider*

ubicrawler*

webcollage*

webcopier*

webmirror*

webstripper*

webzip*

xenu*

zao*

zealbot*

zyborg*

Warnings

• 4 invalid lines.