neveitalia.it
robots.txt

Robots Exclusion Standard data for neveitalia.it

Resource Scan

Scan Details

Site Domain neveitalia.it
Base Domain neveitalia.it
Scan Status Ok
Last Scan2024-11-15T11:13:57+00:00
Next Scan 2024-11-22T11:13:57+00:00

Last Scan

Scanned2024-11-15T11:13:57+00:00
URL https://neveitalia.it/robots.txt
Domain IPs 95.110.165.74
Response IP 95.110.165.74
Found Yes
Hash 581320c6685c368b62f62e0a1962f362d0d2f070fcb0d19e1061cf36a9defaaf
SimHash 6f1dc2b5cbf1

Groups

teleport

Rule Path
Disallow /

emailcollector

Rule Path
Disallow /

netmechanic

Rule Path
Disallow /

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

arianna

Rule Path
Disallow /

arianna news

Rule Path
Disallow /

arianna web

Rule Path
Disallow /

arianna robot

Rule Path
Disallow /

webnews arianna

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

*

Rule Path
Disallow /gestione.php
Disallow /admin/
Disallow /blocks/
Disallow /language/
Disallow /channel.php