asn23.cineca.it
robots.txt

Robots Exclusion Standard data for asn23.cineca.it

Resource Scan

Scan Details

Site Domain asn23.cineca.it
Base Domain cineca.it
Scan Status Ok
Last Scan2026-03-29T22:03:22+00:00
Next Scan 2026-04-28T22:03:22+00:00

Last Scan

Scanned2026-03-29T22:03:22+00:00
URL https://asn23.cineca.it/robots.txt
Domain IPs 3.170.229.37, 3.170.229.71, 3.170.229.73, 3.170.229.77
Response IP 3.170.229.37
Found Yes
Hash f39bc329e42347d4b4f21779aacdae551c80016e66cee2cec90ada538a892b67
SimHash 6494c810a3c2

Groups

*

Rule Path
Disallow /

googlebot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

bingbot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

istellabot

Rule Path
Disallow /

istellabot/1.01.18

Rule Path
Disallow /

istellabot/1.01.18 +http://www.tiscali.it/

Rule Path
Disallow /

istellabot/1.10.2 +http://www.tiscali.it/

Rule Path
Disallow /

mozilla/5.0 (compatible; istellabot/1.01.18 +http://www.tiscali.it/)

Rule Path
Disallow /

Comments

  • www.robotstxt.org/
  • www.google.com/support/webmasters/bin/answer.py?hl=en&answer=156449