hid.it
robots.txt

Robots Exclusion Standard data for hid.it

Resource Scan

Scan Details

Site Domain hid.it
Base Domain hid.it
Scan Status Ok
Last Scan2025-05-31T09:53:07+00:00
Next Scan 2025-06-07T09:53:07+00:00

Last Scan

Scanned2025-05-31T09:53:07+00:00
URL http://hid.it/robots.txt
Redirect https://www.hippoweb.it/robots.txt
Redirect Domain www.hippoweb.it
Redirect Base hippoweb.it
Domain IPs 156.54.64.95
Redirect IPs 104.21.23.222, 172.67.213.247, 2606:4700:3032::6815:17de, 2606:4700:3035::ac43:d5f7
Response IP 172.67.213.247
Found Yes
Hash 233ea5ea51e8727ca60d27cd77afaf177c8ffe6cc182382ecfa1d2c56a64f241
SimHash 6d5c1c59c8b1

Groups

*

Rule Path
Disallow /admin/
Disallow /cache/
Disallow /contrib/
Disallow /images/
Disallow /lib/
Disallow /language/
Disallow /themes/
Disallow /errors.php
Disallow /files.php
Disallow /image_thumbnail.php
Disallow /login.php
Disallow /profile.php
Disallow /search.php

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap http://www.hippoweb.it/sitemap.php

Comments

  • robots.txt for http://www.hippoweb.it/
  • $Id: robots.txt,v 1.00 2005/12/16 07:42:41 dom Exp $
  • Directories
  • Files