faustoricambi.it
robots.txt

Robots Exclusion Standard data for faustoricambi.it

Resource Scan

Scan Details

Site Domain faustoricambi.it
Base Domain faustoricambi.it
Scan Status Ok
Last Scan2024-05-09T00:29:13+00:00
Next Scan 2024-06-08T00:29:13+00:00

Last Scan

Scanned2024-05-09T00:29:13+00:00
URL https://faustoricambi.it/robots.txt
Redirect https://www.faustoricambi.it/robots.txt
Redirect Domain www.faustoricambi.it
Redirect Base faustoricambi.it
Domain IPs 31.11.35.115
Redirect IPs 31.11.35.115
Response IP 31.11.35.115
Found Yes
Hash 53dfa869aaccd83e2d7220e8e267cdc37d92baf7c465c2fac76244a90358671b
SimHash 4e445cd26194

Groups

*

Rule Path
Disallow /ReadyIceCatSheet.asp
Disallow /ajaxRequests.asp
Disallow /renewSession.asp
Disallow /resDownload.asp

Other Records

Field Value
crawl-delay 10

Comments

  • 10 secs delay (GoogleBot ignores this)
  • Disallow IceCat descriptions
  • Disallow internal pages