cobafer.com
robots.txt

Robots Exclusion Standard data for cobafer.com

Resource Scan

Scan Details

Site Domain cobafer.com
Base Domain cobafer.com
Scan Status Ok
Last Scan2025-07-14T19:07:35+00:00
Next Scan 2025-08-13T19:07:35+00:00

Last Scan

Scanned2025-07-14T19:07:35+00:00
URL https://cobafer.com/robots.txt
Domain IPs 104.21.12.226, 172.67.196.135, 2606:4700:3033::6815:ce2, 2606:4700:3035::ac43:c487
Response IP 104.21.12.226
Found Yes
Hash 53dfa869aaccd83e2d7220e8e267cdc37d92baf7c465c2fac76244a90358671b
SimHash 4e445cd26194

Groups

*

Rule Path
Disallow /ReadyIceCatSheet.asp
Disallow /ajaxRequests.asp
Disallow /renewSession.asp
Disallow /resDownload.asp

Other Records

Field Value
crawl-delay 10

Comments

  • 10 secs delay (GoogleBot ignores this)
  • Disallow IceCat descriptions
  • Disallow internal pages