Log In Sign Up

secure.info-komen.org
robots.txt

Robots Exclusion Standard data for secure.info-komen.org

Resource Scan

Scan Details

Site Domain secure.info-komen.org
Base Domain info-komen.org
Scan Status Ok
Last Scan2024-11-22T07:51:39+00:00
Next Scan 2024-12-06T07:51:39+00:00

Last Scan

Scanned2024-11-22T07:51:39+00:00
URL https://secure.info-komen.org/robots.txt
Domain IPs 74.123.154.241
Response IP 74.123.154.241
Found Yes
Hash 027ab5bf10f33ead52bc8a4f079c0a3a41ec3ebc80308dcb0391a5e26c223088
SimHash 79cd1bcb07d2

Groups

*

Rule Path
Disallow /site/Calendar
Disallow /site/TellAFriend
Disallow /site/TR*pg%3Dnational_company
Disallow /site/TR*pg%3Dcompany
Disallow /site/TR*pg%3Dnatl_co_events
Disallow /site/TRGiftForm*
Disallow /site/TR?fr_id=10110&pg=entry
Disallow /site/TR?fr_id=10050&pg=entry
Disallow /site/TR?fr_id=10110&pg=entry
Disallow /site/TR?fr_id=10230&pg=entry
Disallow /site/TR?fr_id=10320&pg=entry

googlebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60
Back to top

Comments

  • $Header: /home/cvs/cvsroot/site_data/001/00000001/static_data/robots.txt,v 1.4 2001/09/13 00:25:08 dave Exp $
Back to top

Warnings

  • 5 invalid lines.
  • `nofollow` is not a known field.
  • `noindex` is not a known field.
Back to top