cureblindness.org
robots.txt

Robots Exclusion Standard data for cureblindness.org

Resource Scan

Scan Details

Site Domain cureblindness.org
Base Domain cureblindness.org
Scan Status Ok
Last Scan2025-12-15T12:44:33+00:00
Next Scan 2026-01-14T12:44:33+00:00

Last Scan

Scanned2025-12-15T12:44:33+00:00
URL https://cureblindness.org/robots.txt
Domain IPs 104.21.49.203, 172.67.167.24, 2606:4700:3030::ac43:a718, 2606:4700:3035::6815:31cb
Response IP 172.67.167.24
Found Yes
Hash 3fe3e074c4b134b3188c9887894b615871470c2ca10ea8d2b671e736b68d0b92
SimHash 0180d004c9b0

Groups

*
*

Rule Path
Disallow /fileadmin/
Disallow /dynamic/
Disallow /cache/

Other Records

Field Value
crawl-delay 30

Other Records

Field Value
sitemap http://cureblindness.com/sitemap/sitemap

Comments

  • Most search engines too heavily crawl index more sites. This keeps them from
  • abusing sites but still index.