theriverstrust.org
robots.txt

Robots Exclusion Standard data for theriverstrust.org

Resource Scan

Scan Details

Site Domain theriverstrust.org
Base Domain theriverstrust.org
Scan Status Ok
Last Scan2024-06-22T18:56:05+00:00
Next Scan 2024-06-29T18:56:05+00:00

Last Scan

Scanned2024-06-22T18:56:05+00:00
URL https://theriverstrust.org/robots.txt
Domain IPs 104.26.12.125, 104.26.13.125, 172.67.72.161, 2606:4700:20::681a:c7d, 2606:4700:20::681a:d7d, 2606:4700:20::ac43:48a1
Response IP 104.26.13.125
Found Yes
Hash c5eac1671ec27e022d8dbc36b35254992041b8e74e9b824c41c6356e451fcab9
SimHash 41101d723793

Groups

*

Rule Path
Disallow /cpresources/
Disallow /vendor/
Disallow /.env
Disallow /cache/

Other Records

Field Value
sitemap https://theriverstrust.org/sitemaps-1-sitemap.xml

Comments

  • robots.txt for https://theriverstrust.org/
  • live - don't allow web crawlers to index cpresources/ or vendor/