simonsfoundation.info
robots.txt

Robots Exclusion Standard data for simonsfoundation.info

Resource Scan

Scan Details

Site Domain simonsfoundation.info
Base Domain simonsfoundation.info
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2024-05-13T17:11:41+00:00
Next Scan 2024-07-12T17:11:41+00:00

Last Successful Scan

Scanned2024-02-21T16:54:47+00:00
URL https://simonsfoundation.info/robots.txt
Domain IPs 104.21.12.76, 172.67.131.243, 2606:4700:3030::ac43:83f3, 2606:4700:3031::6815:c4c
Response IP 172.67.131.243
Found Yes
Hash a8b8c6e2e69586a9c4c800bd145c5e016345f7f9355d06e4f5853e24e6421791
SimHash 8c506f486bd2

Groups

*

Rule Path
Disallow /content/*

Comments

  • robots.txt for all our sites