cagop.my.site.com
robots.txt

Robots Exclusion Standard data for cagop.my.site.com

Resource Scan

Scan Details

Site Domain cagop.my.site.com
Base Domain site.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2024-05-28T14:03:14+00:00
Next Scan 2024-06-11T14:03:14+00:00

Last Successful Scan

Scanned2024-05-06T10:42:52+00:00
URL https://cagop.my.site.com/robots.txt
Domain IPs 23.215.7.21, 23.215.7.27, 2600:1413:b000:1b::17d7:715, 2600:1413:b000:1b::17d7:71b
Response IP 23.59.168.161
Found Yes
Hash 9c7967de636d0fd5d6968e1740bbca6e3939b10f54a0e2467dbed975dfd1546a
SimHash 4324db0dcf91

Groups

*

Product Comment
* applies to all robots
Rule Path Comment
Allow / allow all
Disallow */secur/forgotpassword.jsp?* -

Other Records

Field Value
sitemap https://www.cagop.org/s/sitemap.xml
sitemap https://cagop.my.site.com/surveys/s/sitemap.xml

Comments

  • default robots.txt for sfdc communities sites
  • For use by salesforce.com