cleardigitalmedia.my.site.com
robots.txt

Robots Exclusion Standard data for cleardigitalmedia.my.site.com

Resource Scan

Scan Details

Site Domain cleardigitalmedia.my.site.com
Base Domain site.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2024-04-02T16:56:18+00:00
Next Scan 2024-07-01T16:56:18+00:00

Last Successful Scan

Scanned2023-08-28T23:05:13+00:00
URL https://cleardigitalmedia.my.site.com/robots.txt
Domain IPs 23.215.7.21, 23.215.7.27, 2600:1413:b000:1b::17d7:715, 2600:1413:b000:1b::17d7:71b
Response IP 23.59.168.154
Found Yes
Hash 003a7b24e8bfbb84e52c2a822c91fcc208bdcef26673c8c563c71560f2495fd9
SimHash 6360db65cf91

Groups

*

Product Comment
* applies to all robots
Rule Path Comment
Allow / allow all
Disallow */secur/forgotpassword.jsp?* -

Other Records

Field Value
sitemap https://cleardigitalmedia.my.site.com/1/s/sitemap.xml
sitemap https://cleardigitalmedia.my.site.com/2/s/sitemap.xml

Comments

  • default robots.txt for sfdc communities sites
  • For use by salesforce.com