firstmates.com
robots.txt

Robots Exclusion Standard data for firstmates.com

Resource Scan

Scan Details

Site Domain firstmates.com
Base Domain firstmates.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-09-14T15:41:12+00:00
Next Scan 2024-12-13T15:41:12+00:00

Last Successful Scan

Scanned2022-11-14T10:37:31+00:00
URL https://www.firstmates.com/robots.txt
Response IP 161.71.146.9, 161.71.146.10, 161.71.146.12
Found Yes
Hash ed14ae8ae3563dcf1b8676b0a902dd3b552b0a2073b959610f4be419a14005e6
SimHash 6324dacc4f93

Groups

*

Product Comment
* applies to all robots
Rule Path Comment
Allow / allow all
Disallow */secur/forgotpassword.jsp?* -

Other Records

Field Value
sitemap http://www.firstmates.com/fmdc/s/sitemap.xml
sitemap http://www.firstmates.com/s/sitemap.xml

Comments

  • default robots.txt for sfdc communities sites
  • For use by salesforce.com