help.glassdoor.com
robots.txt

Robots Exclusion Standard data for help.glassdoor.com

Resource Scan

Scan Details

Site Domain help.glassdoor.com
Base Domain glassdoor.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-10-18T22:30:25+00:00
Next Scan 2025-01-16T22:30:25+00:00

Last Successful Scan

Scanned2023-03-03T02:52:28+00:00
URL https://help.glassdoor.com/robots.txt
Domain IPs 104.17.90.51, 104.17.91.51
Response IP 104.17.90.51
Found Yes
Hash c6aa8776944f69de71e674cb14b4f0fd0c84908e72497bbe3e4182fe61c64b2f
SimHash 6320cb6ccf93

Groups

*

Product Comment
* applies to all robots
Rule Path Comment
Allow / allow all
Disallow */secur/forgotpassword.jsp?* -

Other Records

Field Value
sitemap http://help.glassdoor.com/s/sitemap.xml

Comments

  • default robots.txt for sfdc communities sites
  • For use by salesforce.com