na21.salesforce.com
robots.txt

Robots Exclusion Standard data for na21.salesforce.com

Resource Scan

Scan Details

Site Domain na21.salesforce.com
Base Domain salesforce.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-09-14T08:33:15+00:00
Next Scan 2024-12-13T08:33:15+00:00

Last Successful Scan

Scanned2023-08-12T14:04:22+00:00
URL https://na21.salesforce.com/robots.txt
Domain IPs 96.43.152.166, 96.43.152.38
Response IP 96.43.152.38
Found Yes
Hash e2480191399c2b563705a8237e43e1f2d7f768c9e90070198bd96edeb4fdca3e
SimHash 25209bceceb6

Groups

googlebot

Rule Path
Allow /

*

Product Comment
* applies to all robots
Rule Path Comment
Allow /?*un=*&pw=* -
Allow /?*pw=*&un=* -
Allow /secur/frontdoor.jsp?*sid=* -
Allow /secur/contentDoor?*sid=* -
Allow /secur/myDomainDoor?*sid=* -
Allow /secur/LoginInterstitial.apexp -
Allow /secur/login_portal.jsp?*pw=* -
Allow /sserv/login.jsp?*pw=* -
Allow /login.jsp?*pw=* -
Allow /login/login.jsp?*pw=* -
Allow /secur/login_page.jsp?*pw=* -
Disallow / disallow indexing of all pages

Comments

  • robots.txt for sfdc appservers.
  • For use by salesforce.com