www.help.cbp.gov
robots.txt

Robots Exclusion Standard data for www.help.cbp.gov

Resource Scan

Scan Details

Site Domain www.help.cbp.gov
Base Domain cbp.gov
Scan Status Ok
Last Scan2024-06-25T10:55:50+00:00
Next Scan 2024-07-09T10:55:50+00:00

Last Scan

Scanned2024-06-25T10:55:50+00:00
URL https://www.help.cbp.gov/robots.txt
Domain IPs 184.85.126.152, 2600:1417:3f:789::3ff9, 2600:1417:3f:79d::3ff9
Response IP 104.76.137.133
Found Yes
Hash 3b9bf90fff36ef544e780d1e163ffbbe887b088fb7bf3ecc41666aa6e546f42b
SimHash 6324db4dcf93

Groups

*

Product Comment
* applies to all robots
Rule Path Comment
Allow / allow all
Disallow */secur/forgotpassword.jsp?* -

Other Records

Field Value
sitemap https://cbpcomplaints.cbp.gov/s/sitemap.xml

Comments

  • default robots.txt for sfdc communities sites
  • For use by salesforce.com