www.help.cbp.gov
robots.txt

Robots Exclusion Standard data for www.help.cbp.gov

Resource Scan

Scan Details

Site Domain www.help.cbp.gov
Base Domain cbp.gov
Scan Status Ok
Last Scan2024-11-12T13:36:02+00:00
Next Scan 2024-11-26T13:36:02+00:00

Last Scan

Scanned2024-11-12T13:36:02+00:00
URL https://www.help.cbp.gov/robots.txt
Domain IPs 23.50.82.177, 2600:1413:b000:382::3ff9, 2600:1413:b000:383::3ff9
Response IP 184.84.207.176
Found Yes
Hash 3b9bf90fff36ef544e780d1e163ffbbe887b088fb7bf3ecc41666aa6e546f42b
SimHash 6324db4dcf93

Groups

*

Product Comment
* applies to all robots
Rule Path Comment
Allow / allow all
Disallow */secur/forgotpassword.jsp?* -

Other Records

Field Value
sitemap https://cbpcomplaints.cbp.gov/s/sitemap.xml

Comments

  • default robots.txt for sfdc communities sites
  • For use by salesforce.com