www.help.cbp.gov
robots.txt
Robots Exclusion Standard data for www.help.cbp.gov
Resource Scan
Scan Details
Site Domain | www.help.cbp.gov |
Base Domain | cbp.gov |
Scan Status | Ok |
Last Scan | 2024-06-25T10:55:50+00:00 |
Next Scan | 2024-07-09T10:55:50+00:00 |
Last Scan
Scanned | 2024-06-25T10:55:50+00:00 |
URL | https://www.help.cbp.gov/robots.txt |
Domain IPs | 184.85.126.152, 2600:1417:3f:789::3ff9, 2600:1417:3f:79d::3ff9 |
Response IP | 104.76.137.133 |
Found | Yes |
Hash | 3b9bf90fff36ef544e780d1e163ffbbe887b088fb7bf3ecc41666aa6e546f42b |
SimHash | 6324db4dcf93 |
Groups
*
Product | Comment |
---|---|
* | applies to all robots |
Rule | Path | Comment |
---|---|---|
Allow | / | allow all |
Disallow | */secur/forgotpassword.jsp?* | - |
Other Records
Field | Value |
---|---|
sitemap | https://cbpcomplaints.cbp.gov/s/sitemap.xml |
Comments