www.help.cbp.gov
robots.txt
Robots Exclusion Standard data for www.help.cbp.gov
Resource Scan
Scan Details
Site Domain | www.help.cbp.gov |
Base Domain | cbp.gov |
Scan Status | Ok |
Last Scan | 2024-11-12T13:36:02+00:00 |
Next Scan | 2024-11-26T13:36:02+00:00 |
Last Scan
Scanned | 2024-11-12T13:36:02+00:00 |
URL | https://www.help.cbp.gov/robots.txt |
Domain IPs | 23.50.82.177, 2600:1413:b000:382::3ff9, 2600:1413:b000:383::3ff9 |
Response IP | 184.84.207.176 |
Found | Yes |
Hash | 3b9bf90fff36ef544e780d1e163ffbbe887b088fb7bf3ecc41666aa6e546f42b |
SimHash | 6324db4dcf93 |
Groups
*
Product | Comment |
---|---|
* | applies to all robots |
Rule | Path | Comment |
---|---|---|
Allow | / | allow all |
Disallow | */secur/forgotpassword.jsp?* | - |
Other Records
Field | Value |
---|---|
sitemap | https://cbpcomplaints.cbp.gov/s/sitemap.xml |
Comments