cbpcomplaints.cbp.gov
robots.txt
Robots Exclusion Standard data for cbpcomplaints.cbp.gov
Resource Scan
Scan Details
| Site Domain | cbpcomplaints.cbp.gov |
| Base Domain | cbp.gov |
| Scan Status | Ok |
| Last Scan | 2026-04-10T08:14:14+00:00 |
| Next Scan | 2026-04-24T08:14:14+00:00 |
Last Scan
| Scanned | 2026-04-10T08:14:14+00:00 |
| URL | https://cbpcomplaints.cbp.gov/robots.txt |
| Domain IPs | 23.210.99.204, 2600:1413:5000:a84::12b4, 2600:1413:5000:a8b::12b4 |
| Response IP | 104.69.42.67 |
| Found | Yes |
| Hash | 3b9bf90fff36ef544e780d1e163ffbbe887b088fb7bf3ecc41666aa6e546f42b |
| SimHash | 6324db4dcf93 |
Groups
*
| Product | Comment |
|---|---|
| * | applies to all robots |
| Rule | Path | Comment |
|---|---|---|
| Allow | / | allow all |
| Disallow | */secur/forgotpassword.jsp?* | - |
Other Records
| Field | Value |
|---|---|
| sitemap | https://cbpcomplaints.cbp.gov/s/sitemap.xml |
Comments