help.cbp.gov
robots.txt
Robots Exclusion Standard data for help.cbp.gov
Resource Scan
Scan Details
| Site Domain | help.cbp.gov |
| Base Domain | cbp.gov |
| Scan Status | Ok |
| Last Scan | 2024-06-03T07:02:09+00:00 |
| Next Scan | 2024-06-17T07:02:09+00:00 |
Last Scan
| Scanned | 2024-06-03T07:02:09+00:00 |
| URL | https://help.cbp.gov/robots.txt |
| Redirect | https://www.help.cbp.gov/robots.txt |
| Redirect Domain | www.help.cbp.gov |
| Redirect Base | cbp.gov |
| Domain IPs | 23.47.109.53, 2600:1413:1:996::1955 |
| Redirect IPs | 184.85.126.152, 2600:1413:1:597::3ff9, 2600:1413:1:59a::3ff9 |
| Response IP | 104.76.137.133 |
| Found | Yes |
| Hash | 3b9bf90fff36ef544e780d1e163ffbbe887b088fb7bf3ecc41666aa6e546f42b |
| SimHash | 6324db4dcf93 |
Groups
*
| Product | Comment |
|---|---|
| * | applies to all robots |
| Rule | Path | Comment |
|---|---|---|
| Allow | / | allow all |
| Disallow | */secur/forgotpassword.jsp?* | - |
Other Records
| Field | Value |
|---|---|
| sitemap | https://cbpcomplaints.cbp.gov/s/sitemap.xml |
Comments