usconsulate.gov
robots.txt
Robots Exclusion Standard data for usconsulate.gov
Resource Scan
Scan Details
| Site Domain | usconsulate.gov |
| Base Domain | usconsulate.gov |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-05-16T20:54:06+00:00 |
| Next Scan | 2024-07-15T20:54:06+00:00 |
Last Successful Scan
| Scanned | 2024-02-24T20:53:11+00:00 |
| URL | https://usconsulate.gov/robots.txt |
| Redirect | https://www.state.gov/robots.txt |
| Redirect Domain | www.state.gov |
| Redirect Base | state.gov |
| Domain IPs | 2600:1f18:4659:1600:5c0e:d4cf:ce29:54c8, 34.233.79.178 |
| Redirect IPs | 18.155.68.101, 18.155.68.123, 18.155.68.32, 18.155.68.70, 2600:9000:23d2:3400:1f:e8cc:9e00:93a1, 2600:9000:23d2:5e00:1f:e8cc:9e00:93a1, 2600:9000:23d2:6400:1f:e8cc:9e00:93a1, 2600:9000:23d2:6a00:1f:e8cc:9e00:93a1, 2600:9000:23d2:ae00:1f:e8cc:9e00:93a1, 2600:9000:23d2:be00:1f:e8cc:9e00:93a1, 2600:9000:23d2:e00:1f:e8cc:9e00:93a1, 2600:9000:23d2:ee00:1f:e8cc:9e00:93a1 |
| Response IP | 18.155.68.123 |
| Found | Yes |
| Hash | ce427b27cc48c486f6200ae03b9a8f3abbae22a42cb1fe68671b01d61c4270d2 |
| SimHash | 6928c8c0e19b |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.state.gov/sitemap_index.xml |
Warnings
- 1 invalid line.
Comments