state.co.nz
robots.txt
Robots Exclusion Standard data for state.co.nz
Resource Scan
Scan Details
| Site Domain | state.co.nz |
| Base Domain | state.co.nz |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-05-26T09:42:13+00:00 |
| Next Scan | 2024-08-24T09:42:13+00:00 |
Last Successful Scan
| Scanned | 2023-07-09T07:59:59+00:00 |
| URL | https://state.co.nz/robots.txt |
| Redirect | https://www.state.co.nz/robots.txt |
| Redirect Domain | www.state.co.nz |
| Redirect Base | state.co.nz |
| Domain IPs | 23.52.171.57, 23.59.168.144, 2600:1413:b000:1b::17d7:70e, 2600:1413:b000:1b::17d7:714 |
| Redirect IPs | 23.215.7.14, 23.215.7.20, 2600:1413:b000:1b::17d7:70e, 2600:1413:b000:1b::17d7:714 |
| Response IP | 23.59.168.144 |
| Found | Yes |
| Hash | 53a9fda54778e2d6e33d7e542e503f1ff962944ca9d599a15b4b15bd5b6de769 |
| SimHash | e0585844cf93 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | |
| Disallow | /error |
| Disallow | /error/* |
| Disallow | /preview/ |
| Disallow | /direct/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.state.co.nz/sitemap.xml |