blogs.spectator.co.uk
robots.txt
Robots Exclusion Standard data for blogs.spectator.co.uk
Resource Scan
Scan Details
Site Domain | blogs.spectator.co.uk |
Base Domain | spectator.co.uk |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a server error. |
Last Scan | 2024-09-01T21:30:27+00:00 |
Next Scan | 2024-10-01T21:30:27+00:00 |
Last Successful Scan
Scanned | 2024-07-11T21:29:36+00:00 |
URL | https://blogs.spectator.co.uk/robots.txt |
Redirect | https://www.spectator.co.uk/robots.txt |
Redirect Domain | www.spectator.co.uk |
Redirect Base | spectator.co.uk |
Domain IPs | 54.192.18.120, 54.192.18.15, 54.192.18.33, 54.192.18.53 |
Redirect IPs | 13.33.183.26, 13.33.183.53, 13.33.183.78, 13.33.183.91, 2600:9000:223b:0:8:cc2e:7a40:93a1, 2600:9000:223b:2600:8:cc2e:7a40:93a1, 2600:9000:223b:2e00:8:cc2e:7a40:93a1, 2600:9000:223b:6400:8:cc2e:7a40:93a1, 2600:9000:223b:7000:8:cc2e:7a40:93a1, 2600:9000:223b:a400:8:cc2e:7a40:93a1, 2600:9000:223b:f400:8:cc2e:7a40:93a1, 2600:9000:223b:fa00:8:cc2e:7a40:93a1 |
Response IP | 13.33.88.101 |
Found | Yes |
Hash | 49d10c93c6fb23dfd34de8c03e2b20b76cfc3f819be562035cbb4bdad1cd2126 |
SimHash | e96c8880a992 |
Other Records
Field | Value |
---|---|
sitemap | https://www.spectator.co.uk/sitemap_index.xml |
Comments