thescotsman.co.uk
robots.txt
Robots Exclusion Standard data for thescotsman.co.uk
Resource Scan
Scan Details
Site Domain | thescotsman.co.uk |
Base Domain | thescotsman.co.uk |
Scan Status | Ok |
Last Scan | 2024-06-20T16:09:19+00:00 |
Next Scan | 2024-06-27T16:09:19+00:00 |
Last Scan
Scanned | 2024-06-20T16:09:19+00:00 |
URL | http://thescotsman.co.uk/robots.txt |
Redirect | https://www.scotsman.com/robots.txt |
Redirect Domain | www.scotsman.com |
Redirect Base | scotsman.com |
Domain IPs | 34.105.168.53 |
Redirect IPs | 104.18.35.12, 172.64.152.244, 2606:4700:4400::6812:230c, 2606:4700:4400::ac40:98f4 |
Response IP | 104.18.35.12 |
Found | Yes |
Hash | 62bb8db3ded61716080c650c6b10d82a11d9674e98de602f4c0d0d4b46d2c87e |
SimHash | 290c1c44cb12 |
Other Records
Field | Value |
---|---|
sitemap | https://www.scotsman.com/sitemaps/googlenews |
sitemap | https://www.scotsman.com/sitemap.xml |
sitemap | https://www.scotsman.com/sitemap-recent.xml |