wired.co.uk
robots.txt
Robots Exclusion Standard data for wired.co.uk
Resource Scan
Scan Details
Site Domain | wired.co.uk |
Base Domain | wired.co.uk |
Scan Status | Ok |
Last Scan | 2024-11-13T14:42:43+00:00 |
Next Scan | 2024-11-20T14:42:43+00:00 |
Last Scan
Scanned | 2024-11-13T14:42:43+00:00 |
URL | https://wired.co.uk/robots.txt |
Redirect | https://www.wired.co.uk/robots.txt |
Redirect Domain | www.wired.co.uk |
Redirect Base | wired.co.uk |
Domain IPs | 2a05:d018:f0d:d700:c34e:8388:1340:84ee, 2a05:d018:f0d:d701:8e83:49d1:24f8:962f, 2a05:d018:f0d:d702:52bf:70b:5ab8:97c6, 34.242.143.176, 34.247.10.29, 52.31.100.167 |
Redirect IPs | 151.101.0.239, 151.101.128.239, 151.101.192.239, 151.101.64.239 |
Response IP | 199.232.44.239 |
Found | Yes |
Hash | b510f91add46dbb9d62bc7c2f1e274f3c571d6c501d4c1e7ec9bda60aebd016f |
SimHash | 6502c161c6b3 |
Groups
*
Rule | Path |
---|---|
Disallow | /preview/ |
Disallow | /search |
Disallow | /*?redirectURL= |
Disallow | /auth/* |
Disallow | /account/* |
Disallow | /product/ |
Disallow | /user-context?referrer |
Disallow | /services.min.js?_= |
Disallow | /com.condenast/yv8* |
Other Records
Field | Value |
---|---|
sitemap | https://www.wired.co.uk/sitemap.xml |
sitemap | https://www.wired.co.uk/feed/google-latest-news/sitemap-google-news |
sitemap | https://www.wired.co.uk/feed/rss |
sitemap | https://www.wired.co.uk/categories-sitemap.xml |
sitemap | https://www.wired.co.uk/contributors-sitemap.xml |
sitemap | https://www.wired.co.uk/branded-sitemap.xml |
sitemap | https://www.wired.co.uk/bundles-sitemap.xml |