wired.co.uk
robots.txt
Robots Exclusion Standard data for wired.co.uk
Resource Scan
Scan Details
| Site Domain | wired.co.uk |
| Base Domain | wired.co.uk |
| Scan Status | Ok |
| Last Scan | 2024-09-25T14:33:23+00:00 |
| Next Scan | 2024-10-02T14:33:23+00:00 |
Last Scan
| Scanned | 2024-09-25T14:33:23+00:00 |
| URL | https://wired.co.uk/robots.txt |
| Redirect | https://www.wired.co.uk/robots.txt |
| Redirect Domain | www.wired.co.uk |
| Redirect Base | wired.co.uk |
| Domain IPs | 2a05:d018:f0d:d700:174e:4c29:c02d:2ca5, 2a05:d018:f0d:d701:8d7e:eba:95a8:1fe4, 2a05:d018:f0d:d702:f6b4:9c84:419e:9895, 52.212.158.33, 52.215.29.69, 52.49.165.81 |
| Redirect IPs | 151.101.0.239, 151.101.128.239, 151.101.192.239, 151.101.64.239 |
| Response IP | 199.232.44.239 |
| Found | Yes |
| Hash | a22f3c2e2d0fb3e26bd47f70a1bd6c66fcad7c9352dccaf1e421e7e7a3f3aa2a |
| SimHash | 4500c960c7b3 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /preview/ |
| Disallow | /search |
| Disallow | /*?redirectURL= |
| Disallow | /auth/* |
| Disallow | /account/* |
| Disallow | /product/ |
| Disallow | /user-context?referrer |
| Disallow | /services.min.js?_= |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.wired.co.uk/sitemap.xml |
| sitemap | https://www.wired.co.uk/feed/google-latest-news/sitemap-google-news |
| sitemap | https://www.wired.co.uk/feed/rss |
| sitemap | https://www.wired.co.uk/categories-sitemap.xml |
| sitemap | https://www.wired.co.uk/contributors-sitemap.xml |
| sitemap | https://www.wired.co.uk/branded-sitemap.xml |
| sitemap | https://www.wired.co.uk/bundles-sitemap.xml |