gq.co.uk
robots.txt
Robots Exclusion Standard data for gq.co.uk
Resource Scan
Scan Details
| Site Domain | gq.co.uk |
| Base Domain | gq.co.uk |
| Scan Status | Ok |
| Last Scan | 2024-09-21T14:49:47+00:00 |
| Next Scan | 2024-09-28T14:49:47+00:00 |
Last Scan
| Scanned | 2024-09-21T14:49:47+00:00 |
| URL | https://gq.co.uk/robots.txt |
| Redirect | https://www.gq-magazine.co.uk/robots.txt |
| Redirect Domain | www.gq-magazine.co.uk |
| Redirect Base | gq-magazine.co.uk |
| Domain IPs | 2a05:d018:f0d:d700:64c8:6656:9175:ed96, 2a05:d018:f0d:d701:871a:9cb3:5796:b666, 2a05:d018:f0d:d702:7de0:a965:8f:8fef, 52.212.158.33, 54.194.18.35, 54.76.84.245 |
| Redirect IPs | 18.155.68.116, 18.155.68.39, 18.155.68.42, 18.155.68.74, 2600:9000:23d2:1c00:1f:f1fe:5dc0:93a1, 2600:9000:23d2:2600:1f:f1fe:5dc0:93a1, 2600:9000:23d2:8000:1f:f1fe:5dc0:93a1, 2600:9000:23d2:9000:1f:f1fe:5dc0:93a1, 2600:9000:23d2:bc00:1f:f1fe:5dc0:93a1, 2600:9000:23d2:ce00:1f:f1fe:5dc0:93a1, 2600:9000:23d2:f200:1f:f1fe:5dc0:93a1, 2600:9000:23d2:f400:1f:f1fe:5dc0:93a1 |
| Response IP | 18.155.68.42 |
| Found | Yes |
| Hash | fff965d7988e4b5c95eca937e772c66c791c800b7e99528bfdf66485a11e4f58 |
| SimHash | 450489c1c7a3 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /preview/ |
| Disallow | /search |
| Disallow | *?image= |
| Disallow | */image/ |
| Disallow | /5574* |
| Disallow | /*?redirectURL= |
| Disallow | /*%7B%7Bsection%7D%7D |
| Disallow | /*%7B%7Bsection%7D%7D |
| Disallow | /auth/* |
| Disallow | /account/* |
| Disallow | /product/ |
| Disallow | /user-context?referrer |
| Disallow | /services.min.js?_= |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.gq-magazine.co.uk/sitemap.xml |
| sitemap | https://www.gq-magazine.co.uk/feed/rss |
| sitemap | https://www.gq-magazine.co.uk/feed/google-latest-news/sitemap-google-news |
| sitemap | https://www.gq-magazine.co.uk/categories-sitemap.xml |
| sitemap | https://www.gq-magazine.co.uk/contributors-sitemap.xml |
| sitemap | https://www.gq-magazine.co.uk/branded-sitemap.xml |
| sitemap | https://www.gq-magazine.co.uk/bundles-sitemap.xml |