gq-magazine.co.uk
robots.txt

Robots Exclusion Standard data for gq-magazine.co.uk

Resource Scan

Scan Details

Site Domain gq-magazine.co.uk
Base Domain gq-magazine.co.uk
Scan Status Ok
Last Scan2024-11-16T00:45:19+00:00
Next Scan 2024-11-23T00:45:19+00:00

Last Scan

Scanned2024-11-16T00:45:19+00:00
URL https://gq-magazine.co.uk/robots.txt
Redirect https://www.gq-magazine.co.uk/robots.txt
Redirect Domain www.gq-magazine.co.uk
Redirect Base gq-magazine.co.uk
Domain IPs 2a05:d018:f0d:d700:c34e:8388:1340:84ee, 2a05:d018:f0d:d701:8e83:49d1:24f8:962f, 2a05:d018:f0d:d702:52bf:70b:5ab8:97c6, 34.242.143.176, 34.247.10.29, 52.31.100.167
Redirect IPs 18.155.68.116, 18.155.68.39, 18.155.68.42, 18.155.68.74, 2600:9000:23d2:2a00:1f:f1fe:5dc0:93a1, 2600:9000:23d2:3400:1f:f1fe:5dc0:93a1, 2600:9000:23d2:5c00:1f:f1fe:5dc0:93a1, 2600:9000:23d2:7800:1f:f1fe:5dc0:93a1, 2600:9000:23d2:8400:1f:f1fe:5dc0:93a1, 2600:9000:23d2:9c00:1f:f1fe:5dc0:93a1, 2600:9000:23d2:bc00:1f:f1fe:5dc0:93a1, 2600:9000:23d2:d600:1f:f1fe:5dc0:93a1
Response IP 18.155.68.42
Found Yes
Hash 1e1e008a3be20650f1a0d8351cdf4fee64468bd9083c12f172e27796c89d0ad3
SimHash 65048bc1c2e3

Groups

*

Rule Path
Disallow /preview/
Disallow /search
Disallow *?image=
Disallow */image/
Disallow /5574*
Disallow /*?redirectURL=
Disallow /*%7B%7Bsection%7D%7D
Disallow /*%7B%7Bsection%7D%7D
Disallow /auth/*
Disallow /account/*
Disallow /product/
Disallow /user-context?referrer
Disallow /services.min.js?_=
Disallow /com.condenast/yv8*

google-inspectiontool

Rule Path
Allow /

ccbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

youbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.gq-magazine.co.uk/sitemap.xml
sitemap https://www.gq-magazine.co.uk/feed/rss
sitemap https://www.gq-magazine.co.uk/feed/google-latest-news/sitemap-google-news
sitemap https://www.gq-magazine.co.uk/categories-sitemap.xml
sitemap https://www.gq-magazine.co.uk/contributors-sitemap.xml
sitemap https://www.gq-magazine.co.uk/branded-sitemap.xml
sitemap https://www.gq-magazine.co.uk/bundles-sitemap.xml