vogue.co.uk
robots.txt

Robots Exclusion Standard data for vogue.co.uk

Resource Scan

Scan Details

Site Domain vogue.co.uk
Base Domain vogue.co.uk
Scan Status Ok
Last Scan2024-09-20T12:43:53+00:00
Next Scan 2024-09-27T12:43:53+00:00

Last Scan

Scanned2024-09-20T12:43:53+00:00
URL https://vogue.co.uk/robots.txt
Redirect https://www.vogue.co.uk/robots.txt
Redirect Domain www.vogue.co.uk
Redirect Base vogue.co.uk
Domain IPs 2a05:d018:f0d:d700:64c8:6656:9175:ed96, 2a05:d018:f0d:d701:871a:9cb3:5796:b666, 2a05:d018:f0d:d702:7de0:a965:8f:8fef, 52.212.158.33, 54.194.18.35, 54.76.84.245
Redirect IPs 13.227.254.102, 13.227.254.114, 13.227.254.21, 13.227.254.43, 2600:9000:200a:1e00:1b:cf0c:8200:93a1, 2600:9000:200a:400:1b:cf0c:8200:93a1, 2600:9000:200a:8400:1b:cf0c:8200:93a1, 2600:9000:200a:9200:1b:cf0c:8200:93a1, 2600:9000:200a:b600:1b:cf0c:8200:93a1, 2600:9000:200a:bc00:1b:cf0c:8200:93a1, 2600:9000:200a:de00:1b:cf0c:8200:93a1, 2600:9000:200a:fa00:1b:cf0c:8200:93a1
Response IP 13.227.254.114
Found Yes
Hash 56228c4c00ec6720a2615e25b740b908bfd4a5fc326e94f42079a386251bd24b
SimHash 449c8941c683

Groups

*

Rule Path
Disallow /preview/
Disallow /5574*
Disallow /voguevoices/thankyou
Disallow /voguevoices/thankyou2
Disallow *?image=
Disallow */image/
Disallow /search
Disallow /search?
Disallow /search/
Disallow /*?redirectURL=
Disallow /*%7B%7Burl%7D%7D
Disallow /*%7B%7Burl%7D%7D
Disallow /auth/*
Disallow /account/*
Disallow /*%7B%7Bsection%7D%7D
Disallow /*%7B%7Bsection%7D%7D
Disallow /product/
Disallow /user-context?referrer
Disallow /services.min.js?_=

google-inspectiontool

Rule Path
Allow /

ccbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

youbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.vogue.co.uk/sitemap.xml
sitemap https://www.vogue.co.uk/feed/sitemap/sitemap-google-news
sitemap https://www.vogue.co.uk/feed/rss
sitemap https://www.vogue.co.uk/feed/sitemap/rss
sitemap https://www.vogue.co.uk/categories-sitemap.xml
sitemap https://www.vogue.co.uk/contributors-sitemap.xml
sitemap https://www.vogue.co.uk/branded-sitemap.xml
sitemap https://www.vogue.co.uk/bundles-sitemap.xml
sitemap https://www.vogue.co.uk/sitemap-archive-1.xml