glamourmagazine.co.uk
robots.txt

Robots Exclusion Standard data for glamourmagazine.co.uk

Resource Scan

Scan Details

Site Domain glamourmagazine.co.uk
Base Domain glamourmagazine.co.uk
Scan Status Ok
Last Scan2024-07-01T21:57:42+00:00
Next Scan 2024-07-08T21:57:42+00:00

Last Scan

Scanned2024-07-01T21:57:42+00:00
URL https://glamourmagazine.co.uk/robots.txt
Redirect https://www.glamourmagazine.co.uk/robots.txt
Redirect Domain www.glamourmagazine.co.uk
Redirect Base glamourmagazine.co.uk
Domain IPs 2a05:d018:f0d:d700:c827:91ea:9bbe:42e0, 2a05:d018:f0d:d701:c2a0:1e5a:367f:b760, 2a05:d018:f0d:d702:ee4a:b7d6:612d:a3e1, 52.48.190.115, 54.155.179.196, 54.217.31.35
Redirect IPs 2600:9000:2721:2200:19:f0a0:1d40:93a1, 2600:9000:2721:4200:19:f0a0:1d40:93a1, 2600:9000:2721:6200:19:f0a0:1d40:93a1, 2600:9000:2721:a600:19:f0a0:1d40:93a1, 2600:9000:2721:ac00:19:f0a0:1d40:93a1, 2600:9000:2721:c800:19:f0a0:1d40:93a1, 2600:9000:2721:d800:19:f0a0:1d40:93a1, 2600:9000:2721:e200:19:f0a0:1d40:93a1, 3.165.102.36, 3.165.102.76, 3.165.102.82, 3.165.102.90
Response IP 3.165.102.36
Found Yes
Hash adeee68740867819ec8c1c7027b81ba819661f8bbb56a60acde2fed9163fa2ba
SimHash 65101141f712

Groups

*

Rule Path
Disallow /search
Disallow /preview/
Disallow /5574*
Disallow /xhr/
Disallow /*?redirectURL=
Disallow /*%7B%7Bsection%7D%7D
Disallow /*%7B%7Bsection%7D%7D
Disallow /auth/*
Disallow /account/*
Disallow /product/
Disallow /user-context?referrer
Disallow /services.min.js?_=

google-inspectiontool

Rule Path
Allow /

ccbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

youbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.glamourmagazine.co.uk/sitemap.xml
sitemap https://www.glamourmagazine.co.uk/feed/rss
sitemap https://www.glamourmagazine.co.uk/feed/google-latest-news/sitemap-google-news
sitemap https://www.glamourmagazine.co.uk/discountcodes/sitemap.xml
sitemap https://www.glamourmagazine.co.uk/categories-sitemap.xml
sitemap https://www.glamourmagazine.co.uk/contributors-sitemap.xml
sitemap https://www.glamourmagazine.co.uk/branded-sitemap.xml
sitemap https://www.glamourmagazine.co.uk/sitemap-archive-1.xml
sitemap https://www.glamourmagazine.co.uk/bundles-sitemap.xml