cosmos.co.uk
robots.txt

Robots Exclusion Standard data for cosmos.co.uk

Resource Scan

Scan Details

Site Domain cosmos.co.uk
Base Domain cosmos.co.uk
Scan Status Ok
Last Scan2025-11-21T22:51:15+00:00
Next Scan 2025-12-21T22:51:15+00:00

Last Scan

Scanned2025-11-21T22:51:15+00:00
URL https://cosmos.co.uk/robots.txt
Redirect https://www.cosmos.co.uk/robots.txt
Redirect Domain www.cosmos.co.uk
Redirect Base cosmos.co.uk
Domain IPs 20.119.16.57
Redirect IPs 104.18.35.3, 172.64.152.253
Response IP 104.18.35.3
Found Yes
Hash 3ef17660c5184c8087b07038736c8063aae2e9939060e67866975804322a09a2
SimHash 79958a966513

Groups

*

Rule Path
Allow /
Disallow /APIs
Disallow /print
Disallow /common
Disallow /Common
Disallow /gaparm
Disallow /Thank-You
Disallow /thank_you
Disallow /YourWayList*
Disallow *mode%3Dprintme*
Disallow *content%3Dprint*
Disallow /WebResource.axd
Disallow /user/slideshow/
Disallow /Avalon-DealPop/
Disallow /avalon-DealPop/
Allow /user/slideshow///.jpg
Disallow /Avalon-TimeOnSite/
Disallow /avalon-TimeOnSite/
Disallow /Avalon-Subscribe/*
Disallow /avalon-subscribe/*
Disallow /Avalon-AskAnExpert/
Disallow /avalon-AskAnExpert/
Disallow /Avalon-RequestAQuote/
Disallow /avalon-group-request/
Disallow /avalon-RequestAQuote/
Disallow /Avalon-group-request/
Disallow /AVALON-RequestAQuote/*
Allow /Common/Know-Before-You-Go/
Disallow /controls/currencyconverterframe.aspx
Disallow /user/htmlresources/changecountry.html

gptbot

Rule Path
Allow /

googlebot

Rule Path
Allow /

chatgpt-user

Rule Path
Allow /

oai-searchbot

Rule Path
Allow /

perplexitybot

Rule Path
Allow /

google-extended

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.cosmos.co.uk/sitemap.xml