which.co.uk
robots.txt

Robots Exclusion Standard data for which.co.uk

Resource Scan

Scan Details

Site Domain which.co.uk
Base Domain which.co.uk
Scan Status Ok
Last Scan2024-05-23T05:40:40+00:00
Next Scan 2024-06-06T05:40:40+00:00

Last Scan

Scanned2024-05-23T05:40:40+00:00
URL https://which.co.uk/robots.txt
Redirect https://www.which.co.uk/robots.txt
Redirect Domain www.which.co.uk
Redirect Base which.co.uk
Domain IPs 52.19.36.99, 52.208.157.160, 52.210.187.69
Redirect IPs 18.161.6.111, 18.161.6.36, 18.161.6.44, 18.161.6.86
Response IP 108.157.52.9
Found Yes
Hash 3b58cbea9f3549f1b0b2652c4f7ec04c1cf984d28d69db346236ff7a40edf098
SimHash bc3f46e8891b

Groups

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

*

Rule Path
Disallow /baby-and-child/archive/
Disallow /energy/archive/
Disallow /home-and-garden/archive/
Disallow /money/archive/
Disallow /technology/archive/
Disallow /about-which/contact-us/send-us-a-message/thank-you/
Disallow /account/
Disallow /beta/
Disallow /cgi-bin/
Disallow /competitions/best-buy/entry-thank-you/
Disallow /components/
Disallow /documents/
Disallow /login/
Disallow /loginhelp/
Disallow /loginidentification/
Disallow /magazine/computing/thank-you/
Disallow /media/popup/
Disallow /new/
Disallow /signup-light/
Disallow /spp/
Disallow /static/email-pdfs/
Disallow /static/html/pdfs/
Disallow /thank-you/
Disallow /try-which/bbg/faqs/
Disallow /try-which/bbg/terms-conditions/
Disallow /try-which/price-predictor/
Disallow /try-which/wills/
Disallow /user/
Disallow /30585109/

Other Records

Field Value
sitemap https://www.which.co.uk/sitemap.xml

Comments

  • disallow indexing of content archive
  • disallow indexing of utility pages
  • disallow indexing for test scopes