ww2.ocado.com
robots.txt

Robots Exclusion Standard data for ww2.ocado.com

Resource Scan

Scan Details

Site Domain ww2.ocado.com
Base Domain ocado.com
Scan Status Ok
Last Scan2025-07-23T02:34:44+00:00
Next Scan 2025-08-06T02:34:44+00:00

Last Scan

Scanned2025-07-23T02:34:44+00:00
URL https://ww2.ocado.com/robots.txt
Domain IPs 18.161.97.107, 18.161.97.22, 18.161.97.56, 18.161.97.78
Response IP 18.165.72.9
Found Yes
Hash 4fd465fa04ebaac1f6425e86b7f1804d885cd83c174f934ebe921c094afb8c7b
SimHash 50180a01c4b2

Groups

anthropic-ai
applebot-extended
chatgpt-user
claudebot
cohere-ai
diffbot
facebookbot
gptbot
google-extended
perplexitybot
bytespider
ccbot

Rule Path
Allow /

onetrustbot
mozilla/5.0 (x11; linux x86_64; rv:87.0) gecko/20100101 firefox/87.0;onetrustbot;

Rule Path
Allow /
Disallow /previewer/*

*

Rule Path
Disallow /

Comments

  • Allowed AI and Search Bots
  • Special Rules for OneTrustBot
  • Default Block for All Other Bots