whitedream.co.uk
robots.txt

Robots Exclusion Standard data for whitedream.co.uk

Resource Scan

Scan Details

Site Domain whitedream.co.uk
Base Domain whitedream.co.uk
Scan Status Ok
Last Scan2024-09-09T08:25:38+00:00
Next Scan 2024-10-09T08:25:38+00:00

Last Scan

Scanned2024-09-09T08:25:38+00:00
URL https://whitedream.co.uk/robots.txt
Domain IPs 104.21.43.246, 172.67.190.167, 2606:4700:3033::ac43:bea7, 2606:4700:3035::6815:2bf6
Response IP 104.21.43.246
Found Yes
Hash b783dc240cbf32dcf125407b046a277f123c4b1e3d374a6420b7dc94c189bf89
SimHash 2b5898924355

Groups

adsbot-google

Rule Path
Disallow /account.php
Disallow /cart.php
Disallow /checkout.php
Disallow /finishorder.php
Disallow /login.php
Disallow /orderstatus.php
Disallow /postreview.php
Disallow /productimage.php
Disallow /productupdates.php
Disallow /remote.php
Disallow /search.php
Disallow /viewfile.php
Disallow /wishlist.php
Disallow /admin/
Disallow /__socialshop/

*

Rule Path
Disallow /

google-xrawler

Rule Path
Allow /feeds/*

*

Rule Path
Disallow /*?_bc_fsnf=1*
Disallow /*%26_bc_fsnf%3D1*