cloving.co.uk
robots.txt

Robots Exclusion Standard data for cloving.co.uk

Resource Scan

Scan Details

Site Domain cloving.co.uk
Base Domain cloving.co.uk
Scan Status Ok
Last Scan2025-08-18T00:38:25+00:00
Next Scan 2025-09-17T00:38:25+00:00

Last Scan

Scanned2025-08-18T00:38:25+00:00
URL https://cloving.co.uk/robots.txt
Domain IPs 104.26.14.18, 104.26.15.18, 172.67.71.53, 2606:4700:20::681a:e12, 2606:4700:20::681a:f12, 2606:4700:20::ac43:4735
Response IP 104.26.14.18
Found Yes
Hash 0203564b7e4e3adcb7f31425c3afd8bf8aa36e97583e58d9c86651b4bec16055
SimHash 641f98a26b38

Groups

*

Rule Path
Disallow /app
Disallow /customer
Disallow /*?*default_size=
Disallow /*%26*default_size%3D
Disallow /*?*mgs_brand=
Disallow /*%26*mgs_brand%3D
Disallow /*?*cat=
Disallow /*%26*cat%3D
Disallow /*?*color=
Disallow /*%26*color%3D
Disallow /*?*p=
Disallow /*%26*p%3D
Disallow /*?*price=
Disallow /*%26*price%3D

mj12bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

Comments

  • User-agent: bingbot
  • Disallow: /