bumfuzzles.co.uk
robots.txt

Robots Exclusion Standard data for bumfuzzles.co.uk

Resource Scan

Scan Details

Site Domain bumfuzzles.co.uk
Base Domain bumfuzzles.co.uk
Scan Status Ok
Last Scan2025-10-16T17:04:04+00:00
Next Scan 2025-10-23T17:04:04+00:00

Last Scan

Scanned2025-10-16T17:04:04+00:00
URL https://bumfuzzles.co.uk/robots.txt
Redirect https://www.bumfuzzles.co.uk/robots.txt
Redirect Domain www.bumfuzzles.co.uk
Redirect Base bumfuzzles.co.uk
Domain IPs 46.253.116.92
Redirect IPs 46.253.116.92
Response IP 46.253.116.92
Found Yes
Hash e1b375d457d1d85516e3b0f30116c72948de45a1d8e09b6f22b9da3df953b1d6
SimHash 557cdd70fe2f

Groups

claude-web
claudebot
semrushbot
blexbot
ahrefsbot
dotbot

Rule Path
Disallow /

pinterestbot

Rule Path
Allow /
Disallow /shop/category

Other Records

Field Value
crawl-delay 1.0

gptbot
amazonbot

Rule Path
Allow /
Disallow /shop/category

*

Rule Path
Allow /
Disallow /cart

Other Records

Field Value
crawl-delay 0.2

Comments

  • Disallowed crawlers
  • Pinterest
  • Amazon (Alexa), OpenAI GPTBot
  • All crawlers