hobbycraft.co.uk
robots.txt

Robots Exclusion Standard data for hobbycraft.co.uk

Resource Scan

Scan Details

Site Domain hobbycraft.co.uk
Base Domain hobbycraft.co.uk
Scan Status Ok
Last Scan2024-05-26T06:34:30+00:00
Next Scan 2024-06-25T06:34:30+00:00

Last Scan

Scanned2024-05-26T06:34:30+00:00
URL https://hobbycraft.co.uk/robots.txt
Redirect https://www.hobbycraft.co.uk/robots.txt
Redirect Domain www.hobbycraft.co.uk
Redirect Base hobbycraft.co.uk
Domain IPs 23.59.168.184
Redirect IPs 23.59.168.147, 23.59.168.184
Response IP 23.32.29.9
Found Yes
Hash 0dff7b116aa2e4e7f4869507628a1522cdb31d4e3407429d10455ec7db4172e3
SimHash 6b209326cdd5

Groups

*

Rule Path
Allow */demandware.static/*/images/*
Allow */demandware.static/*.css$
Disallow */demandware.static/*
Disallow */demandware.store/*
Disallow */login/*
Disallow */account/*
Disallow /*?awc=
Disallow /*%26awc%3D
Disallow /*?ref=
Disallow /*%26ref%3D
Disallow /*?*dm_i=
Disallow /*?*errormessage=
Disallow /*?bvstate*=
Disallow /*%26bvstate*%3D
Disallow /*?prefn*=
Disallow /*%26prefv1*%3D
Disallow /on/demandware.store/Sites-hobbycraft-uk-Site/en_GB/Error-JsLogger

Other Records

Field Value
sitemap https://www.hobbycraft.co.uk/sitemap_index.xml

Comments

  • Robots updated on 18/10/22 requested by Rebel
  • Robots updated on 19/12/22 requested by Rebel
  • Demandware Allows
  • Demandware Disallows
  • Login Disallows
  • tracking parameter Disallows
  • block BV pagination
  • disallow filter URLs
  • disallow error tracker URL