Log In Sign Up

goodsixty.co.uk
robots.txt

Robots Exclusion Standard data for goodsixty.co.uk

Resource Scan

Scan Details

Site Domain goodsixty.co.uk
Base Domain goodsixty.co.uk
Scan Status Ok
Last Scan2024-08-30T22:37:04+00:00
Next Scan 2024-09-29T22:37:04+00:00

Last Scan

Scanned2024-08-30T22:37:04+00:00
URL https://goodsixty.co.uk/robots.txt
Domain IPs 108.128.72.146, 54.216.252.255, 54.73.26.109
Response IP 54.73.26.109
Found Yes
Hash 8f8495c1dd68817eefd1e49f498e2141e1680665a143e8842c50c95c51f23435
SimHash ba842d8df950

Groups

*

Rule Path
Disallow /checkout
Disallow /location
Disallow /retailers/*/products/*/line_items
Back to top

Other Records

Field Value
sitemap https://www.goodsixty.co.uk/sitemap.xml.gz
Back to top

Comments

  • See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines:
  • User-agent: *
  • Disallow: /
Back to top