Log In Sign Up

tacklebox.co.uk
robots.txt

Robots Exclusion Standard data for tacklebox.co.uk

Resource Scan

Scan Details

Site Domain tacklebox.co.uk
Base Domain tacklebox.co.uk
Scan Status Ok
Last Scan2026-03-03T09:23:43+00:00
Next Scan 2026-04-02T09:23:43+00:00

Last Scan

Scanned2026-03-03T09:23:43+00:00
URL https://tacklebox.co.uk/robots.txt
Domain IPs 85.92.73.62
Response IP 85.92.73.62
Found Yes
Hash 2c0c09f93e72a2f28482a08aa45ddd15a536bd9ae58f43d2f960481f2bcc4c97
SimHash 6513490ccfa1

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /wp-login.php
Disallow /cart/
Disallow /checkout/
Disallow /my-account/
Disallow /order-received/
Allow /wp-admin/admin-ajax.php
Allow /wp-content/uploads/
Allow /wp-includes/js/
Allow /wp-includes/css/
Disallow /*?add-to-cart=
Allow /product/
Allow /shop/
Allow /category/
Allow /tag/

Other Records

Field Value
crawl-delay 30
Back to top

Other Records

Field Value
sitemap https://tacklebox.co.uk/sitemap_index.xml
Back to top

Comments

  • User-agent settings for search engine crawlers
  • Disallow sensitive areas of the website to ensure security
  • Allow search engines to crawl essential resources
  • Disallow unnecessary dynamic URLs generated by WooCommerce
  • Allow indexing of product pages, category pages, and other important content
  • Sitemap
Back to top