springfasteners.co.uk
robots.txt

Robots Exclusion Standard data for springfasteners.co.uk

Resource Scan

Scan Details

Site Domain springfasteners.co.uk
Base Domain springfasteners.co.uk
Scan Status Ok
Last Scan2026-01-30T20:12:05+00:00
Next Scan 2026-03-01T20:12:05+00:00

Last Scan

Scanned2026-01-30T20:12:05+00:00
URL https://springfasteners.co.uk/robots.txt
Domain IPs 5.9.207.61
Response IP 5.9.207.61
Found Yes
Hash 6d1cde61323370880831a68b805187097b7567e6ae04c9cccb25806be1ba967b
SimHash 631cd876a3b1

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

amazonbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

*

Rule Path
Disallow /catalog/product_compare/

dotbot

Rule Path
Disallow /product/
Disallow /product-category/

seekportbot

Rule Path
Disallow /product/

mj12bot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

*

Rule Path
Disallow /*?add-to-cart=