bensonsforbeds.co.uk
robots.txt
Robots Exclusion Standard data for bensonsforbeds.co.uk
Resource Scan
Scan Details
| Site Domain | bensonsforbeds.co.uk |
| Base Domain | bensonsforbeds.co.uk |
| Scan Status | Failed |
| Failure Reason | Scan timed out. |
| Last Scan | 2025-11-08T11:15:50+00:00 |
| Next Scan | 2026-02-06T11:15:50+00:00 |
Last Successful Scan
| Scanned | 2025-06-17T16:29:02+00:00 |
| URL | https://bensonsforbeds.co.uk/robots.txt |
| Redirect | https://www.bensonsforbeds.co.uk/robots.txt |
| Redirect Domain | www.bensonsforbeds.co.uk |
| Redirect Base | bensonsforbeds.co.uk |
| Domain IPs | 76.76.21.21 |
| Redirect IPs | 76.76.21.164, 76.76.21.22 |
| Response IP | 76.76.21.98 |
| Found | Yes |
| Hash | 89af9e9c69c7bc0fdcabf5eeeee15130733fb9fc1b7b7538f382e42aef60d791 |
| SimHash | 2b80981ac905 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | *GLOBAL_ShopPathSSL* |
| Disallow | test$ |
| Disallow | *test* |
| Disallow | /account.php |
| Disallow | /cart.php |
| Disallow | /checkout.php |
| Disallow | /checkout |
| Disallow | /finishorder.php |
| Disallow | /login.php |
| Disallow | /orderstatus.php |
| Disallow | /postreview.php |
| Disallow | /productimage.php |
| Disallow | /productupdates.php |
| Disallow | /remote.php |
| Disallow | /search.php |
| Disallow | /viewfile.php |
| Disallow | /wishlist.php |
| Disallow | /admin/ |
| Disallow | /__socialshop/ |
| Disallow | /payment-success/ |
| Disallow | /payment-declined/ |
| Disallow | /checkout/complete/finance-accepted/ |
| Disallow | /checkout/complete/finance-declined/ |
| Disallow | /checkout/complete/finance-referred/ |
*
| Rule | Path |
|---|---|
| Disallow | /*?_bc_fsnf=1* |
| Disallow | /*%26_bc_fsnf%3D1* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.bensonsforbeds.co.uk/sitemap.xml |