sportsbikeshop.co.uk
robots.txt
Robots Exclusion Standard data for sportsbikeshop.co.uk
Resource Scan
Scan Details
| Site Domain | sportsbikeshop.co.uk |
| Base Domain | sportsbikeshop.co.uk |
| Scan Status | Failed |
| Failure Reason | Scan timed out. |
| Last Scan | 2024-09-19T13:20:28+00:00 |
| Next Scan | 2024-12-18T13:20:28+00:00 |
Last Successful Scan
| Scanned | 2024-01-30T23:22:50+00:00 |
| URL | https://sportsbikeshop.co.uk/robots.txt |
| Redirect | https://www.sportsbikeshop.co.uk/robots.txt |
| Redirect Domain | www.sportsbikeshop.co.uk |
| Redirect Base | sportsbikeshop.co.uk |
| Domain IPs | 23.52.171.241, 23.59.168.178 |
| Redirect IPs | 23.52.171.241, 23.59.168.178 |
| Response IP | 23.59.168.178 |
| Found | Yes |
| Hash | 9795ced75e99ab37f0858115ab1c39c313eb2d11685a01bf6661e7687e4e75df |
| SimHash | cb167405ce8c |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /basket/ |
| Disallow | /checkout/ |
| Disallow | /motorcycle_parts/search/ |
| Disallow | /motorcycle_parts/content_search |
| Disallow | /motorcycle_parts/content_cart/ |
| Disallow | /motorcycle_parts/wishlist/ |
| Disallow | /motorcycle_parts/print/ |
| Disallow | /motorcycle_parts/tellafriend/ |
| Disallow | /motorcycle_parts/bike_specific/ |
| Disallow | /modal_finance.php? |
| Disallow | /modal_ask_question.php? |
| Disallow | /mcn/ |
| Disallow | /bikesocial/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.sportsbikeshop.co.uk/sitemap.xml |
| sitemap | https://www.sportsbikeshop.co.uk/articles/sitemap.xml |