stevestonmarine.com
robots.txt
Robots Exclusion Standard data for stevestonmarine.com
Resource Scan
Scan Details
Site Domain | stevestonmarine.com |
Base Domain | stevestonmarine.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-03-12T01:54:48+00:00 |
Next Scan | 2024-06-10T01:54:48+00:00 |
Last Successful Scan
Scanned | 2023-10-21T20:35:38+00:00 |
URL | https://stevestonmarine.com/robots.txt |
Redirect | https://www.stevestonmarine.com/robots.txt |
Redirect Domain | www.stevestonmarine.com |
Redirect Base | stevestonmarine.com |
Domain IPs | 209.124.85.24 |
Redirect IPs | 172.66.40.147, 172.66.43.109 |
Response IP | 172.66.43.109 |
Found | Yes |
Hash | ed0769e48f2dac8260a3373214d40c5e9a816109299810aac6d0c2a122059350 |
SimHash | 7a5b6d69c6f4 |
Groups
*
Rule | Path |
---|---|
Disallow | /*%26limit |
Disallow | /*?limit |
Disallow | /*?sort |
Disallow | /*%26sort |
Disallow | /*?order |
Disallow | /*%26order |
Disallow | /*?price |
Disallow | /*%26price |
Disallow | /*?brand_tabletpc |
Disallow | /*%26brand_tabletpc |
Disallow | /*?color_default |
Disallow | /*%26color_default |
Disallow | /*?filter_tag |
Disallow | /*%26filter_tag |
Disallow | /*?mode |
Disallow | /*%26mode |
Disallow | /*?cat |
Disallow | /*%26cat |
Disallow | /*?dir |
Disallow | /*%26dir |
Disallow | /*?color |
Disallow | /*%26color |
Disallow | /*?minprice |
Disallow | /*%26minprice |
Disallow | /*?maxprice |
Disallow | /*%26maxprice |
Disallow | /*?route=checkout%2F |
Disallow | /*?route=account%2F |
Disallow | /*?route=product%2Fsearch |
Disallow | /*?page=1 |
Disallow | /*%26create%3D1 |
Disallow | /?route=information%2Fcontact |
Disallow | /*?route=affiliate%2F |
Disallow | /*?keyword |
Disallow | /*?av |
Disallow | /admin/ |
Disallow | /system/ |
Disallow | /control/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.stevestonmarine.com/index.php?route=extension/feed/uksb_sitemaps&store=0/ |