spurwesternwear.com
robots.txt
Robots Exclusion Standard data for spurwesternwear.com
Resource Scan
Scan Details
Site Domain | spurwesternwear.com |
Base Domain | spurwesternwear.com |
Scan Status | Ok |
Last Scan | 2024-09-15T14:17:41+00:00 |
Next Scan | 2024-10-15T14:17:41+00:00 |
Last Scan
Scanned | 2024-09-15T14:17:41+00:00 |
URL | https://spurwesternwear.com/robots.txt |
Redirect | https://www.spurwesternwear.com/robots.txt |
Redirect Domain | www.spurwesternwear.com |
Redirect Base | spurwesternwear.com |
Domain IPs | 104.26.2.249, 104.26.3.249, 172.67.73.51, 2606:4700:20::681a:2f9, 2606:4700:20::681a:3f9, 2606:4700:20::ac43:4933 |
Redirect IPs | 104.26.2.249, 104.26.3.249, 172.67.73.51, 2606:4700:20::681a:2f9, 2606:4700:20::681a:3f9, 2606:4700:20::ac43:4933 |
Response IP | 104.26.2.249 |
Found | Yes |
Hash | f2e244226e593c068fefcb677ab8d71a61736ba8920bd902791738455e01c224 |
SimHash | 9c15b5629d5b |
Groups
*
Rule | Path |
---|---|
Disallow | /account/ |
Disallow | /captcha/ |
Disallow | /checkout/ |
Disallow | /checkoutaccount/ |
Disallow | /checkoutaddress/ |
Disallow | /checkoutamazonpayments/ |
Disallow | /checkoutcart/ |
Disallow | /checkoutconfirmation/ |
Disallow | /checkoutcreditcard/ |
Disallow | /checkoutdebugrealtimeshipping/ |
Disallow | /checkoutgiftcardentry/ |
Disallow | /checkoutgiftcardsetup/ |
Disallow | /checkoutmicropay/ |
Disallow | /checkoutordernotes/ |
Disallow | /checkoutorderoption/ |
Disallow | /checkoutordersummary/ |
Disallow | /checkoutpaymentmethod/ |
Disallow | /checkoutpromotions/ |
Disallow | /checkoutpurchaseorder/ |
Disallow | /checkoutshippingestimate/ |
Disallow | /checkoutshippingmethod/ |
Disallow | /customer/ |
Disallow | /descriptions/ |
Disallow | /download/ |
Disallow | /error/ |
Disallow | /image/popup/ |
Disallow | /minicart/ |
Disallow | /notice/ |
Disallow | /orderdownloads/ |
Disallow | /paypalnotifications/ |
Disallow | /paypalpaymentsadvanced/ |
Disallow | /preview/ |
Disallow | /product/emailproduct |
Disallow | /rating/ |
Disallow | /recurringorder/ |
Disallow | /rss/ |
Disallow | /sessiontimeout/ |
Disallow | /shoppingcart/ |
Disallow | /sitedisclaimer/ |
Disallow | /wallet/ |
Disallow | /xmlpackages/ |
Disallow | /addtocart.aspx |
Disallow | /authnetpost.aspx |
Disallow | /createaccount.aspx |
Disallow | /editaddressrecurring.aspx |
Disallow | /emailproduct.aspx |
Disallow | /invalidrequest.aspx |
Disallow | /pagenotfound.aspx |
Disallow | /paypalembeddedcheckoutok.aspx |
Disallow | /paypalnotification.aspx |
Disallow | /ratecomment.aspx |
Disallow | /rateit.aspx |
Disallow | /rssfeed.aspx |
Disallow | /setcurrency.aspx |
Disallow | /setlocale.aspx |
Disallow | /setvatsetting.aspx |
Disallow | /signin.aspx |
Disallow | /signout.aspx |
Disallow | /tableorder_process.aspx |
Disallow | /twocheckout_return.aspx |
Disallow | /empty.htm |
Disallow | /refused.htm |