searspartsdirect.com
robots.txt

Robots Exclusion Standard data for searspartsdirect.com

Resource Scan

Scan Details

Site Domain searspartsdirect.com
Base Domain searspartsdirect.com
Scan Status Ok
Last Scan2024-06-29T20:27:42+00:00
Next Scan 2024-07-06T20:27:42+00:00

Last Scan

Scanned2024-06-29T20:27:42+00:00
URL https://searspartsdirect.com/robots.txt
Redirect https://www.searspartsdirect.com/robots.txt
Redirect Domain www.searspartsdirect.com
Redirect Base searspartsdirect.com
Domain IPs 104.18.0.194, 104.18.1.194, 2606:4700::6812:1c2, 2606:4700::6812:c2
Redirect IPs 104.18.16.239, 104.18.17.239, 2606:4700::6812:10ef, 2606:4700::6812:11ef
Response IP 104.18.16.239
Found Yes
Hash 6e07b6430303717113055a5edcc0c7d2f3abf347c3e52f4c7a9a24f85bd755a1
SimHash 15015f18a577

Groups

indy library

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

*

Rule Path
Disallow /cart
Disallow /profile
Disallow /shipping
Disallow /payment
Disallow /orderreview
Disallow /ordersubmit
Disallow /order/
Disallow /subscription
Disallow /get-code
Disallow /login
Disallow /register
Disallow /forgot-password
Disallow /search
Disallow /error
Disallow /notfound
Disallow *aorigin
Disallow /*tel%3A

*

Rule Path
Disallow /ma/

*

Rule Path
Disallow /write-a-review

*

Rule Path
Disallow /partsdirect/*
Disallow /*.html

Other Records

Field Value
sitemap https://www.searspartsdirect.com/sitemap.xml

Comments

  • Indy Bot 7.31
  • Grapeshot updated 10-17
  • AhrefsBot updated 11-05-20
  • New Checkout Cart 12-10-19
  • Shopping cart page
  • Checkout shipping address and options page
  • Checkout billing address and payment information page
  • Checkout order review page
  • Checkout order confirmation page
  • Order Subscription Lookup 11-11-20
  • Merchandising Pages - 7-31-19
  • commented out 06/10/2020
  • Disallow: /collections/
  • for PA code generator page - 03-26-2020
  • New login/register/forgot pwd page 03-27-2020
  • search page 03-27-2020
  • error pages 03-27-2020
  • with aorigin param url 12-09-20
  • SPD-7988: 01-14-21
  • SPD-9884: 05-31-2023
  • Disallow legacy URLs: 12-12-2023