jharlen.com
robots.txt
Robots Exclusion Standard data for jharlen.com
Resource Scan
Scan Details
| Site Domain | jharlen.com |
| Base Domain | jharlen.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2026-02-07T05:15:23+00:00 |
| Next Scan | 2026-03-09T05:15:23+00:00 |
Last Successful Scan
| Scanned | 2025-12-17T00:31:59+00:00 |
| URL | https://jharlen.com/robots.txt |
| Redirect | https://www.jharlen.com/robots.txt |
| Redirect Domain | www.jharlen.com |
| Redirect Base | jharlen.com |
| Domain IPs | 104.21.75.155, 172.67.178.109, 2606:4700:3030::6815:4b9b, 2606:4700:3036::ac43:b26d |
| Redirect IPs | 104.21.75.155, 172.67.178.109, 2606:4700:3030::6815:4b9b, 2606:4700:3036::ac43:b26d |
| Response IP | 172.67.178.109 |
| Found | Yes |
| Hash | 5621b3dbf2e062edcd6c62c0f6dbeda1c95319b23ada2f64b33509cf5b665849 |
| SimHash | 9c15a1669d7b |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /account/ |
| Disallow | /captcha/ |
| Disallow | /checkout/ |
| Disallow | /checkoutaccount/ |
| Disallow | /checkoutaddress/ |
| Disallow | /checkoutamazonpayments/ |
| Disallow | /checkoutcart/ |
| Disallow | /checkoutconfirmation/ |
| Disallow | /checkoutcreditcard/ |
| Disallow | /checkoutdebugrealtimeshipping/ |
| Disallow | /checkoutgiftcardentry/ |
| Disallow | /checkoutgiftcardsetup/ |
| Disallow | /checkoutmicropay/ |
| Disallow | /checkoutordernotes/ |
| Disallow | /checkoutorderoption/ |
| Disallow | /checkoutordersummary/ |
| Disallow | /checkoutpaymentmethod/ |
| Disallow | /checkoutpromotions/ |
| Disallow | /checkoutpurchaseorder/ |
| Disallow | /checkoutshippingestimate/ |
| Disallow | /checkoutshippingmethod/ |
| Disallow | /customer/ |
| Disallow | /descriptions/ |
| Disallow | /download/ |
| Disallow | /error/ |
| Disallow | /image/popup/ |
| Disallow | /minicart/ |
| Disallow | /notice/ |
| Disallow | /orderdownloads/ |
| Disallow | /paypalnotifications/ |
| Disallow | /paypalpaymentsadvanced/ |
| Disallow | /preview/ |
| Disallow | /product/emailproduct |
| Disallow | /rating/ |
| Disallow | /recurringorder/ |
| Disallow | /rss/ |
| Disallow | /sessiontimeout/ |
| Disallow | /shoppingcart/ |
| Disallow | /sitedisclaimer/ |
| Disallow | /wallet/ |
| Disallow | /xmlpackages/ |
| Disallow | /addtocart.aspx |
| Disallow | /authnetpost.aspx |
| Disallow | /createaccount.aspx |
| Disallow | /editaddressrecurring.aspx |
| Disallow | /emailproduct.aspx |
| Disallow | /invalidrequest.aspx |
| Disallow | /pagenotfound.aspx |
| Disallow | /paypalembeddedcheckoutok.aspx |
| Disallow | /paypalnotification.aspx |
| Disallow | /ratecomment.aspx |
| Disallow | /rateit.aspx |
| Disallow | /rssfeed.aspx |
| Disallow | /setcurrency.aspx |
| Disallow | /setlocale.aspx |
| Disallow | /setvatsetting.aspx |
| Disallow | /signin.aspx |
| Disallow | /signout.aspx |
| Disallow | /tableorder_process.aspx |
| Disallow | /twocheckout_return.aspx |
| Disallow | /empty.htm |
| Disallow | /refused.htm |