halegroves.com
robots.txt

Robots Exclusion Standard data for halegroves.com

Resource Scan

Scan Details

Site Domain halegroves.com
Base Domain halegroves.com
Scan Status Ok
Last Scan2024-08-28T08:52:45+00:00
Next Scan 2024-09-27T08:52:45+00:00

Last Scan

Scanned2024-08-28T08:52:45+00:00
URL https://halegroves.com/robots.txt
Redirect https://www.halegroves.com/robots.txt
Redirect Domain www.halegroves.com
Redirect Base halegroves.com
Domain IPs 3.167.56.54, 3.167.56.6, 3.167.56.61, 3.167.56.65
Redirect IPs 54.230.112.111, 54.230.112.16, 54.230.112.2, 54.230.112.47
Response IP 65.9.112.101
Found Yes
Hash ee7c7bb43aa7f8d68b7a519d0cef95665405bbc59127677b48bfda477c243c6f
SimHash 24055f4d4761

Groups

*

Rule Path
Disallow /images/art/favicon.ico
Disallow /controls/
Disallow /logs/
Disallow /bin/
Disallow /cart.aspx
Disallow /checkout.aspx
Disallow /summary.aspx
Disallow /submitreview.aspx
Disallow /productreviewdisplay.aspx
Disallow /forgotpassword.aspx
Disallow /articlepopup.aspx
Disallow /forgotpasswordreset.aspx
Disallow /tellafriendpopup.aspx
Disallow /unsubscribe.aspx
Disallow /signindialog.aspx
Disallow /editaccount.aspx
Disallow /orderhistory.aspx
Disallow /orderresolution.aspx
Disallow /category.aspx
Disallow /search/go
Disallow /gifts/*?
Disallow /search.aspx
Disallow /giftproduct.aspx

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

Other Records

Field Value
sitemap https://www.halegroves.com/sitemap.xml
sitemap https://www.halegroves.com/gifts/sitemapSC1.xml.gz

Comments

  • ROBOTS.TXT: 10/27/2014
  • keep all bots out of the listed files and folders

Warnings

  • `noindex` is not a known field.