homemakers.com
robots.txt

Robots Exclusion Standard data for homemakers.com

Resource Scan

Scan Details

Site Domain homemakers.com
Base Domain homemakers.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-11-01T19:29:10+00:00
Next Scan 2025-01-30T19:29:10+00:00

Last Successful Scan

Scanned2023-09-14T18:11:41+00:00
URL https://homemakers.com/robots.txt
Redirect https://www.homemakers.com/robots.txt
Redirect Domain www.homemakers.com
Redirect Base homemakers.com
Domain IPs 104.17.249.30, 104.17.250.30
Redirect IPs 104.17.249.30, 104.17.250.30
Response IP 104.17.250.30
Found Yes
Hash 8ae2a3c5a387ae33ab2242f9067a8fd825ea3a8f62c7039bba99dfc9af200252
SimHash a3e8094287af

Groups

*

Rule Path
Disallow /AjaxGeoIpService
Disallow /webapp/wcs/stores/servlet/CategoryNavigationResultsView
Disallow /DiscountDetailsDisplayView
Disallow /account*
Disallow /profile*
Disallow /order*
Disallow /addressbook*
Disallow /cart*
Disallow /login*
Disallow /checkout*
Disallow /shipping*
Disallow /billing*
Disallow /orderconfirmation*
Disallow /on/demandware.store/*
Disallow /*Search-ShowAjax*
Disallow /*Product-Customize*
Disallow /*pmin%3D*
Disallow /*pmax%3D*
Disallow /*prefn4*
Disallow /*prefn5*
Disallow /*prefn6*
Disallow /*prefn7*
Disallow /*prefn8*
Disallow /*srule%3D*

deepcrawl

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.homemakers.com/sitemap_index.xml

Comments

  • get rid of unwanted GeoIP lookups
  • Pages
  • Refinements
  • Order By

Warnings

  • `current example` is not a known field.