homefurniture.ca
robots.txt

Robots Exclusion Standard data for homefurniture.ca

Resource Scan

Scan Details

Site Domain homefurniture.ca
Base Domain homefurniture.ca
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-05-31T11:39:00+00:00
Next Scan 2024-08-29T11:39:00+00:00

Last Successful Scan

Scanned2024-01-10T10:24:22+00:00
URL https://homefurniture.ca/robots.txt
Redirect https://www.homefurniture.ca/robots.txt
Redirect Domain www.homefurniture.ca
Redirect Base homefurniture.ca
Domain IPs 52.24.145.159, 52.40.25.65
Redirect IPs 2600:1413:b000:6::17d5:2bc6, 2600:1413:b000:6::17d5:2bd4, 96.17.96.24, 96.17.96.27
Response IP 23.44.4.160
Found Yes
Hash 20dd00f83eb2fcacdfac99ea16a2a8fe301c6cb6c917f1711030012b61f2fc9b
SimHash ad1910f6a392

Groups

*

Rule Path
Disallow /admin/
Disallow /user/
Disallow /myaccount/
Disallow /cart/
Disallow /checkout/

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://www.homefurniture.ca/sitemap.xml

Comments

  • robots.txt - Home Furniture https://www.homefurniture.ca
  • Sitemaps