hursthardwoods.com
robots.txt

Robots Exclusion Standard data for hursthardwoods.com

Resource Scan

Scan Details

Site Domain hursthardwoods.com
Base Domain hursthardwoods.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-11-10T08:50:23+00:00
Next Scan 2024-11-17T08:50:23+00:00

Last Successful Scan

Scanned2024-10-10T08:50:04+00:00
URL https://hursthardwoods.com/robots.txt
Redirect https://www.hursthardwoods.com/robots.txt
Redirect Domain www.hursthardwoods.com
Redirect Base hursthardwoods.com
Domain IPs 162.159.136.54, 162.159.137.54
Redirect IPs 162.159.136.54, 162.159.137.54
Response IP 162.159.136.54
Found Yes
Hash fd9c00afa6a7058dd98e236387f9e95e11e925467a3d22ba81e11aa74a2a2fb2
SimHash 8d01dd12cc31

Groups

*

Rule Path
Disallow
Disallow /no-route
Disallow /backup-main-page-hurst-hardwoods
Disallow /test
Disallow /no-route-2
Disallow /test-speed
Disallow /cgi-bin/
Disallow /enable-cookies
Disallow /about-porto
Disallow /catalogsearch/advanced/
Disallow /sendfriend/product/send/
Disallow /sendfriend/product/send/id/
Disallow /sendfriend/product/send/*
Disallow /*?
Disallow /catalogsearch/advanced/
Disallow /sendfriend/product/send/
Disallow /sendfriend/product/send/id/
Disallow /sendfriend/product/send
Disallow /checkout/
Disallow /newsletter
Disallow /catalogsearch/
Disallow /catalog/seo_sitemap/
Disallow /repo/
Disallow /index.php
Disallow /cron.php
Disallow /cron.sh
Disallow /error_log
Disallow /install.php
Disallow /LICENSE.html
Disallow /LICENSE.txt
Disallow /LICENSE_AFL.txt
Disallow /STATUS.txt
Disallow /get.php
Disallow /app/
Disallow /lib/
Disallow /*.php$
Disallow /pkginfo/
Disallow /report/
Disallow /var/
Disallow /customer/account/create/
Disallow /customer/account/login/
Disallow /customer/account/forgotpassword/

Other Records

Field Value
sitemap https://www.hursthardwoods.com/google_sitemap_2.xml