hunterdouglas.ca
robots.txt

Robots Exclusion Standard data for hunterdouglas.ca

Resource Scan

Scan Details

Site Domain hunterdouglas.ca
Base Domain hunterdouglas.ca
Scan Status Ok
Last Scan2024-09-02T22:00:50+00:00
Next Scan 2024-10-02T22:00:50+00:00

Last Scan

Scanned2024-09-02T22:00:50+00:00
URL https://hunterdouglas.ca/robots.txt
Redirect https://www.hunterdouglas.ca/robots.txt
Redirect Domain www.hunterdouglas.ca
Redirect Base hunterdouglas.ca
Domain IPs 34.227.135.179
Redirect IPs 2600:9000:23d1:1400:1c:dadf:b100:93a1, 2600:9000:23d1:2600:1c:dadf:b100:93a1, 2600:9000:23d1:600:1c:dadf:b100:93a1, 2600:9000:23d1:7200:1c:dadf:b100:93a1, 2600:9000:23d1:7400:1c:dadf:b100:93a1, 2600:9000:23d1:7c00:1c:dadf:b100:93a1, 2600:9000:23d1:bc00:1c:dadf:b100:93a1, 2600:9000:23d1:d200:1c:dadf:b100:93a1, 65.9.112.2, 65.9.112.4, 65.9.112.87, 65.9.112.90
Response IP 65.9.112.2
Found Yes
Hash 4d624c357f3dd8ed07a4002a0263955b72cfd18d24b95da12c7edcf214e7d8db
SimHash e51d3772c783

Groups

*

Rule Path
Disallow /etc.clientlibs
Disallow /slideout-pages
Disallow /slideout
Disallow /errors
Disallow /search-results
Disallow /campaign
Disallow /request-a-consultation/
Disallow /text-messaging-terms-conditions
Disallow /fflocator
Disallow /locator/results
Disallow /aerc-qr
Disallow /backup
Disallow /demo
Disallow /syndicated/
Disallow /php/
Disallow /aowd/
Disallow /aowd1/
Disallow /aowd2/
Disallow /campaign2/
Disallow /campaign3/
Disallow /powerview-app-troubleshooting
Disallow /content
Disallow /redir
Disallow /*.jsp$
Disallow /locator/2*
Disallow /locator/3*
Disallow /local-specialists/*

Other Records

Field Value
sitemap https://www.hunterdouglas.ca/sitemap.xml

Comments

  • HD
  • Allow any search crawler to crawl our site
  • AEM Disallow paths
  • HD legacy Disallow paths
  • Crawl sitemap