Log In Sign Up

hunterdouglas.com
robots.txt

Robots Exclusion Standard data for hunterdouglas.com

Resource Scan

Scan Details

Site Domain hunterdouglas.com
Base Domain hunterdouglas.com
Scan Status Ok
Last Scan2024-05-27T18:36:36+00:00
Next Scan 2024-06-26T18:36:36+00:00

Last Scan

Scanned2024-05-27T18:36:36+00:00
URL https://hunterdouglas.com/robots.txt
Redirect https://www.hunterdouglas.com/robots.txt
Redirect Domain www.hunterdouglas.com
Redirect Base hunterdouglas.com
Domain IPs 34.227.135.179
Redirect IPs 13.35.18.24, 13.35.18.26, 13.35.18.65, 13.35.18.88, 2600:9000:20c7:6400:15:61ea:8980:93a1, 2600:9000:20c7:6600:15:61ea:8980:93a1, 2600:9000:20c7:8600:15:61ea:8980:93a1, 2600:9000:20c7:a00:15:61ea:8980:93a1, 2600:9000:20c7:c000:15:61ea:8980:93a1, 2600:9000:20c7:d600:15:61ea:8980:93a1, 2600:9000:20c7:f800:15:61ea:8980:93a1, 2600:9000:20c7:fa00:15:61ea:8980:93a1
Response IP 13.35.18.24
Found Yes
Hash 759143fa322c7053334080d775766445e6069a63b942c9533871de9c9e84e231
SimHash e4a13f3267a3

Groups

*

Rule Path
Disallow /etc.clientlibs
Disallow /slideout-pages
Disallow /slideout
Disallow /errors
Disallow /search-results
Disallow /request-a-consultation/
Disallow /text-messaging-terms-conditions
Disallow /fflocator
Disallow /locator/results
Disallow /aerc-qr
Disallow /campaign
Disallow /dealer-landing
Disallow /syndicated/
Disallow /php/
Disallow /aowd/
Disallow /aowd1/
Disallow /aowd2/
Disallow /campaign2/
Disallow /campaign3/
Disallow /powerview-app-troubleshooting
Disallow /content
Disallow /redir
Disallow .jsp
Disallow /locator/2*
Disallow /locator/3*
Disallow /local-specialists/*
Allow /etc.clientlibs/hd-site/clientlibs/clientlib-site/resources/_global/images/favicon.png
Back to top

Other Records

Field Value
sitemap https://www.hunterdouglas.com/sitemap.xml
Back to top

Comments

  • HD
  • Allow any search crawler to crawl our site
  • AEM Disallow paths
  • HD legacy Disallow paths
  • AEM Allow paths
  • Crawl sitemap
Back to top