hbr.org
robots.txt

Robots Exclusion Standard data for hbr.org

Resource Scan

Scan Details

Site Domain hbr.org
Base Domain hbr.org
Scan Status Ok
Last Scan2024-04-29T11:29:17+00:00
Next Scan 2024-05-06T11:29:17+00:00

Last Scan

Scanned2024-04-29T11:29:17+00:00
URL https://hbr.org/robots.txt
Domain IPs 108.156.133.3, 108.156.133.39, 108.156.133.62, 108.156.133.66
Response IP 108.156.133.62
Found Yes
Hash 9088ea17a8c788d2ffe18a95b139e6b76b147f37193253649132058df38c346e
SimHash 04315b374477

Groups

*

Rule Path
Disallow /resources/
Allow /resources/js
Allow /resources/css
Allow /resources/images/
Allow /resources/xml/sitemaps/
Disallow /fastanswers
Disallow /my-library*
Disallow /email-colleague/
Disallow /add-to-cart/
Disallow /login*
Disallow /shopping-cart/
Disallow /shipping-payment
Disallow /review-order
Disallow /order/thank-you/
Disallow /content/ipad/
Disallow /newsletters*
Disallow /product/recommended*
Disallow /webinar-assessment
Disallow /search*
Disallow /academic-subscriptions
Disallow /alumni-subscriptions
Disallow /*?*language=es
Disallow /*?*language=pt
Allow /resources/html/infographics/2018/ceo-activism-desktop/index.html
Disallow /resources/html/error/404.html
Disallow /sponsored/2022/10/disruptors-who-are-changing-their-industries
Disallow /api/recaptcha/enabled
Disallow /register?*
Disallow /resources/css/webscripts.css

feedburner/1.0

Rule Path
Allow /resources/xml/

gptbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

Warnings

  • 2 invalid lines.