henleysa.ac.za
robots.txt

Robots Exclusion Standard data for henleysa.ac.za

Resource Scan

Scan Details

Site Domain henleysa.ac.za
Base Domain henleysa.ac.za
Scan Status Ok
Last Scan2024-09-22T19:46:58+00:00
Next Scan 2024-10-22T19:46:58+00:00

Last Scan

Scanned2024-09-22T19:46:58+00:00
URL https://henleysa.ac.za/robots.txt
Redirect https://www.henleysa.ac.za/robots.txt
Redirect Domain www.henleysa.ac.za
Redirect Base henleysa.ac.za
Domain IPs 199.60.103.130, 199.60.103.30
Redirect IPs 141.101.90.96, 141.101.90.97, 141.101.90.98, 141.101.90.99, 2a06:98c1:3200::90:0, 2a06:98c1:3200::90:1, 2a06:98c1:3200::90:2, 2a06:98c1:3200::90:3
Response IP 141.101.90.97
Found Yes
Hash 25967cb868a88a3f6d7658c358cc9f989bd06438161bc005057bbd38a25b4f18
SimHash 2848c7e0c7b3

Groups

*

Rule Path
Disallow /_hcms/preview/
Disallow /hs/manage-preferences/
Disallow /hs/preferences-center/
Disallow /*?*hs_preview=*
Disallow /*?*hsCacheBuster=*

hubspotcontentsearchbot

Rule Path
Allow /
Disallow /_hcms/preview/
Disallow /hs/manage-preferences/
Disallow /hs/preferences-center/
Disallow /*?*hs_preview=*
Disallow /*?*hsCacheBuster=*