hoxton.ai
robots.txt
Robots Exclusion Standard data for hoxton.ai
Resource Scan
Scan Details
Site Domain | hoxton.ai |
Base Domain | hoxton.ai |
Scan Status | Ok |
Last Scan | 2024-10-20T03:14:10+00:00 |
Next Scan | 2024-11-19T03:14:10+00:00 |
Last Scan
Scanned | 2024-10-20T03:14:10+00:00 |
URL | https://hoxton.ai/robots.txt |
Redirect | https://www.hoxton.ai/robots.txt |
Redirect Domain | www.hoxton.ai |
Redirect Base | hoxton.ai |
Domain IPs | 199.60.103.192, 199.60.103.92 |
Redirect IPs | 199.60.103.228, 199.60.103.28, 2606:2c40::c73c:671c, 2606:2c40::c73c:67e4 |
Response IP | 199.60.103.228 |
Found | Yes |
Hash | a8b00530df0da89dee8fa63ad21b4db329717ca7b16568aa705f18f812e4a416 |
SimHash | 7475c638c5b1 |
Groups
*
Rule | Path |
---|---|
Disallow | /sample-* |
Disallow | /blog/sample-* |
Disallow | /_hcms/preview/ |
Disallow | /hs/manage-preferences/ |
Disallow | /hs/preferences-center/ |
Disallow | /*?*hs_preview=* |
Disallow | /*?*hsCacheBuster=* |