hesta.com.au
robots.txt
Robots Exclusion Standard data for hesta.com.au
Resource Scan
Scan Details
| Site Domain | hesta.com.au |
| Base Domain | hesta.com.au |
| Scan Status | Ok |
| Last Scan | 2024-10-21T00:46:20+00:00 |
| Next Scan | 2024-11-20T00:46:20+00:00 |
Last Scan
| Scanned | 2024-10-21T00:46:20+00:00 |
| URL | https://hesta.com.au/robots.txt |
| Redirect | https://www.hesta.com.au/robots.txt |
| Redirect Domain | www.hesta.com.au |
| Redirect Base | hesta.com.au |
| Domain IPs | 13.54.19.140, 54.206.249.200 |
| Redirect IPs | 13.54.19.140, 54.206.249.200 |
| Response IP | 54.206.249.200 |
| Found | Yes |
| Hash | 31cbee0bdbd68c359b43ee0b8b73bff6d84bc1ed19bf48862310c3fde0bf5d3e |
| SimHash | 71010944abc3 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /focus/* |
| Disallow | /search?q=* |
| Disallow | /boost-term-results |
| Disallow | /content/dam/position-descriptions |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.hesta.com.au/sitemap.xml |