agso.gov.au
robots.txt
Robots Exclusion Standard data for agso.gov.au
Resource Scan
Scan Details
| Site Domain | agso.gov.au |
| Base Domain | agso.gov.au |
| Scan Status | Ok |
| Last Scan | 2024-06-12T12:47:23+00:00 |
| Next Scan | 2024-07-12T12:47:23+00:00 |
Last Scan
| Scanned | 2024-06-12T12:47:23+00:00 |
| URL | https://www.agso.gov.au/robots.txt |
| Redirect | https://www.ga.gov.au/robots.txt |
| Redirect Domain | www.ga.gov.au |
| Redirect Base | ga.gov.au |
| Domain IPs | 192.104.43.72 |
| Redirect IPs | 18.155.68.116, 18.155.68.36, 18.155.68.50, 18.155.68.85 |
| Response IP | 18.155.68.85 |
| Found | Yes |
| Hash | 410e940639d966cdf077e9d423f2c2266dad1f01bf1b1ccdb71fc6567c6d22cb |
| SimHash | 3571e913cf51 |
Groups
*
| Rule | Path | Comment |
|---|---|---|
| Disallow | /designs/ | This is GA design space |
| Disallow | /_designs/ | This is GA design space |
| Disallow | /_uncover-design/ | This is Uncover Minerals design space |
| Disallow | /value-to-the-nation/ | This is the Value to the Nation design space |
| Disallow | /education/classroom-resources/education-resources/ | This is the Education design space |
| Disallow | /webtemp/ | This is the temporary directory used by various apps |
Comments