ga.gov.au
robots.txt
Robots Exclusion Standard data for ga.gov.au
Resource Scan
Scan Details
Site Domain | ga.gov.au |
Base Domain | ga.gov.au |
Scan Status | Ok |
Last Scan | 2024-05-31T17:32:43+00:00 |
Next Scan | 2024-06-30T17:32:43+00:00 |
Last Scan
Scanned | 2024-05-31T17:32:43+00:00 |
URL | https://ga.gov.au/robots.txt |
Redirect | https://www.ga.gov.au/robots.txt |
Redirect Domain | www.ga.gov.au |
Redirect Base | ga.gov.au |
Domain IPs | 192.104.43.72 |
Redirect IPs | 18.155.68.116, 18.155.68.36, 18.155.68.50, 18.155.68.85 |
Response IP | 18.155.68.36 |
Found | Yes |
Hash | 410e940639d966cdf077e9d423f2c2266dad1f01bf1b1ccdb71fc6567c6d22cb |
SimHash | 3571e913cf51 |
Groups
*
Rule | Path | Comment |
---|---|---|
Disallow | /designs/ | This is GA design space |
Disallow | /_designs/ | This is GA design space |
Disallow | /_uncover-design/ | This is Uncover Minerals design space |
Disallow | /value-to-the-nation/ | This is the Value to the Nation design space |
Disallow | /education/classroom-resources/education-resources/ | This is the Education design space |
Disallow | /webtemp/ | This is the temporary directory used by various apps |
Comments