my.gov.au
robots.txt
Robots Exclusion Standard data for my.gov.au
Resource Scan
Scan Details
| Site Domain | my.gov.au |
| Base Domain | my.gov.au |
| Scan Status | Ok |
| Last Scan | 2024-05-19T19:29:24+00:00 |
| Next Scan | 2024-06-02T19:29:24+00:00 |
Last Scan
| Scanned | 2024-05-19T19:29:24+00:00 |
| URL | https://my.gov.au/robots.txt |
| Domain IPs | 108.157.254.109, 108.157.254.48, 108.157.254.54, 108.157.254.71, 2600:9000:2753:1600:a:ae1c:5880:93a1, 2600:9000:2753:4800:a:ae1c:5880:93a1, 2600:9000:2753:4a00:a:ae1c:5880:93a1, 2600:9000:2753:8c00:a:ae1c:5880:93a1, 2600:9000:2753:a400:a:ae1c:5880:93a1, 2600:9000:2753:b800:a:ae1c:5880:93a1, 2600:9000:2753:d000:a:ae1c:5880:93a1, 2600:9000:2753:f000:a:ae1c:5880:93a1 |
| Response IP | 108.157.254.71 |
| Found | Yes |
| Hash | d04f77192fdeab18812e71b19ce4d9f8d834c3a9f39473f6db4fe305369ad1f4 |
| SimHash | ec410a12cb90 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /logout |
| Disallow | /auth-callback |
| Disallow | /content/mygov/logout.html |
| Disallow | /content/mygov/auth-callback.html |
| Disallow | /en/error |
| Disallow | /en/external-redirects |
| Disallow | /content/mygov/en/error.html |
| Disallow | /content/mygov/en/external-redirects.html |
| Disallow | /en/error/* |
| Disallow | /en/external-redirects/* |
| Disallow | /content/mygov/en/error/* |
| Disallow | /content/mygov/en/external-redirects/* |
| Disallow | /en/signout |
| Disallow | /en/account-closed |
| Disallow | /en/logout-redirect |
| Disallow | /content/mygov/en/signout.html |
| Disallow | /content/mygov/en/account-closed.html |
| Disallow | /content/mygov/en/logout-redirect.html |
| Disallow | /en/about/thankyou |
| Disallow | /content/mygov/en/about/thankyou.html |