homeaffairs.gov.au
robots.txt

Robots Exclusion Standard data for homeaffairs.gov.au

Resource Scan

Scan Details

Site Domain homeaffairs.gov.au
Base Domain homeaffairs.gov.au
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-06-09T02:45:34+00:00
Next Scan 2024-09-07T02:45:34+00:00

Last Successful Scan

Scanned2023-10-20T14:13:06+00:00
URL https://homeaffairs.gov.au/robots.txt
Redirect https://www.homeaffairs.gov.au/robots.txt
Redirect Domain www.homeaffairs.gov.au
Redirect Base homeaffairs.gov.au
Domain IPs 2600:1413:b000:6::17d5:2bd5, 2600:1413:b000:6::17d5:2bdb, 96.17.96.22, 96.17.96.25
Redirect IPs 2600:1413:b000:6::17d5:2bd5, 2600:1413:b000:6::17d5:2bdb, 96.17.96.22, 96.17.96.25
Response IP 23.223.18.130
Found Yes
Hash 7296c45f2bb27d1cf83de04a0544715d5637a71dfb235560d8c7e3ba31a3a6b7
SimHash 08004800efd2

Groups

*

Rule Path
Disallow /other-services-subsite/
Disallow /LMS/