rah.sa.gov.au
robots.txt

Robots Exclusion Standard data for rah.sa.gov.au

Resource Scan

Scan Details

Site Domain rah.sa.gov.au
Base Domain rah.sa.gov.au
Scan Status Ok
Last Scan2024-05-28T20:45:25+00:00
Next Scan 2024-06-27T20:45:25+00:00

Last Scan

Scanned2024-05-28T20:45:25+00:00
URL https://rah.sa.gov.au/robots.txt
Redirect https://www.rah.sa.gov.au/robots.txt
Redirect Domain www.rah.sa.gov.au
Redirect Base rah.sa.gov.au
Domain IPs 3.105.163.86
Redirect IPs 18.155.68.22, 18.155.68.42, 18.155.68.60, 18.155.68.61, 2600:9000:23d2:2400:e:2715:b980:93a1, 2600:9000:23d2:a400:e:2715:b980:93a1, 2600:9000:23d2:a600:e:2715:b980:93a1, 2600:9000:23d2:ae00:e:2715:b980:93a1, 2600:9000:23d2:c000:e:2715:b980:93a1, 2600:9000:23d2:c200:e:2715:b980:93a1, 2600:9000:23d2:c400:e:2715:b980:93a1, 2600:9000:23d2:d800:e:2715:b980:93a1
Response IP 18.155.68.61
Found Yes
Hash 3aff95740f70e262e832b23ed1e65db00454d7c636cc6e1602372cd4fe27bd8d
SimHash 01301d562513

Groups

*

Rule Path
Disallow /cpresources/
Disallow /vendor/
Disallow /.env
Disallow /cache/

Other Records

Field Value
sitemap https://www.rah.sa.gov.au/sitemaps-1-sitemap.xml

Comments

  • robots.txt for https://www.rah.sa.gov.au/
  • live - don't allow web crawlers to index cpresources/ or vendor/