salvos.org.au
robots.txt

Robots Exclusion Standard data for salvos.org.au

Resource Scan

Scan Details

Site Domain salvos.org.au
Base Domain salvos.org.au
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-07-17T03:47:24+00:00
Next Scan 2024-10-15T03:47:24+00:00

Last Successful Scan

Scanned2024-02-25T08:25:43+00:00
URL https://salvos.org.au/robots.txt
Redirect https://www.salvationarmy.org.au/robots.txt
Redirect Domain www.salvationarmy.org.au
Redirect Base salvationarmy.org.au
Domain IPs 13.33.88.120, 13.33.88.56, 13.33.88.79, 13.33.88.8
Redirect IPs 13.33.33.13, 13.33.33.16, 13.33.33.62, 13.33.33.94
Response IP 13.33.33.94
Found Yes
Hash 0a7a71c3e1176aa689b5db6318c4a6c28b696ef877561105d4c0b7eb0a637fa8
SimHash 7909b8c0ccf2

Groups

*

Rule Path
Disallow /admin/login/

semrushbot

Rule Path
Disallow /admin/login/
Disallow /youth-ya/

Other Records

Field Value
crawl-delay 60

Other Records

Field Value
sitemap https://www.salvationarmy.org.au/sitemap.xml

Comments

  • /robots.txt for www.salvationarmy.org.au