salisbury.sa.gov.au
robots.txt

Robots Exclusion Standard data for salisbury.sa.gov.au

Resource Scan

Scan Details

Site Domain salisbury.sa.gov.au
Base Domain salisbury.sa.gov.au
Scan Status Ok
Last Scan2024-11-13T07:49:52+00:00
Next Scan 2024-11-20T07:49:52+00:00

Last Scan

Scanned2024-11-13T07:49:52+00:00
URL https://salisbury.sa.gov.au/robots.txt
Redirect https://www.salisbury.sa.gov.au/robots.txt
Redirect Domain www.salisbury.sa.gov.au
Redirect Base salisbury.sa.gov.au
Domain IPs 3.105.235.62
Redirect IPs 18.155.68.102, 18.155.68.53, 18.155.68.60, 18.155.68.61, 2600:9000:23d2:1600:b:3160:5400:93a1, 2600:9000:23d2:3800:b:3160:5400:93a1, 2600:9000:23d2:600:b:3160:5400:93a1, 2600:9000:23d2:7000:b:3160:5400:93a1, 2600:9000:23d2:9c00:b:3160:5400:93a1, 2600:9000:23d2:b000:b:3160:5400:93a1, 2600:9000:23d2:ba00:b:3160:5400:93a1, 2600:9000:23d2:c800:b:3160:5400:93a1
Response IP 18.155.68.102
Found Yes
Hash 0d188c28441f2f8d66754bc1b5670f4c8a0f2bdb5bb274c6415b18e9945eaa82
SimHash 455013567591

Groups

*

Rule Path
Disallow /cpresources/
Disallow /vendor/
Disallow /.env

Other Records

Field Value
sitemap https://www.salisbury.sa.gov.au/sitemaps-1-sitemap.xml
sitemap https://www.salisbury.sa.gov.au/portal/sitemaps-1-sitemap.xml

Comments

  • robots.txt for https://www.salisbury.sa.gov.au/
  • live - don't allow web crawlers to index cpresources/ or vendor/