scottbaseredevelopment.govt.nz
robots.txt

Robots Exclusion Standard data for scottbaseredevelopment.govt.nz

Resource Scan

Scan Details

Site Domain scottbaseredevelopment.govt.nz
Base Domain scottbaseredevelopment.govt.nz
Scan Status Ok
Last Scan2026-02-18T18:39:45+00:00
Next Scan 2026-02-25T18:39:45+00:00

Last Scan

Scanned2026-02-18T18:39:45+00:00
URL https://scottbaseredevelopment.govt.nz/robots.txt
Redirect https://www.scottbaseredevelopment.govt.nz/robots.txt
Redirect Domain www.scottbaseredevelopment.govt.nz
Redirect Base scottbaseredevelopment.govt.nz
Domain IPs 120.138.19.149
Redirect IPs 120.138.19.149
Response IP 120.138.19.149
Found Yes
Hash 0ed0426018a70ce08620cc78361eb320f64769e4e1ec49d324be670b9d40c956
SimHash a1509d723f93

Groups

*

Rule Path
Disallow /cpresources/
Disallow /vendor/
Disallow /.env
Disallow /cache/

Other Records

Field Value
sitemap https://www.antarcticanz.govt.nz/sitemaps-1-sitemap.xml
sitemap https://www.scottbaseredevelopment.govt.nz/sitemaps-1-sitemap.xml
sitemap https://www.antarcticscienceplatform.org.nz/sitemaps-1-sitemap.xml

Comments

  • robots.txt for https://www.scottbaseredevelopment.govt.nz/
  • live - don't allow web crawlers to index cpresources/ or vendor/