education.govt.nz
robots.txt

Robots Exclusion Standard data for education.govt.nz

Resource Scan

Scan Details

Site Domain education.govt.nz
Base Domain education.govt.nz
Scan Status Ok
Last Scan2024-11-04T15:59:49+00:00
Next Scan 2024-11-18T15:59:49+00:00

Last Scan

Scanned2024-11-04T15:59:49+00:00
URL https://education.govt.nz/robots.txt
Redirect https://www.education.govt.nz/robots.txt
Redirect Domain www.education.govt.nz
Redirect Base education.govt.nz
Domain IPs 104.18.40.190, 172.64.147.66, 2606:4700:4400::6812:28be, 2606:4700:4400::ac40:9342
Redirect IPs 104.18.40.190, 172.64.147.66, 2606:4700:4400::6812:28be, 2606:4700:4400::ac40:9342
Response IP 172.64.147.66
Found Yes
Hash ed5db97e1eda1f7d3f1dbb0310e8aff3fc2e6f1099fd3245ee4e0b72ee9131bc
SimHash 0810cb006773

Groups

*

Rule Path
Disallow /preview/

*

Rule Path
Allow /

Comments

  • Block all crawlers for /preview
  • Allow all crawlers