taupocollege.ac.nz
robots.txt

Robots Exclusion Standard data for taupocollege.ac.nz

Resource Scan

Scan Details

Site Domain taupocollege.ac.nz
Base Domain taupocollege.ac.nz
Scan Status Ok
Last Scan2024-06-11T13:13:45+00:00
Next Scan 2024-07-11T13:13:45+00:00

Last Scan

Scanned2024-06-11T13:13:45+00:00
URL https://taupocollege.ac.nz/robots.txt
Domain IPs 104.21.67.136, 172.67.176.235, 2606:4700:3034::6815:4388, 2606:4700:3035::ac43:b0eb
Response IP 172.67.176.235
Found Yes
Hash e56d83a404f3017f7301a5b62612fffc7dda8c5244cb9d8cc60efdb3d8d67f4e
SimHash 0045cad04511

Groups

googlebot

Rule Path
Allow *.css*
Allow *.js*

*

Rule Path
Disallow /admin/

baiduspider

Rule Path
Disallow /

yandex

Rule Path
Disallow /

Comments

  • Googlebot
  • Allbots
  • Baiduspider
  • Yandex