windsurf.co.nz
robots.txt

Robots Exclusion Standard data for windsurf.co.nz

Resource Scan

Scan Details

Site Domain windsurf.co.nz
Base Domain windsurf.co.nz
Scan Status Ok
Last Scan2026-02-03T18:25:20+00:00
Next Scan 2026-02-10T18:25:20+00:00

Last Scan

Scanned2026-02-03T18:25:20+00:00
URL https://windsurf.co.nz/robots.txt
Domain IPs 14.1.45.91
Response IP 14.1.45.91
Found Yes
Hash 608eb7515506b70acd58af8ca9b03c919ae70eb197621e04f77579ef44ec5bf7
SimHash bd0e72408313

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /logs/
Disallow /weblog/
Disallow /accessprobe/
Disallow /stats/
Disallow /cams/
Disallow /webcams/
Disallow /Guestbook/
Disallow /Guestbook2/
Disallow /favicon.ico

googlebot/2.1
infonavirobot(f107)
tv33_mercator_1-1.0
avsearch-3.0
scooter/2.0
slurp/2.0
searchenginelicencesheep_v1.0
shadow/2.0
multitext/0.1
fast-webcrawler/2.2.5
atomz/1.0
htdig/ (searchit@netmind.com)
spider00.logika.net.

No rules defined. All paths allowed.

Comments

  • windsurf.co.nz Robots.txt
  • updated 17-07-2001