fishing.net.nz
robots.txt

Robots Exclusion Standard data for fishing.net.nz

Resource Scan

Scan Details

Site Domain fishing.net.nz
Base Domain fishing.net.nz
Scan Status Ok
Last Scan2025-04-08T06:26:59+00:00
Next Scan 2025-04-15T06:26:59+00:00

Last Scan

Scanned2025-04-08T06:26:59+00:00
URL https://fishing.net.nz/robots.txt
Domain IPs 104.26.0.250, 104.26.1.250, 172.67.71.75, 2606:4700:20::681a:1fa, 2606:4700:20::681a:fa, 2606:4700:20::ac43:474b
Response IP 172.67.71.75
Found Yes
Hash f913a96dc74ce93b97ef557cc66a71c117f330727e86ac4ed854b59f64ea8810
SimHash 4910da50c670

Groups

*

Rule Path
Allow /
Disallow /admin/
Disallow /tasks/
Disallow /requirements/
Disallow /config/
Disallow /sites/default/includes/display_objects/custom/bitetimes/cgi-bin/bitedata.cgi
Disallow /sites/default/includes/display_objects/custom/bitetimes/cgi-bin/bite5.cgi
Disallow /_autopasswordrequest.cfm
Disallow /_commentpage.cfm
Disallow /_likepage.cfm